2023-07-13T12:19:28.218 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T12:19:28.220 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_matan@teuthology --verbose --description fs:verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} --name matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi --archive /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090 -- /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/orig.config.yaml 2023-07-13T12:19:28.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T12:19:28.352 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090 branch: main description: fs:verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} email: null first_in_suite: false job_id: '7336090' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: f0b380e693e28c35a89e7c2062b0976b7def7973 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: f0b380e693e28c35a89e7c2062b0976b7def7973 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 68df405e530cc8317c62abf2bfc4458a41023b59 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 sha1: f0b380e693e28c35a89e7c2062b0976b7def7973 sleep_before_teardown: 0 suite: fs:verify suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_68df405e530cc8317c62abf2bfc4458a41023b59/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 68df405e530cc8317c62abf2bfc4458a41023b59 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi118.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3Mna00yLVPHncl6oc7Y9Amf4aFlw2hLXHndF4YDriNgrX6lPR/c8ETczOKv7PcBKwOFgfZT123gd9GT2XHLJI5nFNMrPu6dkn+bvH2wz62D5SfL9yNu8hgDqjCAl7N5+TXa7uWUIi2WPq8wk27GQlqdg+I3vRlbvDTsThblukUualPREj0j/vXnBZ4YxDF8kS+R9o5mFwKWGrmOmupZf24YNGuKJ1L3L4d+WsDXnHGzyuR7twuD9o4AWQrSbhsfKNEk+gBCEda6gGMg6RHUrYCtKa8mHjK3VjS1p0rgnUJtnMoH2bjVb5QAiVIgayDMk9siq+CBcsctLnBEgxlC1JE5/BFNoln5MEsboigc5eSreCL8RfcnqvDWpes6OK2btpt7NN58Qtc9GICw1l1ZqpnjRHxGCoOrtieN8IyNUUA6QY5q/sQ2lnWaktE9rofCLkJ+5HlRnwuX9/+7/v+X5/idkDUi8bwj0JSU5kiHZ1nSFQprPI4YDNZOYmQRCcehs= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHchmyXf71FoMjzc4gel+uknrOySkqwMGM2j7V6w3y5U1XIXal9UUqr+ZvMNTemEG+60j7l3jBN1EfuGxTjiNZA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 073e6eb1231451146b4a01d0b85b4f490f71d266 timestamp: 2023-07-13_12:11:45 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-13T12:19:28.352 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_68df405e530cc8317c62abf2bfc4458a41023b59/qa; will attempt to use it 2023-07-13T12:19:28.353 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_68df405e530cc8317c62abf2bfc4458a41023b59/qa/tasks 2023-07-13T12:19:28.353 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-13T12:19:28.357 INFO:teuthology.task.internal:Checking packages... 2023-07-13T12:19:28.397 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f0b380e693e28c35a89e7c2062b0976b7def7973' 2023-07-13T12:19:28.398 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-13T12:19:28.398 INFO:teuthology.packaging:ref: None 2023-07-13T12:19:28.398 INFO:teuthology.packaging:tag: None 2023-07-13T12:19:28.399 INFO:teuthology.packaging:branch: main 2023-07-13T12:19:28.399 INFO:teuthology.packaging:sha1: f0b380e693e28c35a89e7c2062b0976b7def7973 2023-07-13T12:19:28.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-07-13T12:19:28.767 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4869.g05e449f9 2023-07-13T12:19:28.768 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-13T12:19:28.773 INFO:teuthology.task.internal:no buildpackages task found 2023-07-13T12:19:28.773 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-13T12:19:28.812 INFO:teuthology.task.internal:Saving configuration 2023-07-13T12:19:28.832 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-13T12:19:28.893 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T12:19:28.923 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 12:13:41.529694', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPUXf96JyI4/KyYeatIbpcdWvF9DRcpDW+NBShijQWMwRWQdyJNcBlaMZgqwkvXadhM1ldK1pAMfluyYYVVyjAY='} 2023-07-13T12:19:28.950 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 12:13:41.527387', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHchmyXf71FoMjzc4gel+uknrOySkqwMGM2j7V6w3y5U1XIXal9UUqr+ZvMNTemEG+60j7l3jBN1EfuGxTjiNZA='} 2023-07-13T12:19:28.951 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-13T12:19:28.958 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-07-13T12:19:28.958 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-07-13T12:19:28.958 INFO:teuthology.run_tasks:Running task console_log... 2023-07-13T12:19:29.045 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9e4fcae3a0>, signals=[15]) 2023-07-13T12:19:29.047 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-13T12:19:29.055 INFO:teuthology.task.internal:Opening connections... 2023-07-13T12:19:29.056 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T12:19:29.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:19:29.132 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T12:19:29.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:19:29.200 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-13T12:19:29.206 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-07-13T12:19:29.229 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-07-13T12:19:29.230 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-13T12:19:29.291 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2023-07-13T12:19:29.291 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8" 2023-07-13T12:19:29.291 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2023-07-13T12:19:29.292 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2023-07-13T12:19:29.292 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8" 2023-07-13T12:19:29.292 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-07-13T12:19:29.292 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T12:19:29.292 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-07-13T12:19:29.292 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T12:19:29.292 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2023-07-13T12:19:29.293 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T12:19:29.293 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T12:19:29.293 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T12:19:29.293 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-13T12:19:29.318 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-07-13T12:19:29.342 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-07-13T12:19:29.343 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-07-13T12:19:29.405 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-07-13T12:19:29.405 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-07-13T12:19:29.405 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-07-13T12:19:29.405 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-07-13T12:19:29.405 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-07-13T12:19:29.405 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-07-13T12:19:29.406 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T12:19:29.406 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-07-13T12:19:29.406 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T12:19:29.406 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-07-13T12:19:29.406 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T12:19:29.406 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T12:19:29.406 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T12:19:29.407 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-13T12:19:29.434 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-13T12:19:29.453 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-13T12:19:29.465 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-13T12:19:29.466 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-07-13T12:19:29.469 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2023-07-13T12:19:29.489 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-13T12:19:29.498 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-13T12:19:29.498 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-07-13T12:19:29.530 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2023-07-13T12:19:29.571 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-13T12:19:29.640 INFO:teuthology.run_tasks:Running task kernel... 2023-07-13T12:19:29.665 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-07-13T12:19:29.666 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-07-13T12:19:29.666 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-13T12:19:29.668 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-13T12:19:29.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T12:19:29.689 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-07-13T12:19:29.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T12:19:29.690 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-07-13T12:19:29.751 INFO:teuthology.orchestra.run.smithi118.stdout:4.18.0-489.el8.x86_64 2023-07-13T12:19:29.751 INFO:teuthology.task.kernel:Running kernel on smithi118: 4.18.0-489.el8.x86_64 2023-07-13T12:19:29.752 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum install -y kernel 2023-07-13T12:19:29.753 INFO:teuthology.orchestra.run.smithi123.stdout:4.18.0-489.el8.x86_64 2023-07-13T12:19:29.754 INFO:teuthology.task.kernel:Running kernel on smithi123: 4.18.0-489.el8.x86_64 2023-07-13T12:19:29.754 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2023-07-13T12:19:34.770 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - AppStream 12 MB/s | 31 MB 00:02 2023-07-13T12:19:35.033 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - AppStream 12 MB/s | 31 MB 00:02 2023-07-13T12:26:39.699 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - BaseOS 100 kB/s | 41 MB 06:59 2023-07-13T12:26:46.173 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras 36 kB/s | 18 kB 00:00 2023-07-13T12:26:48.007 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras common packages 3.9 kB/s | 6.6 kB 00:01 2023-07-13T12:26:50.967 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 1.2 kB/s | 3.5 kB 00:02 2023-07-13T12:27:27.481 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 439 kB/s | 16 MB 00:36 2023-07-13T12:27:31.262 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 558 kB/s | 24 kB 00:00 2023-07-13T12:27:34.444 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-07-13T12:27:34.444 INFO:teuthology.orchestra.run.smithi118.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-07-13T12:27:34.667 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-07-13T12:27:34.668 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-07-13T12:27:34.668 INFO:teuthology.orchestra.run.smithi118.stdout: Package Architecture Version Repository Size 2023-07-13T12:27:34.669 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-07-13T12:27:34.669 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-07-13T12:27:34.669 INFO:teuthology.orchestra.run.smithi118.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-07-13T12:27:34.669 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-07-13T12:27:34.669 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-07-13T12:27:34.669 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-07-13T12:27:34.669 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T12:27:34.670 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-07-13T12:27:34.670 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2023-07-13T12:27:34.670 INFO:teuthology.orchestra.run.smithi118.stdout:Install 3 Packages 2023-07-13T12:27:34.670 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T12:27:34.671 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 88 M 2023-07-13T12:27:34.671 INFO:teuthology.orchestra.run.smithi118.stdout:Installed size: 95 M 2023-07-13T12:27:34.671 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-07-13T12:27:48.850 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - BaseOS 86 kB/s | 41 MB 08:08 2023-07-13T12:27:55.250 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - Extras 41 kB/s | 18 kB 00:00 2023-07-13T12:27:56.284 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - Extras common packages 7.6 kB/s | 6.6 kB 00:00 2023-07-13T12:27:59.194 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-13T12:28:13.368 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 16 MB 00:14 2023-07-13T12:28:17.068 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 578 kB/s | 24 kB 00:00 2023-07-13T12:28:20.191 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-07-13T12:28:20.192 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-07-13T12:28:20.410 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-07-13T12:28:20.411 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-07-13T12:28:20.411 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2023-07-13T12:28:20.411 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-07-13T12:28:20.411 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-07-13T12:28:20.411 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 4.18.0-500.el8 baseos 9.8 M 2023-07-13T12:28:20.411 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-07-13T12:28:20.412 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-core x86_64 4.18.0-500.el8 baseos 43 M 2023-07-13T12:28:20.412 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules x86_64 4.18.0-500.el8 baseos 35 M 2023-07-13T12:28:20.412 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T12:28:20.412 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-07-13T12:28:20.412 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2023-07-13T12:28:20.412 INFO:teuthology.orchestra.run.smithi123.stdout:Install 3 Packages 2023-07-13T12:28:20.412 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T12:28:20.413 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 88 M 2023-07-13T12:28:20.413 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 95 M 2023-07-13T12:28:20.414 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-07-13T12:29:58.552 INFO:teuthology.orchestra.run.smithi118.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 70 kB/s | 9.8 MB 02:23 2023-07-13T12:30:46.866 INFO:teuthology.orchestra.run.smithi123.stdout:(1/3): kernel-4.18.0-500.el8.x86_64.rpm 69 kB/s | 9.8 MB 02:26 2023-07-13T12:35:50.294 INFO:teuthology.orchestra.run.smithi118.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 73 kB/s | 35 MB 08:15 2023-07-13T12:36:25.567 INFO:teuthology.orchestra.run.smithi123.stdout:(2/3): kernel-modules-4.18.0-500.el8.x86_64.rpm 74 kB/s | 35 MB 08:04 2023-07-13T12:37:11.220 INFO:teuthology.orchestra.run.smithi118.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 76 kB/s | 43 MB 09:36 2023-07-13T12:37:11.221 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-07-13T12:37:11.221 INFO:teuthology.orchestra.run.smithi118.stdout:Total 156 kB/s | 88 MB 09:36 2023-07-13T12:37:11.882 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-07-13T12:37:12.345 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-07-13T12:37:12.345 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-07-13T12:37:13.618 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-07-13T12:37:13.656 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-07-13T12:37:16.388 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-07-13T12:37:16.904 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-13T12:37:20.491 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-13T12:37:20.853 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-13T12:37:24.205 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-13T12:37:24.497 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:37:41.466 INFO:teuthology.orchestra.run.smithi123.stdout:(3/3): kernel-core-4.18.0-500.el8.x86_64.rpm 78 kB/s | 43 MB 09:20 2023-07-13T12:37:41.466 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-07-13T12:37:41.466 INFO:teuthology.orchestra.run.smithi123.stdout:Total 160 kB/s | 88 MB 09:21 2023-07-13T12:37:42.123 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-07-13T12:37:42.545 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-07-13T12:37:42.546 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-07-13T12:37:43.760 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-07-13T12:37:43.794 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-07-13T12:37:46.178 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:37:46.200 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:37:46.538 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:37:46.538 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-07-13T12:37:46.538 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-07-13T12:37:46.542 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-07-13T12:37:47.031 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-13T12:37:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:37:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T12:37:47.200 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-07-13T12:37:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-07-13T12:37:47.200 INFO:teuthology.orchestra.run.smithi118.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-07-13T12:37:47.201 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T12:37:47.201 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-07-13T12:37:47.333 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2023-07-13T12:37:47.550 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-13T12:37:47.551 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-13T12:37:47.551 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-07-13T12:37:47.551 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-13T12:37:47.552 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-13T12:37:47.552 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-07-13T12:37:47.552 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2023-07-13T12:37:47.552 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q kernel | sort -rV | head -n 1 2023-07-13T12:37:47.758 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-13T12:37:47.758 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-13T12:37:47.759 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2023-07-13T12:37:47.792 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2023-07-13T12:37:47.793 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2023-07-13T12:37:47.793 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.02 2023-07-13T12:37:47.793 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 129.el8 2023-07-13T12:37:47.793 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2023-07-13T12:37:47.793 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-13T12:37:47.793 INFO:teuthology.orchestra.run.smithi118.stdout:Group : System Environment/Base 2023-07-13T12:37:47.794 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 9265586 2023-07-13T12:37:47.794 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2023-07-13T12:37:47.794 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-13T12:37:47.794 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-13T12:37:47.794 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-13T12:37:47.794 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-13T12:37:47.794 INFO:teuthology.orchestra.run.smithi118.stdout:Relocations : (not relocatable) 2023-07-13T12:37:47.795 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : CentOS BuildSystem 2023-07-13T12:37:47.795 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2023-07-13T12:37:47.795 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-13T12:37:47.795 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2023-07-13T12:37:47.795 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2023-07-13T12:37:47.795 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T12:37:47.795 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-13T12:37:47.796 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-13T12:37:47.796 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-13T12:37:47.796 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2023-07-13T12:37:47.796 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T12:37:47.796 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2023-07-13T12:37:47.797 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-13T12:37:47.797 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 4.18.0-500.el8.x86_64 2023-07-13T12:37:47.797 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-13T12:37:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2023-07-13T12:37:50.617 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 1/3 2023-07-13T12:37:51.030 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-13T12:37:52.933 INFO:teuthology.orchestra.run.smithi118.stderr:done 2023-07-13T12:37:52.934 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-07-13T12:37:52.997 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.F975eoIcuZ 2023-07-13T12:37:52.998 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.F975eoIcuZ 2023-07-13T12:37:53.071 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.F975eoIcuZ 2023-07-13T12:37:53.237 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.F975eoIcuZ is 6KB 2023-07-13T12:37:53.284 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.F975eoIcuZ 2023-07-13T12:37:53.301 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2023-07-13T12:37:53.398 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-13T12:37:53.398 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-13T12:37:53.398 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-13T12:37:53.398 INFO:teuthology.orchestra.run.smithi118.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-07-13T12:37:53.399 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-07-13T12:37:53.539 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2023-07-13T12:37:54.381 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 2/3 2023-07-13T12:37:54.717 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:38:16.333 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:38:16.356 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:38:16.691 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:38:16.691 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-4.18.0-500.el8.x86_64 1/3 2023-07-13T12:38:16.692 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-core-4.18.0-500.el8.x86_64 2/3 2023-07-13T12:38:17.354 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-modules-4.18.0-500.el8.x86_64 3/3 2023-07-13T12:38:17.354 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T12:38:17.354 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-07-13T12:38:17.355 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-4.18.0-500.el8.x86_64 kernel-core-4.18.0-500.el8.x86_64 2023-07-13T12:38:17.355 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-4.18.0-500.el8.x86_64 2023-07-13T12:38:17.355 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T12:38:17.355 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-07-13T12:38:17.679 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2023-07-13T12:38:17.895 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-13T12:38:17.896 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-13T12:38:17.896 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-500.el8.x86_64 2023-07-13T12:38:17.896 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-13T12:38:17.897 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-13T12:38:17.897 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-07-13T12:38:17.897 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=None, version=distro) 2023-07-13T12:38:17.897 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2023-07-13T12:38:18.104 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-4.18.0-500.el8.x86_64 2023-07-13T12:38:18.105 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-500.el8.x86_64 2023-07-13T12:38:18.105 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -qi grub2-tools 2023-07-13T12:38:18.138 INFO:teuthology.orchestra.run.smithi123.stdout:Name : grub2-tools 2023-07-13T12:38:18.139 INFO:teuthology.orchestra.run.smithi123.stdout:Epoch : 1 2023-07-13T12:38:18.139 INFO:teuthology.orchestra.run.smithi123.stdout:Version : 2.02 2023-07-13T12:38:18.139 INFO:teuthology.orchestra.run.smithi123.stdout:Release : 129.el8 2023-07-13T12:38:18.139 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: x86_64 2023-07-13T12:38:18.139 INFO:teuthology.orchestra.run.smithi123.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-13T12:38:18.139 INFO:teuthology.orchestra.run.smithi123.stdout:Group : System Environment/Base 2023-07-13T12:38:18.140 INFO:teuthology.orchestra.run.smithi123.stdout:Size : 9265586 2023-07-13T12:38:18.140 INFO:teuthology.orchestra.run.smithi123.stdout:License : GPLv3+ 2023-07-13T12:38:18.140 INFO:teuthology.orchestra.run.smithi123.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-13T12:38:18.140 INFO:teuthology.orchestra.run.smithi123.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-13T12:38:18.140 INFO:teuthology.orchestra.run.smithi123.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-13T12:38:18.140 INFO:teuthology.orchestra.run.smithi123.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-13T12:38:18.140 INFO:teuthology.orchestra.run.smithi123.stdout:Relocations : (not relocatable) 2023-07-13T12:38:18.141 INFO:teuthology.orchestra.run.smithi123.stdout:Packager : CentOS BuildSystem 2023-07-13T12:38:18.141 INFO:teuthology.orchestra.run.smithi123.stdout:Vendor : CentOS 2023-07-13T12:38:18.141 INFO:teuthology.orchestra.run.smithi123.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-13T12:38:18.141 INFO:teuthology.orchestra.run.smithi123.stdout:Summary : Support tools for GRUB. 2023-07-13T12:38:18.141 INFO:teuthology.orchestra.run.smithi123.stdout:Description : 2023-07-13T12:38:18.141 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T12:38:18.141 INFO:teuthology.orchestra.run.smithi123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-13T12:38:18.141 INFO:teuthology.orchestra.run.smithi123.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-13T12:38:18.142 INFO:teuthology.orchestra.run.smithi123.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-13T12:38:18.142 INFO:teuthology.orchestra.run.smithi123.stdout:hardware devices. 2023-07-13T12:38:18.142 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T12:38:18.142 INFO:teuthology.orchestra.run.smithi123.stdout:This subpackage provides tools for support of all platforms. 2023-07-13T12:38:18.143 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-13T12:38:18.143 INFO:teuthology.task.kernel:Updating grub on smithi123 to boot 4.18.0-500.el8.x86_64 2023-07-13T12:38:18.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-13T12:38:19.653 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2023-07-13T12:38:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:done 2023-07-13T12:38:22.082 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-07-13T12:38:22.109 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.B7bk7eaBNG 2023-07-13T12:38:22.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B7bk7eaBNG 2023-07-13T12:38:22.200 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.B7bk7eaBNG 2023-07-13T12:38:22.322 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.B7bk7eaBNG is 6KB 2023-07-13T12:38:22.369 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.B7bk7eaBNG 2023-07-13T12:38:22.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo /bin/ls /boot/loader/entries || true 2023-07-13T12:38:22.462 INFO:teuthology.orchestra.run.smithi123.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-13T12:38:22.463 INFO:teuthology.orchestra.run.smithi123.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-13T12:38:22.463 INFO:teuthology.orchestra.run.smithi123.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-13T12:38:22.463 INFO:teuthology.orchestra.run.smithi123.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64.conf 2023-07-13T12:38:22.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-500.el8.x86_64 2023-07-13T12:38:22.632 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2023-07-13T12:38:23.543 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-13T12:38:23.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-13T12:38:23.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:38:52.664 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-13T12:38:52.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-13T12:38:52.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:38:58.160 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-13T12:39:07.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-13T12:39:07.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:39:10.224 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-13T12:39:22.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-13T12:39:22.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:39:52.696 DEBUG:teuthology.orchestra.remote:timed out 2023-07-13T12:39:54.428 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-07-13T12:39:54.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-13T12:39:54.760 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-500.el8.x86_64"... 2023-07-13T12:39:54.760 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-07-13T12:39:54.777 INFO:teuthology.orchestra.run.smithi118.stdout:4.18.0-500.el8.x86_64 2023-07-13T12:39:54.778 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-07-13T12:39:54.778 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-13T12:39:54.778 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-13T12:39:55.779 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-13T12:39:55.779 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-13T12:39:55.861 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2023-07-13T12:39:55.874 DEBUG:teuthology.parallel:result is None 2023-07-13T12:40:01.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-13T12:40:01.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:40:02.044 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-13T12:40:02.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-13T12:40:02.460 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-500.el8.x86_64"... 2023-07-13T12:40:02.460 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-07-13T12:40:02.479 INFO:teuthology.orchestra.run.smithi123.stdout:4.18.0-500.el8.x86_64 2023-07-13T12:40:02.479 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-500.el8.x86_64 vs 4.18.0-500.el8.x86_64 2023-07-13T12:40:02.480 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-13T12:40:02.480 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-13T12:40:03.481 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-13T12:40:03.481 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-13T12:40:03.538 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2023-07-13T12:40:03.553 DEBUG:teuthology.parallel:result is None 2023-07-13T12:40:03.553 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-13T12:40:03.562 INFO:teuthology.task.internal:Creating test directory... 2023-07-13T12:40:03.562 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-13T12:40:03.565 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-13T12:40:03.585 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-13T12:40:03.595 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-13T12:40:03.619 INFO:teuthology.task.internal:Creating archive directory... 2023-07-13T12:40:03.620 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-13T12:40:03.627 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-13T12:40:03.673 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-13T12:40:03.681 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-13T12:40:03.682 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-13T12:40:03.694 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-13T12:40:03.735 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T12:40:03.739 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T12:40:03.748 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T12:40:03.750 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T12:40:03.752 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-13T12:40:03.762 INFO:teuthology.task.internal:Configuring sudo... 2023-07-13T12:40:03.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-13T12:40:03.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-13T12:40:03.823 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-13T12:40:03.832 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-13T12:40:03.833 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-13T12:40:03.866 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-13T12:40:03.885 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T12:40:03.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T12:40:04.049 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T12:40:04.101 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T12:40:04.147 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T12:40:04.147 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-13T12:40:04.218 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T12:40:04.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T12:40:04.317 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T12:40:04.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T12:40:04.443 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T12:40:04.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-13T12:40:04.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-07-13T12:40:04.530 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2023-07-13T12:40:04.594 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-13T12:40:04.625 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-13T12:40:05.070 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-13T12:40:05.078 INFO:teuthology.task.internal:Starting timer... 2023-07-13T12:40:05.079 INFO:teuthology.run_tasks:Running task pcp... 2023-07-13T12:40:05.184 INFO:teuthology.run_tasks:Running task selinux... 2023-07-13T12:40:05.225 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-13T12:40:05.226 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2023-07-13T12:40:05.317 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2023-07-13T12:40:05.319 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2023-07-13T12:40:05.423 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2023-07-13T12:40:05.424 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-13T12:40:05.425 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2023-07-13T12:40:05.456 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2023-07-13T12:40:05.457 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2023-07-13T12:40:05.514 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2023-07-13T12:40:05.515 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi118.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi123.front.sepia.ceph.com': 'permissive'} 2023-07-13T12:40:05.515 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-13T12:40:05.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T12:40:05.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-13T12:40:05.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T12:40:05.574 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-13T12:40:05.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2023-07-13T12:40:05.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2023-07-13T12:40:05.644 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-13T12:40:05.655 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-13T12:40:05.655 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-13T12:40:05.680 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-13T12:40:05.682 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi118.front.sepia.ceph.com,smithi123.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-13T12:49:16.373 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi123.front.sepia.ceph.com')] 2023-07-13T12:49:16.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-13T12:49:16.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:49:16.444 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-07-13T12:49:16.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-13T12:49:16.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-13T12:49:16.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T12:49:16.577 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-13T12:49:16.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-13T12:49:16.651 INFO:teuthology.run_tasks:Running task clock... 2023-07-13T12:49:16.664 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-13T12:49:16.665 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-13T12:49:16.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T12:49:16.667 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-13T12:49:16.668 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T12:49:16.698 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-13T12:49:16.713 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-13T12:49:16.723 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-13T12:49:16.737 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-13T12:49:16.779 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2023-07-13T12:49:16.790 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2023-07-13T12:49:16.799 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2023-07-13T12:49:16.803 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-13T12:49:16.810 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2023-07-13T12:49:16.817 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-13T12:49:16.823 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-13T12:49:16.837 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-13T12:49:16.891 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-07-13T12:49:16.895 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-13T12:49:16.895 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-07-13T12:49:16.895 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T12:49:16.895 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T12:49:16.895 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T12:49:16.896 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T12:49:16.909 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2023-07-13T12:49:16.913 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-13T12:49:16.913 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2023-07-13T12:49:16.913 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T12:49:16.914 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T12:49:16.914 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T12:49:16.914 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T12:49:16.915 INFO:teuthology.run_tasks:Running task install... 2023-07-13T12:49:16.923 DEBUG:teuthology.task.install:project ceph 2023-07-13T12:49:16.923 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'f0b380e693e28c35a89e7c2062b0976b7def7973'}} 2023-07-13T12:49:16.923 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'f0b380e693e28c35a89e7c2062b0976b7def7973'} 2023-07-13T12:49:16.924 INFO:teuthology.task.install:Using flavor: default 2023-07-13T12:49:16.929 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-07-13T12:49:16.930 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-13T12:49:16.930 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f0b380e693e28c35a89e7c2062b0976b7def7973', 'tag': None, 'wait_for_package': False} 2023-07-13T12:49:16.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f0b380e693e28c35a89e7c2062b0976b7def7973 2023-07-13T12:49:16.932 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f0b380e693e28c35a89e7c2062b0976b7def7973', 'tag': None, 'wait_for_package': False} 2023-07-13T12:49:16.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f0b380e693e28c35a89e7c2062b0976b7def7973 2023-07-13T12:49:17.424 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/f0b380e693e28c35a89e7c2062b0976b7def7973/centos/8/flavors/default/ 2023-07-13T12:49:17.424 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4842.gf0b380e6 2023-07-13T12:49:17.428 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/f0b380e693e28c35a89e7c2062b0976b7def7973/centos/8/flavors/default/ 2023-07-13T12:49:17.428 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4842.gf0b380e6 2023-07-13T12:49:17.821 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/f0b380e693e28c35a89e7c2062b0976b7def7973/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/f0b380e693e28c35a89e7c2062b0976b7def7973/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/f0b380e693e28c35a89e7c2062b0976b7def7973/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-13T12:49:17.821 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T12:49:17.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-13T12:49:17.824 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/f0b380e693e28c35a89e7c2062b0976b7def7973/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/f0b380e693e28c35a89e7c2062b0976b7def7973/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/f0b380e693e28c35a89e7c2062b0976b7def7973/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-13T12:49:17.825 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T12:49:17.825 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-13T12:49:17.855 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-13T12:49:17.855 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f0b380e693e28c35a89e7c2062b0976b7def7973/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-13T12:49:17.858 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-13T12:49:17.858 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f0b380e693e28c35a89e7c2062b0976b7def7973/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-13T12:49:17.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-13T12:49:17.929 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-13T12:49:18.008 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-13T12:49:18.010 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-13T12:49:18.076 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2023-07-13T12:49:18.077 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2023-07-13T12:49:18.080 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2023-07-13T12:49:18.081 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2023-07-13T12:49:18.344 INFO:teuthology.orchestra.run.smithi123.stdout:73 files removed 2023-07-13T12:49:18.368 INFO:teuthology.orchestra.run.smithi118.stdout:73 files removed 2023-07-13T12:49:18.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-13T12:49:18.398 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-13T12:49:19.575 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 101 kB/s | 81 kB 00:00 2023-07-13T12:49:19.580 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 105 kB/s | 81 kB 00:00 2023-07-13T12:49:20.176 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-07-13T12:49:20.181 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 17 kB/s | 9.4 kB 00:00 2023-07-13T12:49:20.732 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 2.9 kB/s | 1.5 kB 00:00 2023-07-13T12:49:20.735 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 2.8 kB/s | 1.5 kB 00:00 2023-07-13T12:49:23.094 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - AppStream 13 MB/s | 31 MB 00:02 2023-07-13T12:49:23.807 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - AppStream 10 MB/s | 31 MB 00:03 2023-07-13T12:51:48.029 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - BaseOS 303 kB/s | 41 MB 02:18 2023-07-13T12:51:54.530 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2023-07-13T12:51:54.713 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - BaseOS 287 kB/s | 41 MB 02:26 2023-07-13T12:51:55.463 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - Extras common packages 8.6 kB/s | 6.6 kB 00:00 2023-07-13T12:51:56.823 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 8 - PowerTools 5.2 MB/s | 6.3 MB 00:01 2023-07-13T12:52:00.833 INFO:teuthology.orchestra.run.smithi118.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-13T12:52:01.304 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - Extras 28 kB/s | 18 kB 00:00 2023-07-13T12:52:02.230 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - Extras common packages 8.7 kB/s | 6.6 kB 00:00 2023-07-13T12:52:02.942 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 16 MB 00:01 2023-07-13T12:52:03.681 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 8 - PowerTools 4.8 MB/s | 6.3 MB 00:01 2023-07-13T12:52:06.667 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 535 kB/s | 24 kB 00:00 2023-07-13T12:52:07.633 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-13T12:52:10.470 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-13T12:52:10.471 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-13T12:52:10.501 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-13T12:52:10.501 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-13T12:52:10.502 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-13T12:52:10.503 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-13T12:52:10.504 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-13T12:52:10.506 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-13T12:52:10.508 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-13T12:52:10.509 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-13T12:52:10.694 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2023-07-13T12:52:10.709 INFO:teuthology.orchestra.run.smithi118.stdout:======================================================================================================== 2023-07-13T12:52:10.710 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2023-07-13T12:52:10.710 INFO:teuthology.orchestra.run.smithi118.stdout:======================================================================================================== 2023-07-13T12:52:10.710 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2023-07-13T12:52:10.710 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-13T12:52:10.710 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 6.4 k 2023-07-13T12:52:10.711 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 5.4 M 2023-07-13T12:52:10.711 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 95 M 2023-07-13T12:52:10.711 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 550 M 2023-07-13T12:52:10.711 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 849 k 2023-07-13T12:52:10.711 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 12 M 2023-07-13T12:52:10.711 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 165 k 2023-07-13T12:52:10.712 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 2.7 M 2023-07-13T12:52:10.712 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 58 M 2023-07-13T12:52:10.712 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 1.5 M 2023-07-13T12:52:10.712 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 129 k 2023-07-13T12:52:10.712 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 1.7 M 2023-07-13T12:52:10.713 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 30 M 2023-07-13T12:52:10.713 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 7.4 M 2023-07-13T12:52:10.713 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 47 k 2023-07-13T12:52:10.713 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 119 M 2023-07-13T12:52:10.713 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 351 M 2023-07-13T12:52:10.713 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 13 M 2023-07-13T12:52:10.713 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 276 M 2023-07-13T12:52:10.714 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 48 M 2023-07-13T12:52:10.714 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 891 M 2023-07-13T12:52:10.714 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 258 k 2023-07-13T12:52:10.714 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 164 k 2023-07-13T12:52:10.714 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 258 k 2023-07-13T12:52:10.714 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 18 k 2023-07-13T12:52:10.714 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-13T12:52:10.714 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-13T12:52:10.715 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-13T12:52:10.715 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 31 k 2023-07-13T12:52:10.715 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 772 k 2023-07-13T12:52:10.715 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 11 M 2023-07-13T12:52:10.715 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 139 k 2023-07-13T12:52:10.715 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 129 k 2023-07-13T12:52:10.715 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 65 M 2023-07-13T12:52:10.716 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 82 M 2023-07-13T12:52:10.716 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-13T12:52:10.716 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-13T12:52:10.716 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-13T12:52:10.716 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-13T12:52:10.716 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-13T12:52:10.716 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-13T12:52:10.716 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 197 k 2023-07-13T12:52:10.717 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 642 k 2023-07-13T12:52:10.717 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 371 k 2023-07-13T12:52:10.717 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 723 k 2023-07-13T12:52:10.717 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 363 k 2023-07-13T12:52:10.717 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 1.2 M 2023-07-13T12:52:10.717 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 107 k 2023-07-13T12:52:10.718 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 318 k 2023-07-13T12:52:10.718 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 94 k 2023-07-13T12:52:10.718 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 1.2 M 2023-07-13T12:52:10.718 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 3.4 M 2023-07-13T12:52:10.718 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 73 M 2023-07-13T12:52:10.718 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 179 k 2023-07-13T12:52:10.718 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 2.0 M 2023-07-13T12:52:10.719 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-13T12:52:10.719 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2023-07-13T12:52:10.719 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-13T12:52:10.719 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-13T12:52:10.719 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-13T12:52:10.719 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-13T12:52:10.719 INFO:teuthology.orchestra.run.smithi118.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-13T12:52:10.720 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-13T12:52:10.720 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-13T12:52:10.720 INFO:teuthology.orchestra.run.smithi118.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-13T12:52:10.720 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 3.7 M 2023-07-13T12:52:10.720 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 3.6 M 2023-07-13T12:52:10.720 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-13T12:52:10.720 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-13T12:52:10.720 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-13T12:52:10.721 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-13T12:52:10.721 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-13T12:52:10.721 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-13T12:52:10.721 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2023-07-13T12:52:10.721 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-13T12:52:10.721 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 22 M 2023-07-13T12:52:10.721 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 14 M 2023-07-13T12:52:10.722 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 23 k 2023-07-13T12:52:10.722 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 2.3 M 2023-07-13T12:52:10.722 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 241 k 2023-07-13T12:52:10.722 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 4.6 M 2023-07-13T12:52:10.722 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 18 M 2023-07-13T12:52:10.722 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 15 k 2023-07-13T12:52:10.722 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 24 k 2023-07-13T12:52:10.722 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-13T12:52:10.723 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-13T12:52:10.723 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-13T12:52:10.723 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-13T12:52:10.723 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-13T12:52:10.723 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 137 k 2023-07-13T12:52:10.723 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-13T12:52:10.723 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-13T12:52:10.724 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-13T12:52:10.724 INFO:teuthology.orchestra.run.smithi118.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-13T12:52:10.724 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-13T12:52:10.724 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-13T12:52:10.724 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 473 k 2023-07-13T12:52:10.724 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-13T12:52:10.724 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 6.7 M 2023-07-13T12:52:10.724 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-13T12:52:10.725 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-13T12:52:10.725 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-13T12:52:10.725 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-13T12:52:10.725 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-13T12:52:10.725 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-13T12:52:10.725 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-13T12:52:10.725 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-13T12:52:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-13T12:52:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-13T12:52:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-13T12:52:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-13T12:52:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-13T12:52:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-13T12:52:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-13T12:52:10.726 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-13T12:52:10.727 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-13T12:52:10.727 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 45 k 2023-07-13T12:52:10.727 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 122 k 2023-07-13T12:52:10.727 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-13T12:52:10.727 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-13T12:52:10.727 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-13T12:52:10.727 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-13T12:52:10.727 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-13T12:52:10.728 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-13T12:52:10.728 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-13T12:52:10.728 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-13T12:52:10.728 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-13T12:52:10.728 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-13T12:52:10.728 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-13T12:52:10.728 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-13T12:52:10.729 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-13T12:52:10.729 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-13T12:52:10.729 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-13T12:52:10.729 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-13T12:52:10.729 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-13T12:52:10.729 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-13T12:52:10.729 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-13T12:52:10.729 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-13T12:52:10.730 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-13T12:52:10.730 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-13T12:52:10.730 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-13T12:52:10.730 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-13T12:52:10.730 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-13T12:52:10.730 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-13T12:52:10.730 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-13T12:52:10.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-13T12:52:10.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-13T12:52:10.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-13T12:52:10.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-13T12:52:10.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-13T12:52:10.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-13T12:52:10.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-13T12:52:10.731 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-13T12:52:10.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-13T12:52:10.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-13T12:52:10.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-13T12:52:10.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-13T12:52:10.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-13T12:52:10.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-13T12:52:10.732 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-13T12:52:10.733 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-13T12:52:10.733 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-13T12:52:10.733 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-13T12:52:10.733 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-13T12:52:10.733 INFO:teuthology.orchestra.run.smithi118.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-13T12:52:10.733 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-13T12:52:10.733 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-13T12:52:10.733 INFO:teuthology.orchestra.run.smithi118.stdout:Enabling module streams: 2023-07-13T12:52:10.734 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql 10 2023-07-13T12:52:10.734 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T12:52:10.734 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2023-07-13T12:52:10.734 INFO:teuthology.orchestra.run.smithi118.stdout:======================================================================================================== 2023-07-13T12:52:10.734 INFO:teuthology.orchestra.run.smithi118.stdout:Install 150 Packages 2023-07-13T12:52:10.734 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 16 Packages 2023-07-13T12:52:10.734 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T12:52:10.735 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 2.8 G 2023-07-13T12:52:10.735 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2023-07-13T12:52:12.986 INFO:teuthology.orchestra.run.smithi118.stdout:(1/166): ceph-18.0.0-4842.gf0b380e6.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-07-13T12:52:21.752 INFO:teuthology.orchestra.run.smithi118.stdout:(2/166): ceph-base-18.0.0-4842.gf0b380e6.el8.x8 612 kB/s | 5.4 MB 00:09 2023-07-13T12:52:21.866 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 16 MB 00:14 2023-07-13T12:52:25.699 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 160 kB/s | 24 kB 00:00 2023-07-13T12:52:29.511 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-13T12:52:29.512 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-13T12:52:29.543 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-13T12:52:29.543 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-13T12:52:29.544 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-13T12:52:29.545 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-13T12:52:29.546 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-13T12:52:29.547 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-13T12:52:29.550 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-13T12:52:29.551 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-13T12:52:29.736 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-07-13T12:52:29.751 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================================== 2023-07-13T12:52:29.751 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-07-13T12:52:29.752 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================================== 2023-07-13T12:52:29.752 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-07-13T12:52:29.752 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-13T12:52:29.752 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 6.4 k 2023-07-13T12:52:29.752 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 5.4 M 2023-07-13T12:52:29.752 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 95 M 2023-07-13T12:52:29.753 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 550 M 2023-07-13T12:52:29.753 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 849 k 2023-07-13T12:52:29.753 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 12 M 2023-07-13T12:52:29.753 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 165 k 2023-07-13T12:52:29.753 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 2.7 M 2023-07-13T12:52:29.753 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 58 M 2023-07-13T12:52:29.753 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 1.5 M 2023-07-13T12:52:29.753 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 129 k 2023-07-13T12:52:29.754 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 1.7 M 2023-07-13T12:52:29.754 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 30 M 2023-07-13T12:52:29.754 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 7.4 M 2023-07-13T12:52:29.754 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 47 k 2023-07-13T12:52:29.754 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 119 M 2023-07-13T12:52:29.754 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 351 M 2023-07-13T12:52:29.754 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 13 M 2023-07-13T12:52:29.754 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 276 M 2023-07-13T12:52:29.755 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 48 M 2023-07-13T12:52:29.755 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 891 M 2023-07-13T12:52:29.755 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 258 k 2023-07-13T12:52:29.755 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 164 k 2023-07-13T12:52:29.755 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 258 k 2023-07-13T12:52:29.755 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 18 k 2023-07-13T12:52:29.755 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-13T12:52:29.756 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-13T12:52:29.756 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-13T12:52:29.756 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 31 k 2023-07-13T12:52:29.756 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 772 k 2023-07-13T12:52:29.756 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 11 M 2023-07-13T12:52:29.756 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 139 k 2023-07-13T12:52:29.756 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 129 k 2023-07-13T12:52:29.757 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 65 M 2023-07-13T12:52:29.757 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 82 M 2023-07-13T12:52:29.757 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-13T12:52:29.757 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-13T12:52:29.757 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-13T12:52:29.757 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-13T12:52:29.757 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-13T12:52:29.757 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-13T12:52:29.758 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 197 k 2023-07-13T12:52:29.758 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 642 k 2023-07-13T12:52:29.758 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 371 k 2023-07-13T12:52:29.758 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 723 k 2023-07-13T12:52:29.758 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 363 k 2023-07-13T12:52:29.758 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 1.2 M 2023-07-13T12:52:29.758 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 107 k 2023-07-13T12:52:29.759 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 318 k 2023-07-13T12:52:29.759 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 94 k 2023-07-13T12:52:29.759 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 1.2 M 2023-07-13T12:52:29.759 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 3.4 M 2023-07-13T12:52:29.759 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 73 M 2023-07-13T12:52:29.759 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 179 k 2023-07-13T12:52:29.759 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 2.0 M 2023-07-13T12:52:29.759 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-13T12:52:29.760 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2023-07-13T12:52:29.760 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-13T12:52:29.760 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-13T12:52:29.760 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-13T12:52:29.760 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-13T12:52:29.760 INFO:teuthology.orchestra.run.smithi123.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-13T12:52:29.760 INFO:teuthology.orchestra.run.smithi123.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-13T12:52:29.761 INFO:teuthology.orchestra.run.smithi123.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-13T12:52:29.761 INFO:teuthology.orchestra.run.smithi123.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-13T12:52:29.761 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 3.7 M 2023-07-13T12:52:29.761 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 3.6 M 2023-07-13T12:52:29.761 INFO:teuthology.orchestra.run.smithi123.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-13T12:52:29.761 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-13T12:52:29.761 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-13T12:52:29.761 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-13T12:52:29.762 INFO:teuthology.orchestra.run.smithi123.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-13T12:52:29.762 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-13T12:52:29.762 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-07-13T12:52:29.762 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-13T12:52:29.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 22 M 2023-07-13T12:52:29.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-debuginfo x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 14 M 2023-07-13T12:52:29.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 23 k 2023-07-13T12:52:29.762 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 2.3 M 2023-07-13T12:52:29.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 241 k 2023-07-13T12:52:29.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 4.6 M 2023-07-13T12:52:29.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 18 M 2023-07-13T12:52:29.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4842.gf0b380e6.el8 ceph-noarch 15 k 2023-07-13T12:52:29.763 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 24 k 2023-07-13T12:52:29.763 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-13T12:52:29.763 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-13T12:52:29.764 INFO:teuthology.orchestra.run.smithi123.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-13T12:52:29.764 INFO:teuthology.orchestra.run.smithi123.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-13T12:52:29.764 INFO:teuthology.orchestra.run.smithi123.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-13T12:52:29.764 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 137 k 2023-07-13T12:52:29.764 INFO:teuthology.orchestra.run.smithi123.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-13T12:52:29.764 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-13T12:52:29.764 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-13T12:52:29.764 INFO:teuthology.orchestra.run.smithi123.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-13T12:52:29.765 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-13T12:52:29.765 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-13T12:52:29.765 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 473 k 2023-07-13T12:52:29.765 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-13T12:52:29.765 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 6.7 M 2023-07-13T12:52:29.765 INFO:teuthology.orchestra.run.smithi123.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-13T12:52:29.765 INFO:teuthology.orchestra.run.smithi123.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-13T12:52:29.766 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-13T12:52:29.766 INFO:teuthology.orchestra.run.smithi123.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-13T12:52:29.766 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-13T12:52:29.766 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-13T12:52:29.766 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-13T12:52:29.766 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-13T12:52:29.766 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-13T12:52:29.766 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-13T12:52:29.767 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-13T12:52:29.767 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-13T12:52:29.767 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-13T12:52:29.767 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-13T12:52:29.767 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-13T12:52:29.767 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-13T12:52:29.767 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-13T12:52:29.767 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 45 k 2023-07-13T12:52:29.768 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:18.0.0-4842.gf0b380e6.el8 ceph 122 k 2023-07-13T12:52:29.768 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-13T12:52:29.768 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-13T12:52:29.768 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-13T12:52:29.768 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-13T12:52:29.768 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-13T12:52:29.768 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-13T12:52:29.769 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-13T12:52:29.769 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-13T12:52:29.769 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-13T12:52:29.769 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-13T12:52:29.769 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-13T12:52:29.769 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-13T12:52:29.769 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-13T12:52:29.769 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-13T12:52:29.770 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-13T12:52:29.770 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-13T12:52:29.770 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-13T12:52:29.770 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-13T12:52:29.770 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-13T12:52:29.770 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-13T12:52:29.770 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-13T12:52:29.770 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-13T12:52:29.771 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-13T12:52:29.771 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-13T12:52:29.771 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-13T12:52:29.771 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-13T12:52:29.771 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-13T12:52:29.771 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-13T12:52:29.771 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-13T12:52:29.772 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-13T12:52:29.772 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-13T12:52:29.772 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-13T12:52:29.772 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-13T12:52:29.772 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-13T12:52:29.772 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-13T12:52:29.772 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-13T12:52:29.772 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-13T12:52:29.773 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-13T12:52:29.773 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-13T12:52:29.773 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-13T12:52:29.773 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-13T12:52:29.773 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-13T12:52:29.773 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-13T12:52:29.773 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-13T12:52:29.774 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-13T12:52:29.774 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-13T12:52:29.774 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-13T12:52:29.774 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-13T12:52:29.774 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-13T12:52:29.774 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling module streams: 2023-07-13T12:52:29.774 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql 10 2023-07-13T12:52:29.774 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T12:52:29.775 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-07-13T12:52:29.775 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================================== 2023-07-13T12:52:29.775 INFO:teuthology.orchestra.run.smithi123.stdout:Install 150 Packages 2023-07-13T12:52:29.775 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 16 Packages 2023-07-13T12:52:29.775 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T12:52:29.776 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 2.8 G 2023-07-13T12:52:29.776 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-07-13T12:52:36.237 INFO:teuthology.orchestra.run.smithi123.stdout:(1/166): ceph-18.0.0-4842.gf0b380e6.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-07-13T12:52:41.945 INFO:teuthology.orchestra.run.smithi123.stdout:(2/166): ceph-common-18.0.0-4842.gf0b380e6.el8. 3.9 MB/s | 22 MB 00:05 2023-07-13T12:52:44.244 INFO:teuthology.orchestra.run.smithi123.stdout:(3/166): ceph-base-18.0.0-4842.gf0b380e6.el8.x8 665 kB/s | 5.4 MB 00:08 2023-07-13T12:52:45.093 INFO:teuthology.orchestra.run.smithi118.stdout:(3/166): ceph-common-18.0.0-4842.gf0b380e6.el8. 704 kB/s | 22 MB 00:32 2023-07-13T12:53:01.725 INFO:teuthology.orchestra.run.smithi118.stdout:(4/166): ceph-debuginfo-18.0.0-4842.gf0b380e6.e 883 kB/s | 14 MB 00:16 2023-07-13T12:53:02.475 INFO:teuthology.orchestra.run.smithi118.stdout:(5/166): ceph-fuse-18.0.0-4842.gf0b380e6.el8.x8 1.1 MB/s | 849 kB 00:00 2023-07-13T12:53:02.852 INFO:teuthology.orchestra.run.smithi123.stdout:(4/166): ceph-debuginfo-18.0.0-4842.gf0b380e6.e 789 kB/s | 14 MB 00:18 2023-07-13T12:53:03.869 INFO:teuthology.orchestra.run.smithi123.stdout:(5/166): ceph-fuse-18.0.0-4842.gf0b380e6.el8.x8 835 kB/s | 849 kB 00:01 2023-07-13T12:53:09.942 INFO:teuthology.orchestra.run.smithi118.stdout:(6/166): ceph-fuse-debuginfo-18.0.0-4842.gf0b38 1.6 MB/s | 12 MB 00:07 2023-07-13T12:53:10.159 INFO:teuthology.orchestra.run.smithi118.stdout:(7/166): ceph-immutable-object-cache-18.0.0-484 764 kB/s | 165 kB 00:00 2023-07-13T12:53:11.859 INFO:teuthology.orchestra.run.smithi118.stdout:(8/166): ceph-immutable-object-cache-debuginfo- 1.6 MB/s | 2.7 MB 00:01 2023-07-13T12:53:13.576 INFO:teuthology.orchestra.run.smithi118.stdout:(9/166): ceph-mds-18.0.0-4842.gf0b380e6.el8.x86 1.3 MB/s | 2.3 MB 00:01 2023-07-13T12:53:20.534 INFO:teuthology.orchestra.run.smithi123.stdout:(6/166): ceph-fuse-debuginfo-18.0.0-4842.gf0b38 724 kB/s | 12 MB 00:16 2023-07-13T12:53:21.026 INFO:teuthology.orchestra.run.smithi123.stdout:(7/166): ceph-immutable-object-cache-18.0.0-484 336 kB/s | 165 kB 00:00 2023-07-13T12:53:27.343 INFO:teuthology.orchestra.run.smithi123.stdout:(8/166): ceph-immutable-object-cache-debuginfo- 439 kB/s | 2.7 MB 00:06 2023-07-13T12:53:30.351 INFO:teuthology.orchestra.run.smithi123.stdout:(9/166): ceph-mds-18.0.0-4842.gf0b380e6.el8.x86 779 kB/s | 2.3 MB 00:03 2023-07-13T12:54:32.529 INFO:teuthology.orchestra.run.smithi118.stdout:(10/166): ceph-base-debuginfo-18.0.0-4842.gf0b3 695 kB/s | 95 MB 02:19 2023-07-13T12:54:34.988 INFO:teuthology.orchestra.run.smithi118.stdout:(11/166): ceph-mgr-18.0.0-4842.gf0b380e6.el8.x8 645 kB/s | 1.5 MB 00:02 2023-07-13T12:54:39.971 INFO:teuthology.orchestra.run.smithi118.stdout:(12/166): ceph-mds-debuginfo-18.0.0-4842.gf0b38 689 kB/s | 58 MB 01:26 2023-07-13T12:54:46.187 INFO:teuthology.orchestra.run.smithi118.stdout:(13/166): ceph-mon-18.0.0-4842.gf0b380e6.el8.x8 760 kB/s | 4.6 MB 00:06 2023-07-13T12:55:05.327 INFO:teuthology.orchestra.run.smithi123.stdout:(10/166): ceph-mds-debuginfo-18.0.0-4842.gf0b38 626 kB/s | 58 MB 01:34 2023-07-13T12:55:07.477 INFO:teuthology.orchestra.run.smithi123.stdout:(11/166): ceph-mgr-18.0.0-4842.gf0b380e6.el8.x8 738 kB/s | 1.5 MB 00:02 2023-07-13T12:55:08.552 INFO:teuthology.orchestra.run.smithi123.stdout:(12/166): ceph-base-debuginfo-18.0.0-4842.gf0b3 636 kB/s | 95 MB 02:32 2023-07-13T12:55:12.695 INFO:teuthology.orchestra.run.smithi123.stdout:(13/166): ceph-mon-18.0.0-4842.gf0b380e6.el8.x8 1.1 MB/s | 4.6 MB 00:04 2023-07-13T12:55:13.427 INFO:teuthology.orchestra.run.smithi118.stdout:(14/166): ceph-mgr-debuginfo-18.0.0-4842.gf0b38 807 kB/s | 30 MB 00:38 2023-07-13T12:55:47.567 INFO:teuthology.orchestra.run.smithi118.stdout:(15/166): ceph-osd-18.0.0-4842.gf0b380e6.el8.x8 532 kB/s | 18 MB 00:34 2023-07-13T12:55:55.391 INFO:teuthology.orchestra.run.smithi123.stdout:(14/166): ceph-mgr-debuginfo-18.0.0-4842.gf0b38 648 kB/s | 30 MB 00:47 2023-07-13T12:56:28.189 INFO:teuthology.orchestra.run.smithi123.stdout:(15/166): ceph-osd-18.0.0-4842.gf0b380e6.el8.x8 554 kB/s | 18 MB 00:32 2023-07-13T12:58:26.211 INFO:teuthology.orchestra.run.smithi118.stdout:(16/166): ceph-mon-debuginfo-18.0.0-4842.gf0b38 555 kB/s | 119 MB 03:40 2023-07-13T12:58:46.284 INFO:teuthology.orchestra.run.smithi123.stdout:(16/166): ceph-mon-debuginfo-18.0.0-4842.gf0b38 572 kB/s | 119 MB 03:33 2023-07-13T12:58:46.368 INFO:teuthology.orchestra.run.smithi118.stdout:(17/166): ceph-radosgw-18.0.0-4842.gf0b380e6.el 686 kB/s | 13 MB 00:20 2023-07-13T12:59:06.099 INFO:teuthology.orchestra.run.smithi123.stdout:(17/166): ceph-radosgw-18.0.0-4842.gf0b380e6.el 697 kB/s | 13 MB 00:19 2023-07-13T13:11:55.652 INFO:teuthology.orchestra.run.smithi118.stdout:(18/166): ceph-radosgw-debuginfo-18.0.0-4842.gf 358 kB/s | 276 MB 13:09 2023-07-13T13:11:55.884 INFO:teuthology.orchestra.run.smithi118.stdout:(19/166): ceph-selinux-18.0.0-4842.gf0b380e6.el 104 kB/s | 24 kB 00:00 2023-07-13T13:12:32.823 INFO:teuthology.orchestra.run.smithi118.stdout:(20/166): ceph-osd-debuginfo-18.0.0-4842.gf0b38 358 kB/s | 351 MB 16:45 2023-07-13T13:12:56.657 INFO:teuthology.orchestra.run.smithi123.stdout:(18/166): ceph-osd-debuginfo-18.0.0-4842.gf0b38 364 kB/s | 351 MB 16:28 2023-07-13T13:12:56.857 INFO:teuthology.orchestra.run.smithi123.stdout:(19/166): ceph-selinux-18.0.0-4842.gf0b380e6.el 121 kB/s | 24 kB 00:00 2023-07-13T13:13:39.360 INFO:teuthology.orchestra.run.smithi123.stdout:(20/166): ceph-radosgw-debuginfo-18.0.0-4842.gf 324 kB/s | 276 MB 14:33 2023-07-13T13:14:22.363 INFO:teuthology.orchestra.run.smithi123.stdout:(21/166): ceph-common-debuginfo-18.0.0-4842.gf0 433 kB/s | 550 MB 21:40 2023-07-13T13:14:23.089 INFO:teuthology.orchestra.run.smithi123.stdout:(22/166): cephfs-mirror-18.0.0-4842.gf0b380e6.e 356 kB/s | 258 kB 00:00 2023-07-13T13:14:23.264 INFO:teuthology.orchestra.run.smithi123.stdout:(23/166): libcephfs-devel-18.0.0-4842.gf0b380e6 177 kB/s | 31 kB 00:00 2023-07-13T13:14:24.764 INFO:teuthology.orchestra.run.smithi123.stdout:(24/166): libcephfs2-18.0.0-4842.gf0b380e6.el8. 515 kB/s | 772 kB 00:01 2023-07-13T13:14:58.106 INFO:teuthology.orchestra.run.smithi118.stdout:(21/166): ceph-test-18.0.0-4842.gf0b380e6.el8.x 268 kB/s | 48 MB 03:02 2023-07-13T13:14:59.156 INFO:teuthology.orchestra.run.smithi118.stdout:(22/166): cephfs-mirror-18.0.0-4842.gf0b380e6.e 246 kB/s | 258 kB 00:01 2023-07-13T13:14:59.323 INFO:teuthology.orchestra.run.smithi118.stdout:(23/166): libcephfs-devel-18.0.0-4842.gf0b380e6 186 kB/s | 31 kB 00:00 2023-07-13T13:15:02.372 INFO:teuthology.orchestra.run.smithi118.stdout:(24/166): ceph-common-debuginfo-18.0.0-4842.gf0 414 kB/s | 550 MB 22:40 2023-07-13T13:15:02.406 INFO:teuthology.orchestra.run.smithi118.stdout:(25/166): libcephfs2-18.0.0-4842.gf0b380e6.el8. 250 kB/s | 772 kB 00:03 2023-07-13T13:15:02.857 INFO:teuthology.orchestra.run.smithi118.stdout:(26/166): libcephsqlite-18.0.0-4842.gf0b380e6.e 305 kB/s | 137 kB 00:00 2023-07-13T13:15:03.382 INFO:teuthology.orchestra.run.smithi118.stdout:(27/166): librados-devel-18.0.0-4842.gf0b380e6. 264 kB/s | 139 kB 00:00 2023-07-13T13:15:03.915 INFO:teuthology.orchestra.run.smithi118.stdout:(28/166): librados-devel-debuginfo-18.0.0-4842. 242 kB/s | 129 kB 00:00 2023-07-13T13:15:10.496 INFO:teuthology.orchestra.run.smithi123.stdout:(25/166): libcephfs2-debuginfo-18.0.0-4842.gf0b 248 kB/s | 11 MB 00:45 2023-07-13T13:15:11.234 INFO:teuthology.orchestra.run.smithi123.stdout:(26/166): libcephsqlite-18.0.0-4842.gf0b380e6.e 186 kB/s | 137 kB 00:00 2023-07-13T13:15:12.242 INFO:teuthology.orchestra.run.smithi123.stdout:(27/166): librados-devel-18.0.0-4842.gf0b380e6. 138 kB/s | 139 kB 00:01 2023-07-13T13:15:12.984 INFO:teuthology.orchestra.run.smithi123.stdout:(28/166): librados-devel-debuginfo-18.0.0-4842. 174 kB/s | 129 kB 00:00 2023-07-13T13:15:44.720 INFO:teuthology.orchestra.run.smithi118.stdout:(29/166): libcephfs2-debuginfo-18.0.0-4842.gf0b 267 kB/s | 11 MB 00:42 2023-07-13T13:15:45.753 INFO:teuthology.orchestra.run.smithi118.stdout:(30/166): libradosstriper1-18.0.0-4842.gf0b380e 459 kB/s | 473 kB 00:01 2023-07-13T13:16:06.911 INFO:teuthology.orchestra.run.smithi123.stdout:(29/166): ceph-test-18.0.0-4842.gf0b380e6.el8.x 257 kB/s | 48 MB 03:10 2023-07-13T13:16:08.853 INFO:teuthology.orchestra.run.smithi123.stdout:(30/166): libradosstriper1-18.0.0-4842.gf0b380e 244 kB/s | 473 kB 00:01 2023-07-13T13:18:46.990 INFO:teuthology.orchestra.run.smithi118.stdout:(31/166): librados2-debuginfo-18.0.0-4842.gf0b3 300 kB/s | 65 MB 03:43 2023-07-13T13:18:50.292 INFO:teuthology.orchestra.run.smithi123.stdout:(31/166): librados2-debuginfo-18.0.0-4842.gf0b3 308 kB/s | 65 MB 03:37 2023-07-13T13:19:06.813 INFO:teuthology.orchestra.run.smithi118.stdout:(32/166): librgw2-18.0.0-4842.gf0b380e6.el8.x86 349 kB/s | 6.7 MB 00:19 2023-07-13T13:19:06.971 INFO:teuthology.orchestra.run.smithi118.stdout:(33/166): python3-ceph-argparse-18.0.0-4842.gf0 283 kB/s | 45 kB 00:00 2023-07-13T13:19:07.305 INFO:teuthology.orchestra.run.smithi118.stdout:(34/166): python3-ceph-common-18.0.0-4842.gf0b3 367 kB/s | 122 kB 00:00 2023-07-13T13:19:07.780 INFO:teuthology.orchestra.run.smithi118.stdout:(35/166): python3-cephfs-18.0.0-4842.gf0b380e6. 414 kB/s | 197 kB 00:00 2023-07-13T13:19:08.922 INFO:teuthology.orchestra.run.smithi118.stdout:(36/166): python3-cephfs-debuginfo-18.0.0-4842. 562 kB/s | 642 kB 00:01 2023-07-13T13:19:09.148 INFO:teuthology.orchestra.run.smithi123.stdout:(32/166): librgw2-18.0.0-4842.gf0b380e6.el8.x86 367 kB/s | 6.7 MB 00:18 2023-07-13T13:19:09.298 INFO:teuthology.orchestra.run.smithi123.stdout:(33/166): python3-ceph-argparse-18.0.0-4842.gf0 299 kB/s | 45 kB 00:00 2023-07-13T13:19:09.439 INFO:teuthology.orchestra.run.smithi118.stdout:(37/166): python3-rados-18.0.0-4842.gf0b380e6.e 718 kB/s | 371 kB 00:00 2023-07-13T13:19:09.615 INFO:teuthology.orchestra.run.smithi123.stdout:(34/166): python3-ceph-common-18.0.0-4842.gf0b3 386 kB/s | 122 kB 00:00 2023-07-13T13:19:10.049 INFO:teuthology.orchestra.run.smithi123.stdout:(35/166): python3-cephfs-18.0.0-4842.gf0b380e6. 454 kB/s | 197 kB 00:00 2023-07-13T13:19:10.556 INFO:teuthology.orchestra.run.smithi118.stdout:(38/166): python3-rados-debuginfo-18.0.0-4842.g 647 kB/s | 723 kB 00:01 2023-07-13T13:19:11.089 INFO:teuthology.orchestra.run.smithi118.stdout:(39/166): python3-rbd-18.0.0-4842.gf0b380e6.el8 683 kB/s | 363 kB 00:00 2023-07-13T13:19:11.882 INFO:teuthology.orchestra.run.smithi123.stdout:(36/166): python3-cephfs-debuginfo-18.0.0-4842. 350 kB/s | 642 kB 00:01 2023-07-13T13:19:12.948 INFO:teuthology.orchestra.run.smithi118.stdout:(40/166): python3-rbd-debuginfo-18.0.0-4842.gf0 660 kB/s | 1.2 MB 00:01 2023-07-13T13:19:13.256 INFO:teuthology.orchestra.run.smithi118.stdout:(41/166): python3-rgw-18.0.0-4842.gf0b380e6.el8 346 kB/s | 107 kB 00:00 2023-07-13T13:19:13.840 INFO:teuthology.orchestra.run.smithi118.stdout:(42/166): python3-rgw-debuginfo-18.0.0-4842.gf0 546 kB/s | 318 kB 00:00 2023-07-13T13:19:13.841 INFO:teuthology.orchestra.run.smithi123.stdout:(37/166): python3-rados-18.0.0-4842.gf0b380e6.e 189 kB/s | 371 kB 00:01 2023-07-13T13:19:14.107 INFO:teuthology.orchestra.run.smithi118.stdout:(43/166): rbd-fuse-18.0.0-4842.gf0b380e6.el8.x8 354 kB/s | 94 kB 00:00 2023-07-13T13:19:15.991 INFO:teuthology.orchestra.run.smithi123.stdout:(38/166): python3-rados-debuginfo-18.0.0-4842.g 337 kB/s | 723 kB 00:02 2023-07-13T13:19:16.074 INFO:teuthology.orchestra.run.smithi118.stdout:(44/166): rbd-fuse-debuginfo-18.0.0-4842.gf0b38 636 kB/s | 1.2 MB 00:01 2023-07-13T13:19:16.971 INFO:teuthology.orchestra.run.smithi123.stdout:(39/166): python3-rbd-18.0.0-4842.gf0b380e6.el8 371 kB/s | 363 kB 00:00 2023-07-13T13:19:19.800 INFO:teuthology.orchestra.run.smithi123.stdout:(40/166): python3-rbd-debuginfo-18.0.0-4842.gf0 434 kB/s | 1.2 MB 00:02 2023-07-13T13:19:20.058 INFO:teuthology.orchestra.run.smithi123.stdout:(41/166): python3-rgw-18.0.0-4842.gf0b380e6.el8 416 kB/s | 107 kB 00:00 2023-07-13T13:19:21.358 INFO:teuthology.orchestra.run.smithi123.stdout:(42/166): python3-rgw-debuginfo-18.0.0-4842.gf0 245 kB/s | 318 kB 00:01 2023-07-13T13:19:21.966 INFO:teuthology.orchestra.run.smithi123.stdout:(43/166): rbd-fuse-18.0.0-4842.gf0b380e6.el8.x8 155 kB/s | 94 kB 00:00 2023-07-13T13:19:21.990 INFO:teuthology.orchestra.run.smithi118.stdout:(45/166): rbd-mirror-18.0.0-4842.gf0b380e6.el8. 596 kB/s | 3.4 MB 00:05 2023-07-13T13:19:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:(44/166): rbd-fuse-debuginfo-18.0.0-4842.gf0b38 210 kB/s | 1.2 MB 00:05 2023-07-13T13:19:39.132 INFO:teuthology.orchestra.run.smithi123.stdout:(45/166): rbd-mirror-18.0.0-4842.gf0b380e6.el8. 315 kB/s | 3.4 MB 00:11 2023-07-13T13:20:06.144 INFO:teuthology.orchestra.run.smithi118.stdout:(46/166): librbd1-debuginfo-18.0.0-4842.gf0b380 321 kB/s | 82 MB 04:20 2023-07-13T13:20:06.877 INFO:teuthology.orchestra.run.smithi118.stdout:(47/166): rbd-nbd-18.0.0-4842.gf0b380e6.el8.x86 244 kB/s | 179 kB 00:00 2023-07-13T13:20:16.306 INFO:teuthology.orchestra.run.smithi118.stdout:(48/166): rbd-nbd-debuginfo-18.0.0-4842.gf0b380 223 kB/s | 2.0 MB 00:09 2023-07-13T13:20:16.469 INFO:teuthology.orchestra.run.smithi118.stdout:(49/166): ceph-grafana-dashboards-18.0.0-4842.g 142 kB/s | 23 kB 00:00 2023-07-13T13:20:17.144 INFO:teuthology.orchestra.run.smithi118.stdout:(50/166): ceph-mgr-cephadm-18.0.0-4842.gf0b380e 191 kB/s | 129 kB 00:00 2023-07-13T13:20:23.152 INFO:teuthology.orchestra.run.smithi118.stdout:(51/166): ceph-mgr-dashboard-18.0.0-4842.gf0b38 292 kB/s | 1.7 MB 00:06 2023-07-13T13:20:44.683 INFO:teuthology.orchestra.run.smithi123.stdout:(46/166): librbd1-debuginfo-18.0.0-4842.gf0b380 303 kB/s | 82 MB 04:35 2023-07-13T13:20:45.599 INFO:teuthology.orchestra.run.smithi123.stdout:(47/166): rbd-nbd-18.0.0-4842.gf0b380e6.el8.x86 196 kB/s | 179 kB 00:00 2023-07-13T13:20:58.056 INFO:teuthology.orchestra.run.smithi123.stdout:(48/166): rbd-nbd-debuginfo-18.0.0-4842.gf0b380 168 kB/s | 2.0 MB 00:12 2023-07-13T13:20:58.373 INFO:teuthology.orchestra.run.smithi123.stdout:(49/166): ceph-grafana-dashboards-18.0.0-4842.g 73 kB/s | 23 kB 00:00 2023-07-13T13:20:59.182 INFO:teuthology.orchestra.run.smithi123.stdout:(50/166): ceph-mgr-cephadm-18.0.0-4842.gf0b380e 160 kB/s | 129 kB 00:00 2023-07-13T13:21:05.180 INFO:teuthology.orchestra.run.smithi118.stdout:(52/166): ceph-mgr-diskprediction-local-18.0.0- 181 kB/s | 7.4 MB 00:42 2023-07-13T13:21:07.488 INFO:teuthology.orchestra.run.smithi118.stdout:(53/166): ceph-mgr-modules-core-18.0.0-4842.gf0 104 kB/s | 241 kB 00:02 2023-07-13T13:21:07.897 INFO:teuthology.orchestra.run.smithi118.stdout:(54/166): ceph-mgr-rook-18.0.0-4842.gf0b380e6.e 116 kB/s | 47 kB 00:00 2023-07-13T13:21:08.056 INFO:teuthology.orchestra.run.smithi118.stdout:(55/166): ceph-prometheus-alerts-18.0.0-4842.gf 92 kB/s | 15 kB 00:00 2023-07-13T13:21:09.564 INFO:teuthology.orchestra.run.smithi118.stdout:(56/166): ceph-volume-18.0.0-4842.gf0b380e6.el8 171 kB/s | 258 kB 00:01 2023-07-13T13:21:10.367 INFO:teuthology.orchestra.run.smithi118.stdout:(57/166): cephadm-18.0.0-4842.gf0b380e6.el8.noa 204 kB/s | 164 kB 00:00 2023-07-13T13:21:10.490 INFO:teuthology.orchestra.run.smithi118.stdout:(58/166): cephfs-top-18.0.0-4842.gf0b380e6.el8. 147 kB/s | 18 kB 00:00 2023-07-13T13:21:11.324 INFO:teuthology.orchestra.run.smithi118.stdout:(59/166): automake-1.16.1-7.el8.noarch.rpm 856 kB/s | 713 kB 00:00 2023-07-13T13:21:11.380 INFO:teuthology.orchestra.run.smithi123.stdout:(51/166): ceph-mgr-dashboard-18.0.0-4842.gf0b38 144 kB/s | 1.7 MB 00:12 2023-07-13T13:21:11.540 INFO:teuthology.orchestra.run.smithi118.stdout:(60/166): bison-3.0.4-10.el8.x86_64.rpm 3.1 MB/s | 688 kB 00:00 2023-07-13T13:21:11.716 INFO:teuthology.orchestra.run.smithi118.stdout:(61/166): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-07-13T13:21:11.891 INFO:teuthology.orchestra.run.smithi118.stdout:(62/166): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-07-13T13:21:12.366 INFO:teuthology.orchestra.run.smithi118.stdout:(63/166): libpq-13.5-1.el8.x86_64.rpm 416 kB/s | 198 kB 00:00 2023-07-13T13:21:12.633 INFO:teuthology.orchestra.run.smithi118.stdout:(64/166): librdkafka-0.11.4-3.el8.x86_64.rpm 1.3 MB/s | 354 kB 00:00 2023-07-13T13:21:12.976 INFO:teuthology.orchestra.run.smithi118.stdout:(65/166): libtool-2.4.6-25.el8.x86_64.rpm 2.0 MB/s | 709 kB 00:00 2023-07-13T13:21:13.251 INFO:teuthology.orchestra.run.smithi118.stdout:(66/166): lttng-ust-2.8.1-11.el8.x86_64.rpm 944 kB/s | 259 kB 00:00 2023-07-13T13:21:13.434 INFO:teuthology.orchestra.run.smithi118.stdout:(67/166): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-07-13T13:21:14.743 INFO:teuthology.orchestra.run.smithi118.stdout:(68/166): openblas-0.3.15-4.el8.x86_64.rpm 3.6 MB/s | 4.7 MB 00:01 2023-07-13T13:21:16.010 INFO:teuthology.orchestra.run.smithi118.stdout:(69/166): openblas-threads-0.3.15-4.el8.x86_64. 3.8 MB/s | 4.9 MB 00:01 2023-07-13T13:21:16.460 INFO:teuthology.orchestra.run.smithi118.stdout:(70/166): postgresql-10.23-1.module_el8+300+2c5 3.5 MB/s | 1.6 MB 00:00 2023-07-13T13:21:16.820 INFO:teuthology.orchestra.run.smithi118.stdout:(71/166): postgresql-contrib-10.23-1.module_el8 2.5 MB/s | 903 kB 00:00 2023-07-13T13:21:17.952 INFO:teuthology.orchestra.run.smithi118.stdout:(72/166): postgresql-server-10.23-1.module_el8+ 4.5 MB/s | 5.1 MB 00:01 2023-07-13T13:21:18.903 INFO:teuthology.orchestra.run.smithi118.stdout:(73/166): python3-babel-2.5.1-7.el8.noarch.rpm 5.0 MB/s | 4.8 MB 00:00 2023-07-13T13:21:19.178 INFO:teuthology.orchestra.run.smithi118.stdout:(74/166): python3-jinja2-2.10.1-3.el8.noarch.rp 1.9 MB/s | 538 kB 00:00 2023-07-13T13:21:19.370 INFO:teuthology.orchestra.run.smithi118.stdout:(75/166): python3-jsonpatch-1.21-2.el8.noarch.r 139 kB/s | 27 kB 00:00 2023-07-13T13:21:19.545 INFO:teuthology.orchestra.run.smithi118.stdout:(76/166): python3-jsonpointer-1.10-11.el8.noarc 114 kB/s | 20 kB 00:00 2023-07-13T13:21:19.729 INFO:teuthology.orchestra.run.smithi118.stdout:(77/166): python3-mako-1.0.6-14.el8.noarch.rpm 855 kB/s | 157 kB 00:00 2023-07-13T13:21:19.879 INFO:teuthology.orchestra.run.smithi118.stdout:(78/166): python3-markupsafe-0.23-19.el8.x86_64 259 kB/s | 39 kB 00:00 2023-07-13T13:21:20.571 INFO:teuthology.orchestra.run.smithi118.stdout:(79/166): python3-numpy-1.14.3-10.el8.x86_64.rp 5.4 MB/s | 3.7 MB 00:00 2023-07-13T13:21:20.746 INFO:teuthology.orchestra.run.smithi118.stdout:(80/166): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.3 MB/s | 225 kB 00:00 2023-07-13T13:21:20.922 INFO:teuthology.orchestra.run.smithi118.stdout:(81/166): python3-prettytable-0.7.2-14.el8.noar 251 kB/s | 44 kB 00:00 2023-07-13T13:21:21.039 INFO:teuthology.orchestra.run.smithi118.stdout:(82/166): python3-pyOpenSSL-19.0.0-1.el8.noarch 886 kB/s | 103 kB 00:00 2023-07-13T13:21:21.148 INFO:teuthology.orchestra.run.smithi118.stdout:(83/166): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-07-13T13:21:21.290 INFO:teuthology.orchestra.run.smithi118.stdout:(84/166): python3-pyasn1-modules-0.3.7-6.el8.no 777 kB/s | 110 kB 00:00 2023-07-13T13:21:21.456 INFO:teuthology.orchestra.run.smithi118.stdout:(85/166): python3-pytz-2017.2-9.el8.noarch.rpm 325 kB/s | 54 kB 00:00 2023-07-13T13:21:23.557 INFO:teuthology.orchestra.run.smithi118.stdout:(86/166): python3-scipy-1.0.0-21.module_el8.5.0 6.5 MB/s | 14 MB 00:02 2023-07-13T13:21:23.848 INFO:teuthology.orchestra.run.smithi118.stdout:(87/166): python3-werkzeug-0.12.2-4.el8.noarch. 1.5 MB/s | 457 kB 00:00 2023-07-13T13:21:24.224 INFO:teuthology.orchestra.run.smithi118.stdout:(88/166): socat-1.7.4.1-1.el8.x86_64.rpm 861 kB/s | 323 kB 00:00 2023-07-13T13:21:24.374 INFO:teuthology.orchestra.run.smithi118.stdout:(89/166): uuid-1.6.2-43.el8.x86_64.rpm 426 kB/s | 64 kB 00:00 2023-07-13T13:21:24.616 INFO:teuthology.orchestra.run.smithi118.stdout:(90/166): xmlstarlet-1.6.1-20.el8.x86_64.rpm 292 kB/s | 71 kB 00:00 2023-07-13T13:21:25.225 INFO:teuthology.orchestra.run.smithi118.stdout:(91/166): elfutils-libelf-devel-0.189-2.el8.x86 101 kB/s | 61 kB 00:00 2023-07-13T13:21:25.817 INFO:teuthology.orchestra.run.smithi118.stdout:(92/166): fuse-2.9.7-17.el8.x86_64.rpm 140 kB/s | 83 kB 00:00 2023-07-13T13:21:27.076 INFO:teuthology.orchestra.run.smithi118.stdout:(93/166): keyutils-libs-devel-1.5.10-9.el8.x86_ 38 kB/s | 48 kB 00:01 2023-07-13T13:21:37.300 INFO:teuthology.orchestra.run.smithi118.stdout:(94/166): krb5-devel-1.18.2-22.el8.x86_64.rpm 55 kB/s | 561 kB 00:10 2023-07-13T13:21:37.600 INFO:teuthology.orchestra.run.smithi118.stdout:(95/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 62 kB/s | 19 kB 00:00 2023-07-13T13:21:38.000 INFO:teuthology.orchestra.run.smithi118.stdout:(96/166): libcom_err-devel-1.45.6-5.el8.x86_64. 97 kB/s | 39 kB 00:00 2023-07-13T13:21:43.760 INFO:teuthology.orchestra.run.smithi123.stdout:(52/166): ceph-mgr-diskprediction-local-18.0.0- 234 kB/s | 7.4 MB 00:32 2023-07-13T13:21:45.060 INFO:teuthology.orchestra.run.smithi123.stdout:(53/166): ceph-mgr-modules-core-18.0.0-4842.gf0 185 kB/s | 241 kB 00:01 2023-07-13T13:21:45.535 INFO:teuthology.orchestra.run.smithi123.stdout:(54/166): ceph-mgr-rook-18.0.0-4842.gf0b380e6.e 100 kB/s | 47 kB 00:00 2023-07-13T13:21:46.044 INFO:teuthology.orchestra.run.smithi123.stdout:(55/166): ceph-prometheus-alerts-18.0.0-4842.gf 29 kB/s | 15 kB 00:00 2023-07-13T13:21:47.802 INFO:teuthology.orchestra.run.smithi123.stdout:(56/166): ceph-volume-18.0.0-4842.gf0b380e6.el8 147 kB/s | 258 kB 00:01 2023-07-13T13:21:48.577 INFO:teuthology.orchestra.run.smithi123.stdout:(57/166): cephadm-18.0.0-4842.gf0b380e6.el8.noa 211 kB/s | 164 kB 00:00 2023-07-13T13:21:48.695 INFO:teuthology.orchestra.run.smithi123.stdout:(58/166): cephfs-top-18.0.0-4842.gf0b380e6.el8. 154 kB/s | 18 kB 00:00 2023-07-13T13:21:48.799 INFO:teuthology.orchestra.run.smithi118.stdout:(97/166): libgfortran-8.5.0-20.el8.x86_64.rpm 60 kB/s | 645 kB 00:10 2023-07-13T13:21:49.645 INFO:teuthology.orchestra.run.smithi123.stdout:(59/166): automake-1.16.1-7.el8.noarch.rpm 752 kB/s | 713 kB 00:00 2023-07-13T13:21:49.887 INFO:teuthology.orchestra.run.smithi123.stdout:(60/166): bison-3.0.4-10.el8.x86_64.rpm 2.8 MB/s | 688 kB 00:00 2023-07-13T13:21:50.079 INFO:teuthology.orchestra.run.smithi123.stdout:(61/166): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2023-07-13T13:21:50.254 INFO:teuthology.orchestra.run.smithi123.stdout:(62/166): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-07-13T13:21:50.471 INFO:teuthology.orchestra.run.smithi123.stdout:(63/166): libpq-13.5-1.el8.x86_64.rpm 913 kB/s | 198 kB 00:00 2023-07-13T13:21:50.671 INFO:teuthology.orchestra.run.smithi123.stdout:(64/166): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-07-13T13:21:50.905 INFO:teuthology.orchestra.run.smithi123.stdout:(65/166): libtool-2.4.6-25.el8.x86_64.rpm 3.0 MB/s | 709 kB 00:00 2023-07-13T13:21:51.097 INFO:teuthology.orchestra.run.smithi123.stdout:(66/166): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-07-13T13:21:51.297 INFO:teuthology.orchestra.run.smithi123.stdout:(67/166): oniguruma-6.8.2-2.el8.x86_64.rpm 936 kB/s | 187 kB 00:00 2023-07-13T13:21:51.458 INFO:teuthology.orchestra.run.smithi118.stdout:(98/166): libquadmath-8.5.0-20.el8.x86_64.rpm 65 kB/s | 172 kB 00:02 2023-07-13T13:21:52.148 INFO:teuthology.orchestra.run.smithi123.stdout:(68/166): openblas-0.3.15-4.el8.x86_64.rpm 5.6 MB/s | 4.7 MB 00:00 2023-07-13T13:21:52.291 INFO:teuthology.orchestra.run.smithi118.stdout:(99/166): librabbitmq-0.9.0-4.el8.x86_64.rpm 56 kB/s | 47 kB 00:00 2023-07-13T13:21:52.598 INFO:teuthology.orchestra.run.smithi123.stdout:(69/166): openblas-threads-0.3.15-4.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2023-07-13T13:21:52.798 INFO:teuthology.orchestra.run.smithi123.stdout:(70/166): postgresql-10.23-1.module_el8+300+2c5 7.8 MB/s | 1.6 MB 00:00 2023-07-13T13:21:52.982 INFO:teuthology.orchestra.run.smithi123.stdout:(71/166): postgresql-contrib-10.23-1.module_el8 4.8 MB/s | 903 kB 00:00 2023-07-13T13:21:53.382 INFO:teuthology.orchestra.run.smithi123.stdout:(72/166): postgresql-server-10.23-1.module_el8+ 13 MB/s | 5.1 MB 00:00 2023-07-13T13:21:53.799 INFO:teuthology.orchestra.run.smithi123.stdout:(73/166): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-07-13T13:21:53.991 INFO:teuthology.orchestra.run.smithi123.stdout:(74/166): python3-jinja2-2.10.1-3.el8.noarch.rp 2.7 MB/s | 538 kB 00:00 2023-07-13T13:21:54.158 INFO:teuthology.orchestra.run.smithi123.stdout:(75/166): python3-jsonpatch-1.21-2.el8.noarch.r 159 kB/s | 27 kB 00:00 2023-07-13T13:21:54.292 INFO:teuthology.orchestra.run.smithi123.stdout:(76/166): python3-jsonpointer-1.10-11.el8.noarc 149 kB/s | 20 kB 00:00 2023-07-13T13:21:54.442 INFO:teuthology.orchestra.run.smithi123.stdout:(77/166): python3-mako-1.0.6-14.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2023-07-13T13:21:54.601 INFO:teuthology.orchestra.run.smithi123.stdout:(78/166): python3-markupsafe-0.23-19.el8.x86_64 245 kB/s | 39 kB 00:00 2023-07-13T13:21:54.993 INFO:teuthology.orchestra.run.smithi123.stdout:(79/166): python3-numpy-1.14.3-10.el8.x86_64.rp 9.5 MB/s | 3.7 MB 00:00 2023-07-13T13:21:55.074 INFO:teuthology.orchestra.run.smithi118.stdout:(100/166): libselinux-devel-2.9-8.el8.x86_64.rp 72 kB/s | 200 kB 00:02 2023-07-13T13:21:55.134 INFO:teuthology.orchestra.run.smithi123.stdout:(80/166): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-07-13T13:21:55.268 INFO:teuthology.orchestra.run.smithi123.stdout:(81/166): python3-prettytable-0.7.2-14.el8.noar 329 kB/s | 44 kB 00:00 2023-07-13T13:21:55.427 INFO:teuthology.orchestra.run.smithi123.stdout:(82/166): python3-pyOpenSSL-19.0.0-1.el8.noarch 653 kB/s | 103 kB 00:00 2023-07-13T13:21:55.569 INFO:teuthology.orchestra.run.smithi123.stdout:(83/166): python3-pyasn1-0.3.7-6.el8.noarch.rpm 894 kB/s | 126 kB 00:00 2023-07-13T13:21:55.719 INFO:teuthology.orchestra.run.smithi123.stdout:(84/166): python3-pyasn1-modules-0.3.7-6.el8.no 733 kB/s | 110 kB 00:00 2023-07-13T13:21:55.869 INFO:teuthology.orchestra.run.smithi123.stdout:(85/166): python3-pytz-2017.2-9.el8.noarch.rpm 361 kB/s | 54 kB 00:00 2023-07-13T13:21:56.728 INFO:teuthology.orchestra.run.smithi123.stdout:(86/166): python3-scipy-1.0.0-21.module_el8.5.0 16 MB/s | 14 MB 00:00 2023-07-13T13:21:56.862 INFO:teuthology.orchestra.run.smithi123.stdout:(87/166): python3-werkzeug-0.12.2-4.el8.noarch. 3.4 MB/s | 457 kB 00:00 2023-07-13T13:21:57.020 INFO:teuthology.orchestra.run.smithi123.stdout:(88/166): socat-1.7.4.1-1.el8.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2023-07-13T13:21:57.154 INFO:teuthology.orchestra.run.smithi123.stdout:(89/166): uuid-1.6.2-43.el8.x86_64.rpm 480 kB/s | 64 kB 00:00 2023-07-13T13:21:57.321 INFO:teuthology.orchestra.run.smithi123.stdout:(90/166): xmlstarlet-1.6.1-20.el8.x86_64.rpm 423 kB/s | 71 kB 00:00 2023-07-13T13:21:57.466 INFO:teuthology.orchestra.run.smithi118.stdout:(101/166): libsepol-devel-2.9-3.el8.x86_64.rpm 36 kB/s | 87 kB 00:02 2023-07-13T13:21:58.038 INFO:teuthology.orchestra.run.smithi123.stdout:(91/166): elfutils-libelf-devel-0.189-2.el8.x86 86 kB/s | 61 kB 00:00 2023-07-13T13:21:59.483 INFO:teuthology.orchestra.run.smithi118.stdout:(102/166): libuuid-devel-2.32.1-42.el8.x86_64.r 49 kB/s | 99 kB 00:02 2023-07-13T13:21:59.858 INFO:teuthology.orchestra.run.smithi118.stdout:(103/166): libverto-devel-0.3.2-2.el8.x86_64.rp 48 kB/s | 18 kB 00:00 2023-07-13T13:22:00.363 INFO:teuthology.orchestra.run.smithi123.stdout:(92/166): fuse-2.9.7-17.el8.x86_64.rpm 36 kB/s | 83 kB 00:02 2023-07-13T13:22:00.475 INFO:teuthology.orchestra.run.smithi118.stdout:(104/166): libzstd-devel-1.4.4-1.el8.x86_64.rpm 71 kB/s | 44 kB 00:00 2023-07-13T13:22:00.954 INFO:teuthology.orchestra.run.smithi123.stdout:(93/166): keyutils-libs-devel-1.5.10-9.el8.x86_ 81 kB/s | 48 kB 00:00 2023-07-13T13:22:10.396 INFO:teuthology.orchestra.run.smithi123.stdout:(94/166): krb5-devel-1.18.2-22.el8.x86_64.rpm 59 kB/s | 561 kB 00:09 2023-07-13T13:22:10.679 INFO:teuthology.orchestra.run.smithi123.stdout:(95/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 66 kB/s | 19 kB 00:00 2023-07-13T13:22:11.504 INFO:teuthology.orchestra.run.smithi123.stdout:(96/166): libcom_err-devel-1.45.6-5.el8.x86_64. 47 kB/s | 39 kB 00:00 2023-07-13T13:22:17.937 INFO:teuthology.orchestra.run.smithi123.stdout:(97/166): libgfortran-8.5.0-20.el8.x86_64.rpm 100 kB/s | 645 kB 00:06 2023-07-13T13:22:20.287 INFO:teuthology.orchestra.run.smithi123.stdout:(98/166): libquadmath-8.5.0-20.el8.x86_64.rpm 73 kB/s | 172 kB 00:02 2023-07-13T13:22:20.937 INFO:teuthology.orchestra.run.smithi123.stdout:(99/166): librabbitmq-0.9.0-4.el8.x86_64.rpm 72 kB/s | 47 kB 00:00 2023-07-13T13:22:24.254 INFO:teuthology.orchestra.run.smithi123.stdout:(100/166): libselinux-devel-2.9-8.el8.x86_64.rp 60 kB/s | 200 kB 00:03 2023-07-13T13:22:26.645 INFO:teuthology.orchestra.run.smithi123.stdout:(101/166): libsepol-devel-2.9-3.el8.x86_64.rpm 36 kB/s | 87 kB 00:02 2023-07-13T13:22:28.545 INFO:teuthology.orchestra.run.smithi123.stdout:(102/166): libuuid-devel-2.32.1-42.el8.x86_64.r 52 kB/s | 99 kB 00:01 2023-07-13T13:22:30.512 INFO:teuthology.orchestra.run.smithi123.stdout:(103/166): libverto-devel-0.3.2-2.el8.x86_64.rp 9.2 kB/s | 18 kB 00:01 2023-07-13T13:22:33.903 INFO:teuthology.orchestra.run.smithi123.stdout:(104/166): libzstd-devel-1.4.4-1.el8.x86_64.rpm 13 kB/s | 44 kB 00:03 2023-07-13T13:22:58.293 INFO:teuthology.orchestra.run.smithi118.stdout:(105/166): openssl-devel-1.1.1k-9.el8.x86_64.rp 56 kB/s | 3.2 MB 00:57 2023-07-13T13:23:07.735 INFO:teuthology.orchestra.run.smithi118.stdout:(106/166): pcre2-devel-10.32-3.el8.x86_64.rpm 64 kB/s | 605 kB 00:09 2023-07-13T13:23:11.376 INFO:teuthology.orchestra.run.smithi118.stdout:(107/166): pcre2-utf16-10.32-3.el8.x86_64.rpm 63 kB/s | 229 kB 00:03 2023-07-13T13:23:14.339 INFO:teuthology.orchestra.run.smithi118.stdout:(108/166): pcre2-utf32-10.32-3.el8.x86_64.rpm 74 kB/s | 220 kB 00:02 2023-07-13T13:23:20.859 INFO:teuthology.orchestra.run.smithi118.stdout:(109/166): python3-cffi-1.11.5-6.el8.x86_64.rpm 38 kB/s | 249 kB 00:06 2023-07-13T13:23:28.897 INFO:teuthology.orchestra.run.smithi123.stdout:(105/166): openssl-devel-1.1.1k-9.el8.x86_64.rp 59 kB/s | 3.2 MB 00:54 2023-07-13T13:23:30.641 INFO:teuthology.orchestra.run.smithi118.stdout:(110/166): python3-cryptography-3.2.1-6.el8.x86 66 kB/s | 641 kB 00:09 2023-07-13T13:23:31.550 INFO:teuthology.orchestra.run.smithi118.stdout:(111/166): python3-jwt-1.6.1-2.el8.noarch.rpm 47 kB/s | 43 kB 00:00 2023-07-13T13:23:35.075 INFO:teuthology.orchestra.run.smithi118.stdout:(112/166): python3-oauthlib-2.1.0-1.el8.noarch. 44 kB/s | 155 kB 00:03 2023-07-13T13:23:37.258 INFO:teuthology.orchestra.run.smithi118.stdout:(113/166): python3-pycparser-2.14-14.el8.noarch 50 kB/s | 109 kB 00:02 2023-07-13T13:23:39.458 INFO:teuthology.orchestra.run.smithi118.stdout:(114/166): python3-requests-oauthlib-1.0.0-1.el 19 kB/s | 43 kB 00:02 2023-07-13T13:23:42.383 INFO:teuthology.orchestra.run.smithi118.stdout:(115/166): xfsprogs-devel-5.0.0-12.el8.x86_64.r 25 kB/s | 74 kB 00:02 2023-07-13T13:23:42.904 INFO:teuthology.orchestra.run.smithi123.stdout:(106/166): pcre2-devel-10.32-3.el8.x86_64.rpm 43 kB/s | 605 kB 00:14 2023-07-13T13:23:42.941 INFO:teuthology.orchestra.run.smithi118.stdout:(116/166): zlib-devel-1.2.11-21.el8.x86_64.rpm 104 kB/s | 58 kB 00:00 2023-07-13T13:23:43.383 INFO:teuthology.orchestra.run.smithi118.stdout:(117/166): gperftools-libs-2.7-9.el8.x86_64.rpm 694 kB/s | 306 kB 00:00 2023-07-13T13:23:43.492 INFO:teuthology.orchestra.run.smithi118.stdout:(118/166): liboath-2.6.2-3.el8.x86_64.rpm 543 kB/s | 59 kB 00:00 2023-07-13T13:23:43.584 INFO:teuthology.orchestra.run.smithi118.stdout:(119/166): libunwind-1.3.1-3.el8.x86_64.rpm 818 kB/s | 75 kB 00:00 2023-07-13T13:23:43.743 INFO:teuthology.orchestra.run.smithi118.stdout:(120/166): python3-asyncssh-2.7.0-2.el8.noarch. 2.9 MB/s | 476 kB 00:00 2023-07-13T13:23:43.834 INFO:teuthology.orchestra.run.smithi118.stdout:(121/166): python3-bcrypt-3.1.6-2.el8.1.x86_64. 476 kB/s | 44 kB 00:00 2023-07-13T13:23:43.918 INFO:teuthology.orchestra.run.smithi118.stdout:(122/166): python3-beautifulsoup4-4.6.3-2.el8.1 2.2 MB/s | 185 kB 00:00 2023-07-13T13:23:44.019 INFO:teuthology.orchestra.run.smithi118.stdout:(123/166): python3-cachetools-3.1.1-4.el8.noarc 329 kB/s | 33 kB 00:00 2023-07-13T13:23:44.394 INFO:teuthology.orchestra.run.smithi118.stdout:(124/166): python3-certifi-2018.10.15-7.el8.noa 43 kB/s | 16 kB 00:00 2023-07-13T13:23:44.602 INFO:teuthology.orchestra.run.smithi118.stdout:(125/166): python3-cheroot-8.5.2-1.el8.noarch.r 829 kB/s | 173 kB 00:00 2023-07-13T13:23:44.778 INFO:teuthology.orchestra.run.smithi118.stdout:(126/166): python3-cherrypy-18.4.0-1.el8.noarch 2.1 MB/s | 384 kB 00:00 2023-07-13T13:23:44.887 INFO:teuthology.orchestra.run.smithi118.stdout:(127/166): python3-google-auth-1.1.1-10.el8.noa 750 kB/s | 81 kB 00:00 2023-07-13T13:23:44.954 INFO:teuthology.orchestra.run.smithi118.stdout:(128/166): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-07-13T13:23:45.013 INFO:teuthology.orchestra.run.smithi118.stdout:(129/166): python3-jaraco-functools-2.0-4.el8.n 302 kB/s | 18 kB 00:00 2023-07-13T13:23:45.404 INFO:teuthology.orchestra.run.smithi118.stdout:(130/166): python3-kubernetes-11.0.0-6.el8.noar 3.0 MB/s | 1.2 MB 00:00 2023-07-13T13:23:45.488 INFO:teuthology.orchestra.run.smithi118.stdout:(131/166): python3-logutils-0.3.5-11.el8.noarch 586 kB/s | 49 kB 00:00 2023-07-13T13:23:45.597 INFO:teuthology.orchestra.run.smithi118.stdout:(132/166): python3-more-itertools-7.2.0-3.el8.n 542 kB/s | 59 kB 00:00 2023-07-13T13:23:45.797 INFO:teuthology.orchestra.run.smithi118.stdout:(133/166): python3-natsort-7.1.1-2.el8.noarch.r 301 kB/s | 60 kB 00:00 2023-07-13T13:23:45.913 INFO:teuthology.orchestra.run.smithi123.stdout:(107/166): pcre2-utf16-10.32-3.el8.x86_64.rpm 76 kB/s | 229 kB 00:03 2023-07-13T13:23:46.055 INFO:teuthology.orchestra.run.smithi118.stdout:(134/166): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-07-13T13:23:46.164 INFO:teuthology.orchestra.run.smithi118.stdout:(135/166): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-07-13T13:23:46.265 INFO:teuthology.orchestra.run.smithi118.stdout:(136/166): python3-repoze-lru-0.7-6.el8.noarch. 337 kB/s | 34 kB 00:00 2023-07-13T13:23:46.531 INFO:teuthology.orchestra.run.smithi118.stdout:(137/166): rbd-mirror-debuginfo-18.0.0-4842.gf0 283 kB/s | 73 MB 04:24 2023-07-13T13:23:46.557 INFO:teuthology.orchestra.run.smithi118.stdout:(138/166): python3-routes-2.4.1-12.el8.noarch.r 673 kB/s | 196 kB 00:00 2023-07-13T13:23:46.674 INFO:teuthology.orchestra.run.smithi118.stdout:(139/166): python3-simplegeneric-0.8.1-17.el8.n 160 kB/s | 19 kB 00:00 2023-07-13T13:23:46.807 INFO:teuthology.orchestra.run.smithi118.stdout:(140/166): python3-singledispatch-3.4.0.3-18.el 179 kB/s | 24 kB 00:00 2023-07-13T13:23:46.916 INFO:teuthology.orchestra.run.smithi118.stdout:(141/166): python3-rsa-4.8-1.el8.noarch.rpm 160 kB/s | 61 kB 00:00 2023-07-13T13:23:46.933 INFO:teuthology.orchestra.run.smithi118.stdout:(142/166): python3-tempora-1.14.1-5.el8.noarch. 233 kB/s | 29 kB 00:00 2023-07-13T13:23:47.042 INFO:teuthology.orchestra.run.smithi118.stdout:(143/166): python3-trustme-0.6.0-4.el8.noarch.r 219 kB/s | 27 kB 00:00 2023-07-13T13:23:47.308 INFO:teuthology.orchestra.run.smithi118.stdout:(144/166): python3-waitress-1.4.3-1.el8.noarch. 681 kB/s | 255 kB 00:00 2023-07-13T13:23:47.334 INFO:teuthology.orchestra.run.smithi118.stdout:(145/166): python3-webob-1.8.5-1.el8.1.noarch.r 860 kB/s | 251 kB 00:00 2023-07-13T13:23:47.442 INFO:teuthology.orchestra.run.smithi118.stdout:(146/166): python3-webtest-2.0.33-1.el8.noarch. 788 kB/s | 85 kB 00:00 2023-07-13T13:23:47.459 INFO:teuthology.orchestra.run.smithi118.stdout:(147/166): python3-websocket-client-0.56.0-5.el 407 kB/s | 61 kB 00:00 2023-07-13T13:23:47.585 INFO:teuthology.orchestra.run.smithi118.stdout:(148/166): python3-zc-lockfile-2.0-2.el8.noarch 162 kB/s | 23 kB 00:00 2023-07-13T13:23:47.860 INFO:teuthology.orchestra.run.smithi118.stdout:(149/166): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2023-07-13T13:23:48.096 INFO:teuthology.orchestra.run.smithi123.stdout:(108/166): pcre2-utf32-10.32-3.el8.x86_64.rpm 101 kB/s | 220 kB 00:02 2023-07-13T13:23:54.436 INFO:teuthology.orchestra.run.smithi123.stdout:(109/166): python3-cffi-1.11.5-6.el8.x86_64.rpm 39 kB/s | 249 kB 00:06 2023-07-13T13:23:56.559 INFO:teuthology.orchestra.run.smithi118.stdout:(150/166): librbd1-18.0.0-4842.gf0b380e6.el8.x8 419 kB/s | 3.6 MB 00:08 2023-07-13T13:23:58.801 INFO:teuthology.orchestra.run.smithi118.stdout:(151/166): librados2-18.0.0-4842.gf0b380e6.el8. 334 kB/s | 3.7 MB 00:11 2023-07-13T13:23:59.459 INFO:teuthology.orchestra.run.smithi118.stdout:(152/166): elfutils-debuginfod-client-0.189-2.e 115 kB/s | 76 kB 00:00 2023-07-13T13:24:00.285 INFO:teuthology.orchestra.run.smithi118.stdout:(153/166): NetworkManager-initscripts-updown-1. 38 kB/s | 143 kB 00:03 2023-07-13T13:24:03.584 INFO:teuthology.orchestra.run.smithi118.stdout:(154/166): elfutils-libelf-0.189-2.el8.x86_64.r 56 kB/s | 232 kB 00:04 2023-07-13T13:24:04.343 INFO:teuthology.orchestra.run.smithi118.stdout:(155/166): elfutils-libs-0.189-2.el8.x86_64.rpm 75 kB/s | 302 kB 00:04 2023-07-13T13:24:05.901 INFO:teuthology.orchestra.run.smithi123.stdout:(110/166): python3-cryptography-3.2.1-6.el8.x86 56 kB/s | 641 kB 00:11 2023-07-13T13:24:06.818 INFO:teuthology.orchestra.run.smithi123.stdout:(111/166): python3-jwt-1.6.1-2.el8.noarch.rpm 46 kB/s | 43 kB 00:00 2023-07-13T13:24:09.259 INFO:teuthology.orchestra.run.smithi123.stdout:(112/166): python3-oauthlib-2.1.0-1.el8.noarch. 63 kB/s | 155 kB 00:02 2023-07-13T13:24:10.976 INFO:teuthology.orchestra.run.smithi123.stdout:(113/166): python3-pycparser-2.14-14.el8.noarch 64 kB/s | 109 kB 00:01 2023-07-13T13:24:11.358 INFO:teuthology.orchestra.run.smithi118.stdout:(156/166): libblkid-2.32.1-42.el8.x86_64.rpm 31 kB/s | 220 kB 00:07 2023-07-13T13:24:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:(114/166): python3-requests-oauthlib-1.0.0-1.el 51 kB/s | 43 kB 00:00 2023-07-13T13:24:14.768 INFO:teuthology.orchestra.run.smithi123.stdout:(115/166): xfsprogs-devel-5.0.0-12.el8.x86_64.r 25 kB/s | 74 kB 00:02 2023-07-13T13:24:15.632 INFO:teuthology.orchestra.run.smithi118.stdout:(157/166): libfdisk-2.32.1-42.el8.x86_64.rpm 59 kB/s | 253 kB 00:04 2023-07-13T13:24:16.125 INFO:teuthology.orchestra.run.smithi123.stdout:(116/166): rbd-mirror-debuginfo-18.0.0-4842.gf0 271 kB/s | 73 MB 04:36 2023-07-13T13:24:16.750 INFO:teuthology.orchestra.run.smithi123.stdout:(117/166): zlib-devel-1.2.11-21.el8.x86_64.rpm 29 kB/s | 58 kB 00:01 2023-07-13T13:24:17.043 INFO:teuthology.orchestra.run.smithi123.stdout:(118/166): gperftools-libs-2.7-9.el8.x86_64.rpm 334 kB/s | 306 kB 00:00 2023-07-13T13:24:17.168 INFO:teuthology.orchestra.run.smithi123.stdout:(119/166): liboath-2.6.2-3.el8.x86_64.rpm 141 kB/s | 59 kB 00:00 2023-07-13T13:24:17.218 INFO:teuthology.orchestra.run.smithi123.stdout:(120/166): libunwind-1.3.1-3.el8.x86_64.rpm 428 kB/s | 75 kB 00:00 2023-07-13T13:24:17.385 INFO:teuthology.orchestra.run.smithi123.stdout:(121/166): python3-bcrypt-3.1.6-2.el8.1.x86_64. 262 kB/s | 44 kB 00:00 2023-07-13T13:24:17.835 INFO:teuthology.orchestra.run.smithi123.stdout:(122/166): python3-beautifulsoup4-4.6.3-2.el8.1 412 kB/s | 185 kB 00:00 2023-07-13T13:24:17.977 INFO:teuthology.orchestra.run.smithi123.stdout:(123/166): python3-cachetools-3.1.1-4.el8.noarc 233 kB/s | 33 kB 00:00 2023-07-13T13:24:18.077 INFO:teuthology.orchestra.run.smithi123.stdout:(124/166): python3-certifi-2018.10.15-7.el8.noa 163 kB/s | 16 kB 00:00 2023-07-13T13:24:18.503 INFO:teuthology.orchestra.run.smithi123.stdout:(125/166): python3-asyncssh-2.7.0-2.el8.noarch. 356 kB/s | 476 kB 00:01 2023-07-13T13:24:18.894 INFO:teuthology.orchestra.run.smithi123.stdout:(126/166): python3-cheroot-8.5.2-1.el8.noarch.r 211 kB/s | 173 kB 00:00 2023-07-13T13:24:19.211 INFO:teuthology.orchestra.run.smithi123.stdout:(127/166): python3-google-auth-1.1.1-10.el8.noa 257 kB/s | 81 kB 00:00 2023-07-13T13:24:19.236 INFO:teuthology.orchestra.run.smithi123.stdout:(128/166): python3-cherrypy-18.4.0-1.el8.noarch 524 kB/s | 384 kB 00:00 2023-07-13T13:24:19.278 INFO:teuthology.orchestra.run.smithi123.stdout:(129/166): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-07-13T13:24:19.304 INFO:teuthology.orchestra.run.smithi123.stdout:(130/166): python3-jaraco-functools-2.0-4.el8.n 263 kB/s | 18 kB 00:00 2023-07-13T13:24:19.445 INFO:teuthology.orchestra.run.smithi123.stdout:(131/166): python3-logutils-0.3.5-11.el8.noarch 344 kB/s | 49 kB 00:00 2023-07-13T13:24:19.587 INFO:teuthology.orchestra.run.smithi123.stdout:(132/166): python3-more-itertools-7.2.0-3.el8.n 414 kB/s | 59 kB 00:00 2023-07-13T13:24:19.738 INFO:teuthology.orchestra.run.smithi123.stdout:(133/166): python3-natsort-7.1.1-2.el8.noarch.r 402 kB/s | 60 kB 00:00 2023-07-13T13:24:20.196 INFO:teuthology.orchestra.run.smithi123.stdout:(134/166): python3-pecan-1.3.2-9.el8.noarch.rpm 617 kB/s | 283 kB 00:00 2023-07-13T13:24:20.214 INFO:teuthology.orchestra.run.smithi118.stdout:(158/166): libmount-2.32.1-42.el8.x86_64.rpm 52 kB/s | 236 kB 00:04 2023-07-13T13:24:20.263 INFO:teuthology.orchestra.run.smithi123.stdout:(135/166): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-07-13T13:24:20.422 INFO:teuthology.orchestra.run.smithi123.stdout:(136/166): python3-repoze-lru-0.7-6.el8.noarch. 212 kB/s | 34 kB 00:00 2023-07-13T13:24:20.781 INFO:teuthology.orchestra.run.smithi118.stdout:(159/166): iproute-6.2.0-2.el8.x86_64.rpm 51 kB/s | 880 kB 00:17 2023-07-13T13:24:20.847 INFO:teuthology.orchestra.run.smithi123.stdout:(137/166): python3-routes-2.4.1-12.el8.noarch.r 462 kB/s | 196 kB 00:00 2023-07-13T13:24:20.923 INFO:teuthology.orchestra.run.smithi123.stdout:(138/166): python3-kubernetes-11.0.0-6.el8.noar 726 kB/s | 1.2 MB 00:01 2023-07-13T13:24:20.998 INFO:teuthology.orchestra.run.smithi123.stdout:(139/166): python3-simplegeneric-0.8.1-17.el8.n 250 kB/s | 19 kB 00:00 2023-07-13T13:24:21.048 INFO:teuthology.orchestra.run.smithi123.stdout:(140/166): python3-rsa-4.8-1.el8.noarch.rpm 306 kB/s | 61 kB 00:00 2023-07-13T13:24:21.132 INFO:teuthology.orchestra.run.smithi123.stdout:(141/166): python3-singledispatch-3.4.0.3-18.el 179 kB/s | 24 kB 00:00 2023-07-13T13:24:21.199 INFO:teuthology.orchestra.run.smithi123.stdout:(142/166): python3-tempora-1.14.1-5.el8.noarch. 194 kB/s | 29 kB 00:00 2023-07-13T13:24:21.224 INFO:teuthology.orchestra.run.smithi123.stdout:(143/166): python3-trustme-0.6.0-4.el8.noarch.r 300 kB/s | 27 kB 00:00 2023-07-13T13:24:21.456 INFO:teuthology.orchestra.run.smithi118.stdout:(160/166): libsmartcols-2.32.1-42.el8.x86_64.rp 144 kB/s | 179 kB 00:01 2023-07-13T13:24:21.516 INFO:teuthology.orchestra.run.smithi123.stdout:(144/166): python3-webob-1.8.5-1.el8.1.noarch.r 862 kB/s | 251 kB 00:00 2023-07-13T13:24:21.532 INFO:teuthology.orchestra.run.smithi118.stdout:(161/166): libuuid-2.32.1-42.el8.x86_64.rpm 131 kB/s | 98 kB 00:00 2023-07-13T13:24:21.582 INFO:teuthology.orchestra.run.smithi123.stdout:(145/166): python3-websocket-client-0.56.0-5.el 921 kB/s | 61 kB 00:00 2023-07-13T13:24:21.683 INFO:teuthology.orchestra.run.smithi123.stdout:(146/166): python3-waitress-1.4.3-1.el8.noarch. 528 kB/s | 255 kB 00:00 2023-07-13T13:24:21.708 INFO:teuthology.orchestra.run.smithi123.stdout:(147/166): python3-webtest-2.0.33-1.el8.noarch. 681 kB/s | 85 kB 00:00 2023-07-13T13:24:21.750 INFO:teuthology.orchestra.run.smithi123.stdout:(148/166): python3-zc-lockfile-2.0-2.el8.noarch 344 kB/s | 23 kB 00:00 2023-07-13T13:24:23.465 INFO:teuthology.orchestra.run.smithi118.stdout:(162/166): util-linux-user-2.32.1-42.el8.x86_64 53 kB/s | 102 kB 00:01 2023-07-13T13:24:23.825 INFO:teuthology.orchestra.run.smithi123.stdout:(149/166): thrift-0.13.0-2.el8.x86_64.rpm 839 kB/s | 1.7 MB 00:02 2023-07-13T13:24:28.147 INFO:teuthology.orchestra.run.smithi118.stdout:(163/166): xfsdump-3.1.8-6.el8.x86_64.rpm 71 kB/s | 334 kB 00:04 2023-07-13T13:24:33.664 INFO:teuthology.orchestra.run.smithi123.stdout:(150/166): librados2-18.0.0-4842.gf0b380e6.el8. 315 kB/s | 3.7 MB 00:11 2023-07-13T13:24:34.622 INFO:teuthology.orchestra.run.smithi123.stdout:(151/166): NetworkManager-initscripts-updown-1. 150 kB/s | 143 kB 00:00 2023-07-13T13:24:35.206 INFO:teuthology.orchestra.run.smithi123.stdout:(152/166): elfutils-debuginfod-client-0.189-2.e 130 kB/s | 76 kB 00:00 2023-07-13T13:24:36.314 INFO:teuthology.orchestra.run.smithi123.stdout:(153/166): librbd1-18.0.0-4842.gf0b380e6.el8.x8 292 kB/s | 3.6 MB 00:12 2023-07-13T13:24:37.864 INFO:teuthology.orchestra.run.smithi123.stdout:(154/166): elfutils-libelf-0.189-2.el8.x86_64.r 87 kB/s | 232 kB 00:02 2023-07-13T13:24:40.755 INFO:teuthology.orchestra.run.smithi123.stdout:(155/166): elfutils-libs-0.189-2.el8.x86_64.rpm 68 kB/s | 302 kB 00:04 2023-07-13T13:24:45.463 INFO:teuthology.orchestra.run.smithi123.stdout:(156/166): libblkid-2.32.1-42.el8.x86_64.rpm 47 kB/s | 220 kB 00:04 2023-07-13T13:24:49.120 INFO:teuthology.orchestra.run.smithi123.stdout:(157/166): libfdisk-2.32.1-42.el8.x86_64.rpm 69 kB/s | 253 kB 00:03 2023-07-13T13:24:49.255 INFO:teuthology.orchestra.run.smithi123.stdout:(158/166): iproute-6.2.0-2.el8.x86_64.rpm 77 kB/s | 880 kB 00:11 2023-07-13T13:24:49.717 INFO:teuthology.orchestra.run.smithi118.stdout:(164/166): xfsprogs-5.0.0-12.el8.x86_64.rpm 51 kB/s | 1.1 MB 00:21 2023-07-13T13:24:53.770 INFO:teuthology.orchestra.run.smithi123.stdout:(159/166): libmount-2.32.1-42.el8.x86_64.rpm 51 kB/s | 236 kB 00:04 2023-07-13T13:24:55.219 INFO:teuthology.orchestra.run.smithi123.stdout:(160/166): libuuid-2.32.1-42.el8.x86_64.rpm 68 kB/s | 98 kB 00:01 2023-07-13T13:24:56.320 INFO:teuthology.orchestra.run.smithi123.stdout:(161/166): libsmartcols-2.32.1-42.el8.x86_64.rp 25 kB/s | 179 kB 00:07 2023-07-13T13:24:58.244 INFO:teuthology.orchestra.run.smithi123.stdout:(162/166): util-linux-user-2.32.1-42.el8.x86_64 53 kB/s | 102 kB 00:01 2023-07-13T13:25:05.343 INFO:teuthology.orchestra.run.smithi123.stdout:(163/166): xfsdump-3.1.8-6.el8.x86_64.rpm 47 kB/s | 334 kB 00:07 2023-07-13T13:25:06.547 INFO:teuthology.orchestra.run.smithi118.stdout:(165/166): util-linux-2.32.1-42.el8.x86_64.rpm 59 kB/s | 2.6 MB 00:45 2023-07-13T13:25:18.532 INFO:teuthology.orchestra.run.smithi123.stdout:(164/166): xfsprogs-5.0.0-12.el8.x86_64.rpm 84 kB/s | 1.1 MB 00:13 2023-07-13T13:25:43.751 INFO:teuthology.orchestra.run.smithi123.stdout:(165/166): util-linux-2.32.1-42.el8.x86_64.rpm 55 kB/s | 2.6 MB 00:48 2023-07-13T13:43:48.189 INFO:teuthology.orchestra.run.smithi118.stdout:(166/166): ceph-test-debuginfo-18.0.0-4842.gf0b 486 kB/s | 891 MB 31:15 2023-07-13T13:43:48.191 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2023-07-13T13:43:48.191 INFO:teuthology.orchestra.run.smithi118.stdout:Total 942 kB/s | 2.8 GB 51:37 2023-07-13T13:43:49.055 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2023-07-13T13:43:49.505 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2023-07-13T13:43:49.506 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2023-07-13T13:44:00.689 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2023-07-13T13:44:00.692 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2023-07-13T13:44:01.891 INFO:teuthology.orchestra.run.smithi123.stdout:(166/166): ceph-test-debuginfo-18.0.0-4842.gf0b 501 kB/s | 891 MB 30:22 2023-07-13T13:44:01.894 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-07-13T13:44:01.894 INFO:teuthology.orchestra.run.smithi123.stdout:Total 944 kB/s | 2.8 GB 51:32 2023-07-13T13:44:02.776 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-07-13T13:44:03.223 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-07-13T13:44:03.224 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-07-13T13:44:14.478 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-07-13T13:44:14.482 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-07-13T13:44:16.363 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2023-07-13T13:44:17.971 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 1/1 2023-07-13T13:44:18.274 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_6 1/182 2023-07-13T13:44:18.458 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/182 2023-07-13T13:44:18.603 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 3/182 2023-07-13T13:44:18.662 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 3/182 2023-07-13T13:44:18.828 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 4/182 2023-07-13T13:44:18.888 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 4/182 2023-07-13T13:44:19.102 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/182 2023-07-13T13:44:19.308 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 6/182 2023-07-13T13:44:19.483 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/182 2023-07-13T13:44:19.645 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/182 2023-07-13T13:44:20.052 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/182 2023-07-13T13:44:20.228 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:18.0.0-4842.gf0b380e6.el8.x86_64 9/182 2023-07-13T13:44:20.626 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:18.0.0-4842.gf0b380e6.el8.x86_64 9/182 2023-07-13T13:44:20.911 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:18.0.0-4842.gf0b380e6.el8.x86_64 10/182 2023-07-13T13:44:21.038 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:18.0.0-4842.gf0b380e6.el8.x86_64 10/182 2023-07-13T13:44:21.203 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:18.0.0-4842.gf0b380e6.el8.x86_64 11/182 2023-07-13T13:44:21.309 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:18.0.0-4842.gf0b380e6.el8.x86_64 11/182 2023-07-13T13:44:21.510 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:18.0.0-4842.gf0b380e6.el8.x86_64 12/182 2023-07-13T13:44:21.711 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 13/182 2023-07-13T13:44:21.908 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 13/182 2023-07-13T13:44:22.178 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/182 2023-07-13T13:44:22.248 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/182 2023-07-13T13:44:22.493 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/182 2023-07-13T13:44:22.709 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/182 2023-07-13T13:44:23.049 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpq-13.5-1.el8.x86_64 17/182 2023-07-13T13:44:23.323 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 18/182 2023-07-13T13:44:23.436 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:18.0.0-4842.gf0b380e6.el8.x86_64 19/182 2023-07-13T13:44:23.543 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4842.gf0b380e6.el8.x86_64 19/182 2023-07-13T13:44:23.652 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:18.0.0-4842.gf0b380e6.el8.x86 20/182 2023-07-13T13:44:23.774 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4842.gf0b380e6.el8.x86 20/182 2023-07-13T13:44:23.958 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 21/182 2023-07-13T13:44:24.163 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 22/182 2023-07-13T13:44:24.269 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 23/182 2023-07-13T13:44:24.411 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 23/182 2023-07-13T13:44:24.544 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 24/182 2023-07-13T13:44:25.141 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 24/182 2023-07-13T13:44:25.360 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.15-4.el8.x86_64 25/182 2023-07-13T13:44:25.976 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 25/182 2023-07-13T13:44:26.127 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 26/182 2023-07-13T13:44:26.821 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 26/182 2023-07-13T13:44:27.154 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 27/182 2023-07-13T13:44:27.383 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 28/182 2023-07-13T13:44:27.581 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/182 2023-07-13T13:44:27.787 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 30/182 2023-07-13T13:44:28.008 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:18.0.0-4842.gf0b380e6.el8. 31/182 2023-07-13T13:44:28.180 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:18.0.0-4842.gf0b380e6.el 32/182 2023-07-13T13:44:28.422 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:18.0.0-4842.gf0b380e6.el8.x86_6 33/182 2023-07-13T13:44:29.397 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/182 2023-07-13T13:44:29.709 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/182 2023-07-13T13:44:29.944 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-07-13T13:44:30.058 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/182 2023-07-13T13:44:30.218 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/182 2023-07-13T13:44:31.547 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 1/1 2023-07-13T13:44:31.829 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_6 1/182 2023-07-13T13:44:32.000 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/182 2023-07-13T13:44:32.008 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/182 2023-07-13T13:44:32.162 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 3/182 2023-07-13T13:44:32.241 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 3/182 2023-07-13T13:44:32.289 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 38/182 2023-07-13T13:44:32.404 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 4/182 2023-07-13T13:44:32.474 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 4/182 2023-07-13T13:44:32.528 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 39/182 2023-07-13T13:44:32.663 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/182 2023-07-13T13:44:32.777 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.8-1.el8.noarch 40/182 2023-07-13T13:44:32.858 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 6/182 2023-07-13T13:44:32.973 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 41/182 2023-07-13T13:44:33.035 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/182 2023-07-13T13:44:33.162 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:18.0.0-4842.gf0b380e6.el8.x86_6 42/182 2023-07-13T13:44:33.204 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/182 2023-07-13T13:44:33.359 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 43/182 2023-07-13T13:44:33.534 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 44/182 2023-07-13T13:44:33.602 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/182 2023-07-13T13:44:33.742 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 45/182 2023-07-13T13:44:33.795 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:18.0.0-4842.gf0b380e6.el8.x86_64 9/182 2023-07-13T13:44:33.819 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 45/182 2023-07-13T13:44:33.992 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 46/182 2023-07-13T13:44:34.104 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 46/182 2023-07-13T13:44:34.191 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:18.0.0-4842.gf0b380e6.el8.x86_64 9/182 2023-07-13T13:44:34.263 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 47/182 2023-07-13T13:44:34.388 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:18.0.0-4842.gf0b380e6.el8.x86_64 10/182 2023-07-13T13:44:34.442 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 48/182 2023-07-13T13:44:34.496 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:18.0.0-4842.gf0b380e6.el8.x86_64 10/182 2023-07-13T13:44:34.645 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:18.0.0-4842.gf0b380e6.el8.x86_64 11/182 2023-07-13T13:44:34.734 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:18.0.0-4842.gf0b380e6.el8.x86_64 11/182 2023-07-13T13:44:34.960 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:18.0.0-4842.gf0b380e6.el8.x86_64 12/182 2023-07-13T13:44:34.980 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 48/182 2023-07-13T13:44:35.104 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 13/182 2023-07-13T13:44:35.226 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 49/182 2023-07-13T13:44:35.240 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 49/182 2023-07-13T13:44:35.324 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 13/182 2023-07-13T13:44:35.411 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 50/182 2023-07-13T13:44:35.651 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 51/182 2023-07-13T13:44:35.720 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/182 2023-07-13T13:44:35.783 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/182 2023-07-13T13:44:35.957 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 52/182 2023-07-13T13:44:35.967 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/182 2023-07-13T13:44:36.130 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 53/182 2023-07-13T13:44:36.159 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/182 2023-07-13T13:44:36.303 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 54/182 2023-07-13T13:44:36.476 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 55/182 2023-07-13T13:44:36.508 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpq-13.5-1.el8.x86_64 17/182 2023-07-13T13:44:36.682 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 18/182 2023-07-13T13:44:36.713 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 56/182 2023-07-13T13:44:36.803 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:18.0.0-4842.gf0b380e6.el8.x86_64 19/182 2023-07-13T13:44:36.909 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4842.gf0b380e6.el8.x86_64 19/182 2023-07-13T13:44:36.919 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 57/182 2023-07-13T13:44:37.028 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:18.0.0-4842.gf0b380e6.el8.x86 20/182 2023-07-13T13:44:37.078 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 58/182 2023-07-13T13:44:37.132 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4842.gf0b380e6.el8.x86 20/182 2023-07-13T13:44:37.206 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 59/182 2023-07-13T13:44:37.301 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 21/182 2023-07-13T13:44:37.379 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 60/182 2023-07-13T13:44:37.458 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 22/182 2023-07-13T13:44:37.586 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 23/182 2023-07-13T13:44:37.589 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 61/182 2023-07-13T13:44:37.704 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 23/182 2023-07-13T13:44:37.758 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-2.6-1.el8.noarch 62/182 2023-07-13T13:44:37.861 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 24/182 2023-07-13T13:44:37.936 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 63/182 2023-07-13T13:44:38.151 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 64/182 2023-07-13T13:44:38.433 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 65/182 2023-07-13T13:44:38.458 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 24/182 2023-07-13T13:44:38.621 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 66/182 2023-07-13T13:44:38.628 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.15-4.el8.x86_64 25/182 2023-07-13T13:44:38.944 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 67/182 2023-07-13T13:44:39.243 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 25/182 2023-07-13T13:44:39.275 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 68/182 2023-07-13T13:44:39.386 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 26/182 2023-07-13T13:44:39.467 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 69/182 2023-07-13T13:44:40.085 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 26/182 2023-07-13T13:44:40.200 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 70/182 2023-07-13T13:44:40.389 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 27/182 2023-07-13T13:44:40.408 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:18.0.0-4842.gf0b380e6.el8.x86_64 71/182 2023-07-13T13:44:40.466 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:18.0.0-4842.gf0b380e6.el8.x86_64 71/182 2023-07-13T13:44:40.584 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 28/182 2023-07-13T13:44:40.679 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 72/182 2023-07-13T13:44:40.749 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/182 2023-07-13T13:44:40.973 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/182 2023-07-13T13:44:40.980 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 30/182 2023-07-13T13:44:41.176 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:18.0.0-4842.gf0b380e6.el8. 31/182 2023-07-13T13:44:41.328 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/182 2023-07-13T13:44:41.347 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:18.0.0-4842.gf0b380e6.el 32/182 2023-07-13T13:44:41.564 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:18.0.0-4842.gf0b380e6.el8.x86_6 33/182 2023-07-13T13:44:41.619 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 75/182 2023-07-13T13:44:41.851 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/182 2023-07-13T13:44:42.078 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/182 2023-07-13T13:44:42.329 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/182 2023-07-13T13:44:42.541 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/182 2023-07-13T13:44:42.843 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/182 2023-07-13T13:44:43.133 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/182 2023-07-13T13:44:43.327 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/182 2023-07-13T13:44:43.430 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/182 2023-07-13T13:44:43.759 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/182 2023-07-13T13:44:43.957 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/182 2023-07-13T13:44:44.232 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/182 2023-07-13T13:44:44.513 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/182 2023-07-13T13:44:44.733 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/182 2023-07-13T13:44:45.026 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/182 2023-07-13T13:44:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/182 2023-07-13T13:44:45.219 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/182 2023-07-13T13:44:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 38/182 2023-07-13T13:44:45.531 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/182 2023-07-13T13:44:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 39/182 2023-07-13T13:44:45.804 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/182 2023-07-13T13:44:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.8-1.el8.noarch 40/182 2023-07-13T13:44:45.942 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/182 2023-07-13T13:44:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 41/182 2023-07-13T13:44:46.106 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/182 2023-07-13T13:44:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:18.0.0-4842.gf0b380e6.el8.x86_6 42/182 2023-07-13T13:44:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 43/182 2023-07-13T13:44:46.434 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/182 2023-07-13T13:44:46.563 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 44/182 2023-07-13T13:44:46.768 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 45/182 2023-07-13T13:44:46.831 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 45/182 2023-07-13T13:44:47.001 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 46/182 2023-07-13T13:44:47.065 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 46/182 2023-07-13T13:44:47.213 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 47/182 2023-07-13T13:44:47.401 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 48/182 2023-07-13T13:44:47.628 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/182 2023-07-13T13:44:47.754 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/182 2023-07-13T13:44:47.899 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 48/182 2023-07-13T13:44:47.960 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/182 2023-07-13T13:44:48.135 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 49/182 2023-07-13T13:44:48.149 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 49/182 2023-07-13T13:44:48.166 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/182 2023-07-13T13:44:48.312 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 50/182 2023-07-13T13:44:48.392 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.7-17.el8.x86_64 96/182 2023-07-13T13:44:48.550 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/182 2023-07-13T13:44:48.561 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 51/182 2023-07-13T13:44:48.706 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : uuid-1.6.2-43.el8.x86_64 98/182 2023-07-13T13:44:48.800 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 98/182 2023-07-13T13:44:48.808 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 52/182 2023-07-13T13:44:48.956 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 99/182 2023-07-13T13:44:49.005 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 53/182 2023-07-13T13:44:49.162 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 54/182 2023-07-13T13:44:49.165 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 100/182 2023-07-13T13:44:49.335 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 55/182 2023-07-13T13:44:49.555 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 56/182 2023-07-13T13:44:49.763 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 57/182 2023-07-13T13:44:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 58/182 2023-07-13T13:44:50.036 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 59/182 2023-07-13T13:44:50.205 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 60/182 2023-07-13T13:44:50.373 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 61/182 2023-07-13T13:44:50.518 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-2.6-1.el8.noarch 62/182 2023-07-13T13:44:50.681 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 63/182 2023-07-13T13:44:50.910 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 64/182 2023-07-13T13:44:51.159 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 65/182 2023-07-13T13:44:51.362 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 66/182 2023-07-13T13:44:51.722 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 67/182 2023-07-13T13:44:51.740 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 101/182 2023-07-13T13:44:51.984 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 68/182 2023-07-13T13:44:51.989 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 101/182 2023-07-13T13:44:52.184 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 69/182 2023-07-13T13:44:52.600 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 101/182 2023-07-13T13:44:52.933 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 70/182 2023-07-13T13:44:53.117 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:18.0.0-4842.gf0b380e6.el8.x86_64 71/182 2023-07-13T13:44:53.193 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:18.0.0-4842.gf0b380e6.el8.x86_64 71/182 2023-07-13T13:44:53.325 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:18.0.0-4842.gf0b380e6.el8.x86_64 102/182 2023-07-13T13:44:53.388 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 72/182 2023-07-13T13:44:53.434 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:18.0.0-4842.gf0b380e6.el8.x86_64 102/182 2023-07-13T13:44:53.622 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:18.0.0-4842.gf0b380e6.el8.x86_64 103/182 2023-07-13T13:44:53.668 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/182 2023-07-13T13:44:54.045 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/182 2023-07-13T13:44:54.286 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 75/182 2023-07-13T13:44:54.485 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/182 2023-07-13T13:44:54.729 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/182 2023-07-13T13:44:54.954 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/182 2023-07-13T13:44:56.003 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/182 2023-07-13T13:44:56.360 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/182 2023-07-13T13:44:56.582 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/182 2023-07-13T13:44:56.808 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/182 2023-07-13T13:44:57.100 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/182 2023-07-13T13:44:57.301 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/182 2023-07-13T13:44:57.519 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/182 2023-07-13T13:44:57.711 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/182 2023-07-13T13:44:58.007 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/182 2023-07-13T13:44:58.196 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/182 2023-07-13T13:44:58.351 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/182 2023-07-13T13:44:58.505 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/182 2023-07-13T13:44:58.836 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/182 2023-07-13T13:44:59.086 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/182 2023-07-13T13:44:59.237 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/182 2023-07-13T13:44:59.432 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/182 2023-07-13T13:44:59.650 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/182 2023-07-13T13:44:59.841 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.7-17.el8.x86_64 96/182 2023-07-13T13:45:00.025 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/182 2023-07-13T13:45:00.216 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-43.el8.x86_64 98/182 2023-07-13T13:45:00.314 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 98/182 2023-07-13T13:45:00.507 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 99/182 2023-07-13T13:45:00.658 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 100/182 2023-07-13T13:45:03.785 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 101/182 2023-07-13T13:45:04.024 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 101/182 2023-07-13T13:45:04.620 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 101/182 2023-07-13T13:45:04.931 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:18.0.0-4842.gf0b380e6.el8.x86_64 102/182 2023-07-13T13:45:05.029 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:18.0.0-4842.gf0b380e6.el8.x86_64 102/182 2023-07-13T13:45:05.198 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:18.0.0-4842.gf0b380e6.el8.x86_64 103/182 2023-07-13T13:45:12.632 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4842.gf0b380e6.el8.x86_64 103/182 2023-07-13T13:45:12.632 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2023-07-13T13:45:12.633 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2023-07-13T13:45:12.633 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-07-13T13:45:12.633 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /run 2023-07-13T13:45:12.633 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2023-07-13T13:45:12.633 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2023-07-13T13:45:12.633 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2023-07-13T13:45:12.633 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2023-07-13T13:45:12.634 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /dev 2023-07-13T13:45:12.634 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:45:12.994 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:18.0.0-4842.gf0b380e6.el8.noarch 104/182 2023-07-13T13:45:14.594 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:18.0.0-4842.gf0b380e6.el8.noarch 104/182 2023-07-13T13:45:14.762 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:18.0.0-4842.gf0b380e6.el8.x86_64 105/182 2023-07-13T13:45:14.983 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:18.0.0-4842.gf0b380e6.el8.x86_64 105/182 2023-07-13T13:45:15.169 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:18.0.0-4842.gf0b380e6.el8.x86_64 106/182 2023-07-13T13:45:15.624 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:18.0.0-4842.gf0b380e6.el8.x86_64 106/182 2023-07-13T13:45:15.852 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:18.0.0-4842.gf0b380e6.el8.x86_64 107/182 2023-07-13T13:45:15.875 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:18.0.0-4842.gf0b380e6.el8.x86_64 107/182 2023-07-13T13:45:16.092 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 108/182 2023-07-13T13:45:16.279 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 109/182 2023-07-13T13:45:16.426 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 110/182 2023-07-13T13:45:16.507 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 110/182 2023-07-13T13:45:16.786 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.6-7.el8.x86_64 111/182 2023-07-13T13:45:17.001 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.1-7.el8.noarch 112/182 2023-07-13T13:45:17.447 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 113/182 2023-07-13T13:45:17.648 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 113/182 2023-07-13T13:45:17.757 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4842.gf0b380e6.e 114/182 2023-07-13T13:45:17.923 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4842.gf0b380e6. 115/182 2023-07-13T13:45:18.151 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4842.gf0b380e6.el8.noa 116/182 2023-07-13T13:45:18.359 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4842.gf0b380e6.el8.noa 116/182 2023-07-13T13:45:18.594 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4842.gf0b380e6.el8.n 117/182 2023-07-13T13:45:19.559 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4842.gf0b380e6.el8.n 117/182 2023-07-13T13:45:19.759 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4842.gf0b 118/182 2023-07-13T13:45:19.851 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4842.gf0b 118/182 2023-07-13T13:45:20.285 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4842.gf0b380e6.el 119/182 2023-07-13T13:45:20.511 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:18.0.0-4842.gf0b380e6.el8.x86_64 120/182 2023-07-13T13:45:20.547 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4842.gf0b380e6.el8.x86_64 120/182 2023-07-13T13:45:20.742 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:18.0.0-4842.gf0b380e6.el8.noarch 121/182 2023-07-13T13:45:20.752 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4842.gf0b380e6.el8.noarch 121/182 2023-07-13T13:45:20.978 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:18.0.0-4842.gf0b380e6.el8.x86_64 122/182 2023-07-13T13:45:21.150 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/182 2023-07-13T13:45:23.610 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4842.gf0b380e6.el8.x86_64 103/182 2023-07-13T13:45:23.610 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2023-07-13T13:45:23.610 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2023-07-13T13:45:23.610 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2023-07-13T13:45:23.611 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /run 2023-07-13T13:45:23.611 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2023-07-13T13:45:23.611 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2023-07-13T13:45:23.611 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2023-07-13T13:45:23.611 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2023-07-13T13:45:23.611 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2023-07-13T13:45:23.611 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:45:23.970 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:18.0.0-4842.gf0b380e6.el8.noarch 104/182 2023-07-13T13:45:25.544 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:18.0.0-4842.gf0b380e6.el8.noarch 104/182 2023-07-13T13:45:25.691 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/182 2023-07-13T13:45:25.794 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:18.0.0-4842.gf0b380e6.el8.x86_64 105/182 2023-07-13T13:45:26.024 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:18.0.0-4842.gf0b380e6.el8.x86_64 105/182 2023-07-13T13:45:26.203 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:18.0.0-4842.gf0b380e6.el8.x86_64 106/182 2023-07-13T13:45:26.658 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:18.0.0-4842.gf0b380e6.el8.x86_64 106/182 2023-07-13T13:45:26.844 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:18.0.0-4842.gf0b380e6.el8.x86_64 107/182 2023-07-13T13:45:26.868 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:18.0.0-4842.gf0b380e6.el8.x86_64 107/182 2023-07-13T13:45:27.084 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 108/182 2023-07-13T13:45:27.178 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:18.0.0-4842.gf0b380e6.el8.x86_64 124/182 2023-07-13T13:45:27.296 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 109/182 2023-07-13T13:45:27.461 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 110/182 2023-07-13T13:45:27.477 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 125/182 2023-07-13T13:45:27.510 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 125/182 2023-07-13T13:45:27.542 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 110/182 2023-07-13T13:45:27.691 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4842.gf0b38 126/182 2023-07-13T13:45:27.733 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4842.gf0b38 126/182 2023-07-13T13:45:27.798 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : jq-1.6-7.el8.x86_64 111/182 2023-07-13T13:45:27.941 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 127/182 2023-07-13T13:45:28.036 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.1-7.el8.noarch 112/182 2023-07-13T13:45:28.286 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 127/182 2023-07-13T13:45:28.512 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 113/182 2023-07-13T13:45:28.532 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 128/182 2023-07-13T13:45:28.687 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 113/182 2023-07-13T13:45:28.742 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 128/182 2023-07-13T13:45:28.817 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4842.gf0b380e6.e 114/182 2023-07-13T13:45:28.992 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4842.gf0b380e6. 115/182 2023-07-13T13:45:29.072 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 129/182 2023-07-13T13:45:29.202 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4842.gf0b380e6.el8.noa 116/182 2023-07-13T13:45:29.412 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4842.gf0b380e6.el8.noa 116/182 2023-07-13T13:45:29.609 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4842.gf0b380e6.el8.n 117/182 2023-07-13T13:45:30.030 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 130/182 2023-07-13T13:45:30.345 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 131/182 2023-07-13T13:45:30.546 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 132/182 2023-07-13T13:45:30.573 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4842.gf0b380e6.el8.n 117/182 2023-07-13T13:45:30.780 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4842.gf0b 118/182 2023-07-13T13:45:30.819 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 133/182 2023-07-13T13:45:30.868 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4842.gf0b 118/182 2023-07-13T13:45:30.995 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 134/182 2023-07-13T13:45:31.141 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:18.0.0-4842.gf0b380e6.el8.x86_ 135/182 2023-07-13T13:45:31.255 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4842.gf0b380e6.el 119/182 2023-07-13T13:45:31.468 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:18.0.0-4842.gf0b380e6.el8.x86_64 120/182 2023-07-13T13:45:31.503 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4842.gf0b380e6.el8.x86_64 120/182 2023-07-13T13:45:31.710 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:18.0.0-4842.gf0b380e6.el8.noarch 121/182 2023-07-13T13:45:31.720 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4842.gf0b380e6.el8.noarch 121/182 2023-07-13T13:45:31.904 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:18.0.0-4842.gf0b380e6.el8.x86_64 122/182 2023-07-13T13:45:32.077 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/182 2023-07-13T13:45:32.175 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 136/182 2023-07-13T13:45:32.474 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 136/182 2023-07-13T13:45:32.527 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 136/182 2023-07-13T13:45:32.702 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 137/182 2023-07-13T13:45:32.906 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:18.0.0-4842.gf0b380e6.el8.noarch 138/182 2023-07-13T13:45:33.139 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 139/182 2023-07-13T13:45:33.504 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 140/182 2023-07-13T13:45:36.608 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/182 2023-07-13T13:45:38.046 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:18.0.0-4842.gf0b380e6.el8.x86_64 124/182 2023-07-13T13:45:38.300 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 125/182 2023-07-13T13:45:38.333 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 125/182 2023-07-13T13:45:38.526 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4842.gf0b38 126/182 2023-07-13T13:45:38.567 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4842.gf0b38 126/182 2023-07-13T13:45:38.751 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 127/182 2023-07-13T13:45:39.095 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 127/182 2023-07-13T13:45:39.300 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 128/182 2023-07-13T13:45:39.510 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 128/182 2023-07-13T13:45:39.840 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 129/182 2023-07-13T13:45:40.717 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 130/182 2023-07-13T13:45:41.029 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 131/182 2023-07-13T13:45:41.214 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 132/182 2023-07-13T13:45:41.444 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 133/182 2023-07-13T13:45:41.621 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 134/182 2023-07-13T13:45:41.784 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:18.0.0-4842.gf0b380e6.el8.x86_ 135/182 2023-07-13T13:45:42.794 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 136/182 2023-07-13T13:45:43.025 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 136/182 2023-07-13T13:45:43.093 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 136/182 2023-07-13T13:45:43.304 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 137/182 2023-07-13T13:45:43.499 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:18.0.0-4842.gf0b380e6.el8.noarch 138/182 2023-07-13T13:45:43.669 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 139/182 2023-07-13T13:45:43.939 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 140/182 2023-07-13T13:45:44.189 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 141/182 2023-07-13T13:45:54.611 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 141/182 2023-07-13T13:46:42.556 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 142/182 2023-07-13T13:46:44.039 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-debuginfo-2:18.0.0-4842.gf0b380e6.el 143/182 2023-07-13T13:46:44.486 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 144/182 2023-07-13T13:46:50.614 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-4 145/182 2023-07-13T13:46:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 142/182 2023-07-13T13:46:54.123 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 146/182 2023-07-13T13:46:54.140 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-debuginfo-2:18.0.0-4842.gf0b380e6.el 143/182 2023-07-13T13:46:54.592 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 144/182 2023-07-13T13:47:00.706 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-4 145/182 2023-07-13T13:47:04.191 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 146/182 2023-07-13T13:47:08.595 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 147/182 2023-07-13T13:47:17.100 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 147/182 2023-07-13T13:47:45.836 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 148/182 2023-07-13T13:47:54.194 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 148/182 2023-07-13T13:48:15.511 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 149/182 2023-07-13T13:48:25.566 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 149/182 2023-07-13T13:49:51.779 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-4842.gf0b380e6.e 150/182 2023-07-13T13:49:53.220 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 151/182 2023-07-13T13:49:53.417 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-4842.gf0b380e6.el8 152/182 2023-07-13T13:50:01.087 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-debuginfo-2:18.0.0-4842.gf0b380e6 153/182 2023-07-13T13:50:01.735 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-4842.gf0b380e6.e 150/182 2023-07-13T13:50:03.107 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 151/182 2023-07-13T13:50:03.323 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-4842.gf0b380e6.el8 152/182 2023-07-13T13:50:10.561 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados2-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 154/182 2023-07-13T13:50:10.849 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librbd1-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x8 155/182 2023-07-13T13:50:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-debuginfo-2:18.0.0-4842.gf0b380e6 153/182 2023-07-13T13:50:12.690 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-4842.gf0b380e6 156/182 2023-07-13T13:50:14.986 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-debuginfo-2:18.0.0-4842.gf0b380e6. 157/182 2023-07-13T13:50:16.202 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-4842.gf0b380e6.el 158/182 2023-07-13T13:50:16.531 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-4842.gf0b380e6.el 159/182 2023-07-13T13:50:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados2-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 154/182 2023-07-13T13:50:20.963 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librbd1-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x8 155/182 2023-07-13T13:50:21.253 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-4842.gf0b380e6 156/182 2023-07-13T13:50:22.892 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-debuginfo-2:18.0.0-4842.gf0b380e6. 157/182 2023-07-13T13:50:24.879 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-4842.gf0b380e6.el 158/182 2023-07-13T13:50:25.250 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 160/182 2023-07-13T13:50:25.662 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-4842.gf0b380e6.el8 161/182 2023-07-13T13:50:25.933 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x8 162/182 2023-07-13T13:50:26.103 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 163/182 2023-07-13T13:50:26.119 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 163/182 2023-07-13T13:50:26.299 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 164/182 2023-07-13T13:50:26.442 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-4842.gf0b380e6.el 159/182 2023-07-13T13:50:28.611 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.1-9.el8.x86_64 165/182 2023-07-13T13:50:29.176 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 165/182 2023-07-13T13:50:30.003 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.0.4-10.el8.x86_64 166/182 2023-07-13T13:50:30.016 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 166/182 2023-07-13T13:50:30.238 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 167/182 2023-07-13T13:50:30.416 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 168/182 2023-07-13T13:50:30.565 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 169/182 2023-07-13T13:50:30.566 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 170/182 2023-07-13T13:50:30.805 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 170/182 2023-07-13T13:50:30.806 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 171/182 2023-07-13T13:50:31.096 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 171/182 2023-07-13T13:50:31.101 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 172/182 2023-07-13T13:50:31.214 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 172/182 2023-07-13T13:50:31.215 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 173/182 2023-07-13T13:50:31.442 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 173/182 2023-07-13T13:50:31.588 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 174/182 2023-07-13T13:50:31.780 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 175/182 2023-07-13T13:50:31.988 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 176/182 2023-07-13T13:50:31.988 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 177/182 2023-07-13T13:50:32.171 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 177/182 2023-07-13T13:50:32.172 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 178/182 2023-07-13T13:50:32.355 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 178/182 2023-07-13T13:50:32.355 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 179/182 2023-07-13T13:50:32.596 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 179/182 2023-07-13T13:50:32.597 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 180/182 2023-07-13T13:50:32.780 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 180/182 2023-07-13T13:50:32.780 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 181/182 2023-07-13T13:50:32.963 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 181/182 2023-07-13T13:50:33.128 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 182/182 2023-07-13T13:50:33.708 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 182/182 2023-07-13T13:50:33.708 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:18.0.0-4842.gf0b380e6.el8.x86_64 1/182 2023-07-13T13:50:33.708 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:18.0.0-4842.gf0b380e6.el8.x86_64 2/182 2023-07-13T13:50:33.708 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 3/182 2023-07-13T13:50:33.709 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 4/182 2023-07-13T13:50:33.709 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-4842.gf0b380e6.el 5/182 2023-07-13T13:50:33.709 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_6 6/182 2023-07-13T13:50:33.709 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 7/182 2023-07-13T13:50:33.709 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 8/182 2023-07-13T13:50:33.709 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4842.gf0b38 9/182 2023-07-13T13:50:33.709 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-4 10/182 2023-07-13T13:50:33.710 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:18.0.0-4842.gf0b380e6.el8.x86_64 11/182 2023-07-13T13:50:33.710 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 12/182 2023-07-13T13:50:33.710 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:18.0.0-4842.gf0b380e6.el8.x86_64 13/182 2023-07-13T13:50:33.710 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 14/182 2023-07-13T13:50:33.710 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:18.0.0-4842.gf0b380e6.el8.x86_64 15/182 2023-07-13T13:50:33.710 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 16/182 2023-07-13T13:50:33.710 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:18.0.0-4842.gf0b380e6.el8.x86_64 17/182 2023-07-13T13:50:33.711 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 18/182 2023-07-13T13:50:33.711 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 19/182 2023-07-13T13:50:33.711 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-4842.gf0b380e6.e 20/182 2023-07-13T13:50:33.711 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:18.0.0-4842.gf0b380e6.el8.x86_64 21/182 2023-07-13T13:50:33.711 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:18.0.0-4842.gf0b380e6.el8.x86_64 22/182 2023-07-13T13:50:33.711 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 23/182 2023-07-13T13:50:33.711 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 24/182 2023-07-13T13:50:33.711 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:18.0.0-4842.gf0b380e6.el8.x86_ 25/182 2023-07-13T13:50:33.712 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:18.0.0-4842.gf0b380e6.el8.x86_64 26/182 2023-07-13T13:50:33.712 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-4842.gf0b380e6.el8 27/182 2023-07-13T13:50:33.712 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:18.0.0-4842.gf0b380e6.el8.x86_64 28/182 2023-07-13T13:50:33.712 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:18.0.0-4842.gf0b380e6.el8.x86_6 29/182 2023-07-13T13:50:33.712 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-4842.gf0b380e6 30/182 2023-07-13T13:50:33.722 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 31/182 2023-07-13T13:50:33.722 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:18.0.0-4842.gf0b380e6.el8.x86 32/182 2023-07-13T13:50:33.722 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x8 33/182 2023-07-13T13:50:33.722 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:18.0.0-4842.gf0b380e6.el8.x86_64 34/182 2023-07-13T13:50:33.722 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4842.gf0b380e6.el 35/182 2023-07-13T13:50:33.722 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:18.0.0-4842.gf0b380e6.el8. 36/182 2023-07-13T13:50:33.723 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:18.0.0-4842.gf0b380e6.el8.x86_6 37/182 2023-07-13T13:50:33.723 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-4842.gf0b380e6 38/182 2023-07-13T13:50:33.723 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:18.0.0-4842.gf0b380e6.el8.x86_64 39/182 2023-07-13T13:50:33.723 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-4842.gf0b380e6. 40/182 2023-07-13T13:50:33.723 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 41/182 2023-07-13T13:50:33.723 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-4842.gf0b380e6.el 42/182 2023-07-13T13:50:33.723 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 43/182 2023-07-13T13:50:33.724 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-4842.gf0b380e6.el 44/182 2023-07-13T13:50:33.724 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 45/182 2023-07-13T13:50:33.724 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 46/182 2023-07-13T13:50:33.724 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 47/182 2023-07-13T13:50:33.724 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-4842.gf0b380e6.el8 48/182 2023-07-13T13:50:33.724 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 49/182 2023-07-13T13:50:33.724 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x8 50/182 2023-07-13T13:50:33.725 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4842.gf0b380e6. 51/182 2023-07-13T13:50:33.725 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4842.gf0b380e6.el8.noa 52/182 2023-07-13T13:50:33.725 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4842.gf0b380e6.el8.n 53/182 2023-07-13T13:50:33.725 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4842.gf0b 54/182 2023-07-13T13:50:33.725 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4842.gf0b380e6.el 55/182 2023-07-13T13:50:33.725 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4842.gf0b380e6.el8.noarch 56/182 2023-07-13T13:50:33.725 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4842.gf0b380e6.e 57/182 2023-07-13T13:50:33.725 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:18.0.0-4842.gf0b380e6.el8.noarch 58/182 2023-07-13T13:50:33.726 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 59/182 2023-07-13T13:50:33.726 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:18.0.0-4842.gf0b380e6.el8.noarch 60/182 2023-07-13T13:50:33.726 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.1-7.el8.noarch 61/182 2023-07-13T13:50:33.726 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.0.4-10.el8.x86_64 62/182 2023-07-13T13:50:33.726 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.1-9.el8.x86_64 63/182 2023-07-13T13:50:33.726 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.6-7.el8.x86_64 64/182 2023-07-13T13:50:33.726 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpq-13.5-1.el8.x86_64 65/182 2023-07-13T13:50:33.726 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 66/182 2023-07-13T13:50:33.727 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 67/182 2023-07-13T13:50:33.727 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 68/182 2023-07-13T13:50:33.727 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 69/182 2023-07-13T13:50:33.727 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 70/182 2023-07-13T13:50:33.727 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 71/182 2023-07-13T13:50:33.727 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 72/182 2023-07-13T13:50:33.727 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 73/182 2023-07-13T13:50:33.728 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 74/182 2023-07-13T13:50:33.728 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 75/182 2023-07-13T13:50:33.728 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 76/182 2023-07-13T13:50:33.728 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 77/182 2023-07-13T13:50:33.728 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 78/182 2023-07-13T13:50:33.728 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 79/182 2023-07-13T13:50:33.728 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 80/182 2023-07-13T13:50:33.728 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 81/182 2023-07-13T13:50:33.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 82/182 2023-07-13T13:50:33.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 83/182 2023-07-13T13:50:33.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 84/182 2023-07-13T13:50:33.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 85/182 2023-07-13T13:50:33.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 86/182 2023-07-13T13:50:33.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 87/182 2023-07-13T13:50:33.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 88/182 2023-07-13T13:50:33.729 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 89/182 2023-07-13T13:50:33.730 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 90/182 2023-07-13T13:50:33.730 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 91/182 2023-07-13T13:50:33.730 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 92/182 2023-07-13T13:50:33.730 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 93/182 2023-07-13T13:50:33.730 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 94/182 2023-07-13T13:50:33.730 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 95/182 2023-07-13T13:50:33.730 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 96/182 2023-07-13T13:50:33.731 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/182 2023-07-13T13:50:33.731 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 98/182 2023-07-13T13:50:33.731 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 99/182 2023-07-13T13:50:33.731 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 100/182 2023-07-13T13:50:33.731 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 101/182 2023-07-13T13:50:33.731 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 102/182 2023-07-13T13:50:33.731 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 103/182 2023-07-13T13:50:33.731 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 104/182 2023-07-13T13:50:33.732 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 105/182 2023-07-13T13:50:33.732 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 106/182 2023-07-13T13:50:33.732 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 107/182 2023-07-13T13:50:33.732 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 108/182 2023-07-13T13:50:33.732 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 109/182 2023-07-13T13:50:33.732 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 110/182 2023-07-13T13:50:33.732 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 111/182 2023-07-13T13:50:33.732 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 112/182 2023-07-13T13:50:33.733 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 113/182 2023-07-13T13:50:33.733 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/182 2023-07-13T13:50:33.733 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 115/182 2023-07-13T13:50:33.733 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 116/182 2023-07-13T13:50:33.733 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 117/182 2023-07-13T13:50:33.733 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 118/182 2023-07-13T13:50:33.733 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 119/182 2023-07-13T13:50:33.734 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 120/182 2023-07-13T13:50:33.734 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 121/182 2023-07-13T13:50:33.734 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 122/182 2023-07-13T13:50:33.734 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 123/182 2023-07-13T13:50:33.734 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 124/182 2023-07-13T13:50:33.734 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 125/182 2023-07-13T13:50:33.734 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 126/182 2023-07-13T13:50:33.734 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 127/182 2023-07-13T13:50:33.735 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 128/182 2023-07-13T13:50:33.735 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 129/182 2023-07-13T13:50:33.735 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 130/182 2023-07-13T13:50:33.735 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 131/182 2023-07-13T13:50:33.735 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 132/182 2023-07-13T13:50:33.735 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 133/182 2023-07-13T13:50:33.735 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 134/182 2023-07-13T13:50:33.735 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 135/182 2023-07-13T13:50:33.736 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 136/182 2023-07-13T13:50:33.736 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-2.6-1.el8.noarch 137/182 2023-07-13T13:50:33.736 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 138/182 2023-07-13T13:50:33.736 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 139/182 2023-07-13T13:50:33.736 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 140/182 2023-07-13T13:50:33.736 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 141/182 2023-07-13T13:50:33.736 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 142/182 2023-07-13T13:50:33.737 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 143/182 2023-07-13T13:50:33.737 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 144/182 2023-07-13T13:50:33.737 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 145/182 2023-07-13T13:50:33.737 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 146/182 2023-07-13T13:50:33.737 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 147/182 2023-07-13T13:50:33.737 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 148/182 2023-07-13T13:50:33.738 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 149/182 2023-07-13T13:50:33.738 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 150/182 2023-07-13T13:50:33.738 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:18.0.0-4842.gf0b380e6.el8.x86_64 151/182 2023-07-13T13:50:33.738 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 152/182 2023-07-13T13:50:33.738 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:18.0.0-4842.gf0b380e6.el8.x86_64 153/182 2023-07-13T13:50:33.738 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 154/182 2023-07-13T13:50:33.738 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 155/182 2023-07-13T13:50:33.739 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 156/182 2023-07-13T13:50:33.739 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 157/182 2023-07-13T13:50:33.739 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 158/182 2023-07-13T13:50:33.739 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 159/182 2023-07-13T13:50:33.739 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 160/182 2023-07-13T13:50:33.739 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 161/182 2023-07-13T13:50:33.739 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 162/182 2023-07-13T13:50:33.739 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 163/182 2023-07-13T13:50:33.740 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 164/182 2023-07-13T13:50:33.740 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 165/182 2023-07-13T13:50:33.740 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 166/182 2023-07-13T13:50:33.740 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 167/182 2023-07-13T13:50:33.740 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 168/182 2023-07-13T13:50:33.741 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 169/182 2023-07-13T13:50:33.741 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 170/182 2023-07-13T13:50:33.741 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 171/182 2023-07-13T13:50:33.741 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 172/182 2023-07-13T13:50:33.741 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 173/182 2023-07-13T13:50:33.741 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 174/182 2023-07-13T13:50:33.741 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 175/182 2023-07-13T13:50:33.741 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 176/182 2023-07-13T13:50:33.742 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 177/182 2023-07-13T13:50:33.742 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 178/182 2023-07-13T13:50:33.742 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 179/182 2023-07-13T13:50:33.742 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 180/182 2023-07-13T13:50:33.742 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 181/182 2023-07-13T13:50:35.073 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 160/182 2023-07-13T13:50:35.493 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-4842.gf0b380e6.el8 161/182 2023-07-13T13:50:35.697 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x8 162/182 2023-07-13T13:50:35.879 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 163/182 2023-07-13T13:50:35.895 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 163/182 2023-07-13T13:50:36.090 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 164/182 2023-07-13T13:50:36.362 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.1-9.el8.x86_64 165/182 2023-07-13T13:50:36.440 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 165/182 2023-07-13T13:50:36.665 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.0.4-10.el8.x86_64 166/182 2023-07-13T13:50:36.688 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 166/182 2023-07-13T13:50:38.289 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 167/182 2023-07-13T13:50:39.767 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 168/182 2023-07-13T13:50:39.949 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 169/182 2023-07-13T13:50:39.950 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 170/182 2023-07-13T13:50:40.240 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 170/182 2023-07-13T13:50:40.240 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 171/182 2023-07-13T13:50:40.439 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 171/182 2023-07-13T13:50:40.444 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 172/182 2023-07-13T13:50:40.557 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 172/182 2023-07-13T13:50:40.557 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 173/182 2023-07-13T13:50:40.633 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 182/182 2023-07-13T13:50:40.634 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:40.634 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2023-07-13T13:50:40.634 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-13T13:50:40.634 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-13T13:50:40.634 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-13T13:50:40.634 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-13T13:50:40.635 INFO:teuthology.orchestra.run.smithi118.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-13T13:50:40.635 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-13T13:50:40.635 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-13T13:50:40.635 INFO:teuthology.orchestra.run.smithi118.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-13T13:50:40.635 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.635 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.635 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-13T13:50:40.635 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-13T13:50:40.636 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-13T13:50:40.636 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-13T13:50:40.636 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-13T13:50:40.636 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-13T13:50:40.636 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2023-07-13T13:50:40.636 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.1-7.el8.noarch 2023-07-13T13:50:40.636 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.0.4-10.el8.x86_64 2023-07-13T13:50:40.637 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.637 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.637 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.637 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.637 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.637 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.637 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.637 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.638 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.638 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.638 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.638 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.638 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.638 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.638 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.639 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.639 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.639 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.639 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.639 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.639 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.639 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.639 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.640 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.640 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.640 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.640 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.640 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.640 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.640 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.641 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.641 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.641 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.641 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:40.641 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-13T13:50:40.641 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.1-9.el8.x86_64 2023-07-13T13:50:40.641 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-13T13:50:40.642 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-13T13:50:40.642 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.6-7.el8.x86_64 2023-07-13T13:50:40.642 INFO:teuthology.orchestra.run.smithi118.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-13T13:50:40.642 INFO:teuthology.orchestra.run.smithi118.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-13T13:50:40.642 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-13T13:50:40.642 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.642 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.642 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.643 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.643 INFO:teuthology.orchestra.run.smithi118.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-13T13:50:40.643 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-13T13:50:40.643 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-13T13:50:40.643 INFO:teuthology.orchestra.run.smithi118.stdout: libpq-13.5-1.el8.x86_64 2023-07-13T13:50:40.643 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-13T13:50:40.643 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-13T13:50:40.644 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.644 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.644 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.644 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.644 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.644 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-13T13:50:40.644 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.644 INFO:teuthology.orchestra.run.smithi118.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-13T13:50:40.645 INFO:teuthology.orchestra.run.smithi118.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-13T13:50:40.645 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-13T13:50:40.645 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-13T13:50:40.645 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-13T13:50:40.645 INFO:teuthology.orchestra.run.smithi118.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-13T13:50:40.645 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-13T13:50:40.645 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-13T13:50:40.645 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-13T13:50:40.646 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-13T13:50:40.646 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-13T13:50:40.646 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-13T13:50:40.646 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-13T13:50:40.646 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-13T13:50:40.646 INFO:teuthology.orchestra.run.smithi118.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-13T13:50:40.646 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-13T13:50:40.646 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-13T13:50:40.647 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-13T13:50:40.647 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-13T13:50:40.647 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-13T13:50:40.647 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-13T13:50:40.647 INFO:teuthology.orchestra.run.smithi118.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-13T13:50:40.647 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-13T13:50:40.647 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.648 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.648 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.648 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.648 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-13T13:50:40.648 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-13T13:50:40.648 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-13T13:50:40.648 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-13T13:50:40.648 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-13T13:50:40.649 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-13T13:50:40.649 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-13T13:50:40.649 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-13T13:50:40.649 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-13T13:50:40.649 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-13T13:50:40.649 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-13T13:50:40.649 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-13T13:50:40.649 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-13T13:50:40.650 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-13T13:50:40.650 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-13T13:50:40.650 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-13T13:50:40.650 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-13T13:50:40.650 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-13T13:50:40.650 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-13T13:50:40.650 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-13T13:50:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-13T13:50:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-13T13:50:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-2.6-1.el8.noarch 2023-07-13T13:50:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-13T13:50:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-13T13:50:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-13T13:50:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-13T13:50:40.651 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-13T13:50:40.652 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-13T13:50:40.652 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.652 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.652 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.652 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.652 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-13T13:50:40.652 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-13T13:50:40.652 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.653 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.653 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-13T13:50:40.653 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-13T13:50:40.653 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-13T13:50:40.653 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-13T13:50:40.653 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-13T13:50:40.653 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-13T13:50:40.654 INFO:teuthology.orchestra.run.smithi118.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-13T13:50:40.654 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-13T13:50:40.654 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-13T13:50:40.654 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-13T13:50:40.654 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-13T13:50:40.654 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-13T13:50:40.654 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-13T13:50:40.655 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.655 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.655 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.655 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.655 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.655 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:40.656 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-13T13:50:40.656 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-13T13:50:40.656 INFO:teuthology.orchestra.run.smithi118.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-13T13:50:40.656 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-13T13:50:40.656 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-13T13:50:40.657 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-13T13:50:40.657 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:40.657 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2023-07-13T13:50:40.785 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 173/182 2023-07-13T13:50:40.990 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 174/182 2023-07-13T13:50:41.164 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 175/182 2023-07-13T13:50:41.208 DEBUG:teuthology.parallel:result is None 2023-07-13T13:50:41.405 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 176/182 2023-07-13T13:50:41.406 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 177/182 2023-07-13T13:50:41.631 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 177/182 2023-07-13T13:50:41.631 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 178/182 2023-07-13T13:50:41.839 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 178/182 2023-07-13T13:50:41.839 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 179/182 2023-07-13T13:50:42.072 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 179/182 2023-07-13T13:50:42.073 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 180/182 2023-07-13T13:50:42.256 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 180/182 2023-07-13T13:50:42.256 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 181/182 2023-07-13T13:50:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 181/182 2023-07-13T13:50:42.613 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 182/182 2023-07-13T13:50:43.195 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 182/182 2023-07-13T13:50:43.195 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:18.0.0-4842.gf0b380e6.el8.x86_64 1/182 2023-07-13T13:50:43.196 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:18.0.0-4842.gf0b380e6.el8.x86_64 2/182 2023-07-13T13:50:43.196 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 3/182 2023-07-13T13:50:43.196 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 4/182 2023-07-13T13:50:43.196 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-4842.gf0b380e6.el 5/182 2023-07-13T13:50:43.196 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_6 6/182 2023-07-13T13:50:43.196 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 7/182 2023-07-13T13:50:43.197 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 8/182 2023-07-13T13:50:43.197 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4842.gf0b38 9/182 2023-07-13T13:50:43.197 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-4 10/182 2023-07-13T13:50:43.197 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:18.0.0-4842.gf0b380e6.el8.x86_64 11/182 2023-07-13T13:50:43.197 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 12/182 2023-07-13T13:50:43.197 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:18.0.0-4842.gf0b380e6.el8.x86_64 13/182 2023-07-13T13:50:43.197 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 14/182 2023-07-13T13:50:43.198 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:18.0.0-4842.gf0b380e6.el8.x86_64 15/182 2023-07-13T13:50:43.198 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 16/182 2023-07-13T13:50:43.198 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:18.0.0-4842.gf0b380e6.el8.x86_64 17/182 2023-07-13T13:50:43.198 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 18/182 2023-07-13T13:50:43.198 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 19/182 2023-07-13T13:50:43.198 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-4842.gf0b380e6.e 20/182 2023-07-13T13:50:43.198 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:18.0.0-4842.gf0b380e6.el8.x86_64 21/182 2023-07-13T13:50:43.199 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:18.0.0-4842.gf0b380e6.el8.x86_64 22/182 2023-07-13T13:50:43.199 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 23/182 2023-07-13T13:50:43.199 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 24/182 2023-07-13T13:50:43.199 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:18.0.0-4842.gf0b380e6.el8.x86_ 25/182 2023-07-13T13:50:43.199 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:18.0.0-4842.gf0b380e6.el8.x86_64 26/182 2023-07-13T13:50:43.199 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-4842.gf0b380e6.el8 27/182 2023-07-13T13:50:43.200 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:18.0.0-4842.gf0b380e6.el8.x86_64 28/182 2023-07-13T13:50:43.200 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:18.0.0-4842.gf0b380e6.el8.x86_6 29/182 2023-07-13T13:50:43.200 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-4842.gf0b380e6 30/182 2023-07-13T13:50:43.210 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-debuginfo-2:18.0.0-4842.gf0b380e6.el8. 31/182 2023-07-13T13:50:43.210 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:18.0.0-4842.gf0b380e6.el8.x86 32/182 2023-07-13T13:50:43.210 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x8 33/182 2023-07-13T13:50:43.210 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:18.0.0-4842.gf0b380e6.el8.x86_64 34/182 2023-07-13T13:50:43.210 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4842.gf0b380e6.el 35/182 2023-07-13T13:50:43.210 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:18.0.0-4842.gf0b380e6.el8. 36/182 2023-07-13T13:50:43.211 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:18.0.0-4842.gf0b380e6.el8.x86_6 37/182 2023-07-13T13:50:43.211 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-4842.gf0b380e6 38/182 2023-07-13T13:50:43.211 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:18.0.0-4842.gf0b380e6.el8.x86_64 39/182 2023-07-13T13:50:43.211 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-4842.gf0b380e6. 40/182 2023-07-13T13:50:43.211 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 41/182 2023-07-13T13:50:43.211 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-4842.gf0b380e6.el 42/182 2023-07-13T13:50:43.211 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 43/182 2023-07-13T13:50:43.212 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-4842.gf0b380e6.el 44/182 2023-07-13T13:50:43.212 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 45/182 2023-07-13T13:50:43.212 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x 46/182 2023-07-13T13:50:43.212 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 47/182 2023-07-13T13:50:43.212 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-4842.gf0b380e6.el8 48/182 2023-07-13T13:50:43.212 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 49/182 2023-07-13T13:50:43.213 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x8 50/182 2023-07-13T13:50:43.213 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4842.gf0b380e6. 51/182 2023-07-13T13:50:43.213 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4842.gf0b380e6.el8.noa 52/182 2023-07-13T13:50:43.213 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4842.gf0b380e6.el8.n 53/182 2023-07-13T13:50:43.213 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4842.gf0b 54/182 2023-07-13T13:50:43.213 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4842.gf0b380e6.el 55/182 2023-07-13T13:50:43.214 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4842.gf0b380e6.el8.noarch 56/182 2023-07-13T13:50:43.214 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4842.gf0b380e6.e 57/182 2023-07-13T13:50:43.214 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:18.0.0-4842.gf0b380e6.el8.noarch 58/182 2023-07-13T13:50:43.214 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 59/182 2023-07-13T13:50:43.214 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:18.0.0-4842.gf0b380e6.el8.noarch 60/182 2023-07-13T13:50:43.214 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.1-7.el8.noarch 61/182 2023-07-13T13:50:43.214 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.0.4-10.el8.x86_64 62/182 2023-07-13T13:50:43.214 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.1-9.el8.x86_64 63/182 2023-07-13T13:50:43.215 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : jq-1.6-7.el8.x86_64 64/182 2023-07-13T13:50:43.215 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpq-13.5-1.el8.x86_64 65/182 2023-07-13T13:50:43.215 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 66/182 2023-07-13T13:50:43.215 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 67/182 2023-07-13T13:50:43.215 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 68/182 2023-07-13T13:50:43.215 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 69/182 2023-07-13T13:50:43.215 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 70/182 2023-07-13T13:50:43.215 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 71/182 2023-07-13T13:50:43.216 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 72/182 2023-07-13T13:50:43.216 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 73/182 2023-07-13T13:50:43.216 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 74/182 2023-07-13T13:50:43.216 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 75/182 2023-07-13T13:50:43.216 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 76/182 2023-07-13T13:50:43.216 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 77/182 2023-07-13T13:50:43.216 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 78/182 2023-07-13T13:50:43.217 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 79/182 2023-07-13T13:50:43.217 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 80/182 2023-07-13T13:50:43.217 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 81/182 2023-07-13T13:50:43.217 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 82/182 2023-07-13T13:50:43.217 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 83/182 2023-07-13T13:50:43.217 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 84/182 2023-07-13T13:50:43.217 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 85/182 2023-07-13T13:50:43.217 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 86/182 2023-07-13T13:50:43.218 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 87/182 2023-07-13T13:50:43.218 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 88/182 2023-07-13T13:50:43.218 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 89/182 2023-07-13T13:50:43.218 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 90/182 2023-07-13T13:50:43.218 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 91/182 2023-07-13T13:50:43.218 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 92/182 2023-07-13T13:50:43.218 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 93/182 2023-07-13T13:50:43.219 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 94/182 2023-07-13T13:50:43.219 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 95/182 2023-07-13T13:50:43.219 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 96/182 2023-07-13T13:50:43.219 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/182 2023-07-13T13:50:43.220 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 98/182 2023-07-13T13:50:43.220 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 99/182 2023-07-13T13:50:43.220 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 100/182 2023-07-13T13:50:43.221 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 101/182 2023-07-13T13:50:43.221 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 102/182 2023-07-13T13:50:43.221 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 103/182 2023-07-13T13:50:43.221 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 104/182 2023-07-13T13:50:43.222 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 105/182 2023-07-13T13:50:43.222 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 106/182 2023-07-13T13:50:43.222 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 107/182 2023-07-13T13:50:43.222 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 108/182 2023-07-13T13:50:43.223 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 109/182 2023-07-13T13:50:43.223 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 110/182 2023-07-13T13:50:43.223 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 111/182 2023-07-13T13:50:43.223 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 112/182 2023-07-13T13:50:43.224 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 113/182 2023-07-13T13:50:43.224 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/182 2023-07-13T13:50:43.224 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 115/182 2023-07-13T13:50:43.224 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 116/182 2023-07-13T13:50:43.225 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 117/182 2023-07-13T13:50:43.225 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 118/182 2023-07-13T13:50:43.225 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 119/182 2023-07-13T13:50:43.225 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 120/182 2023-07-13T13:50:43.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 121/182 2023-07-13T13:50:43.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 122/182 2023-07-13T13:50:43.226 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 123/182 2023-07-13T13:50:43.227 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 124/182 2023-07-13T13:50:43.227 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 125/182 2023-07-13T13:50:43.227 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 126/182 2023-07-13T13:50:43.228 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 127/182 2023-07-13T13:50:43.228 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 128/182 2023-07-13T13:50:43.228 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 129/182 2023-07-13T13:50:43.228 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 130/182 2023-07-13T13:50:43.229 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 131/182 2023-07-13T13:50:43.229 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 132/182 2023-07-13T13:50:43.229 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 133/182 2023-07-13T13:50:43.230 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 134/182 2023-07-13T13:50:43.230 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 135/182 2023-07-13T13:50:43.230 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 136/182 2023-07-13T13:50:43.230 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-2.6-1.el8.noarch 137/182 2023-07-13T13:50:43.231 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 138/182 2023-07-13T13:50:43.231 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 139/182 2023-07-13T13:50:43.231 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 140/182 2023-07-13T13:50:43.231 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 141/182 2023-07-13T13:50:43.231 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 142/182 2023-07-13T13:50:43.232 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 143/182 2023-07-13T13:50:43.232 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 144/182 2023-07-13T13:50:43.232 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 145/182 2023-07-13T13:50:43.233 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 146/182 2023-07-13T13:50:43.233 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 147/182 2023-07-13T13:50:43.233 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 148/182 2023-07-13T13:50:43.233 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 149/182 2023-07-13T13:50:43.233 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 150/182 2023-07-13T13:50:43.234 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:18.0.0-4842.gf0b380e6.el8.x86_64 151/182 2023-07-13T13:50:43.234 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 152/182 2023-07-13T13:50:43.234 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:18.0.0-4842.gf0b380e6.el8.x86_64 153/182 2023-07-13T13:50:43.234 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 154/182 2023-07-13T13:50:43.234 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 155/182 2023-07-13T13:50:43.234 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 156/182 2023-07-13T13:50:43.234 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 157/182 2023-07-13T13:50:43.234 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 158/182 2023-07-13T13:50:43.235 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 159/182 2023-07-13T13:50:43.235 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 160/182 2023-07-13T13:50:43.235 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 161/182 2023-07-13T13:50:43.235 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 162/182 2023-07-13T13:50:43.235 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 163/182 2023-07-13T13:50:43.235 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 164/182 2023-07-13T13:50:43.235 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 165/182 2023-07-13T13:50:43.236 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 166/182 2023-07-13T13:50:43.236 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 167/182 2023-07-13T13:50:43.236 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 168/182 2023-07-13T13:50:43.236 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 169/182 2023-07-13T13:50:43.236 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 170/182 2023-07-13T13:50:43.236 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 171/182 2023-07-13T13:50:43.236 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 172/182 2023-07-13T13:50:43.237 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 173/182 2023-07-13T13:50:43.237 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 174/182 2023-07-13T13:50:43.237 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 175/182 2023-07-13T13:50:43.237 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 176/182 2023-07-13T13:50:43.237 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 177/182 2023-07-13T13:50:43.237 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 178/182 2023-07-13T13:50:43.237 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 179/182 2023-07-13T13:50:43.237 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 180/182 2023-07-13T13:50:43.238 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 181/182 2023-07-13T13:50:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 182/182 2023-07-13T13:50:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:45.952 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2023-07-13T13:50:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-13T13:50:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-13T13:50:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-13T13:50:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-13T13:50:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-13T13:50:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-13T13:50:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-13T13:50:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-13T13:50:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-13T13:50:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-13T13:50:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-13T13:50:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-13T13:50:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-13T13:50:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-13T13:50:45.955 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-07-13T13:50:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.1-7.el8.noarch 2023-07-13T13:50:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.0.4-10.el8.x86_64 2023-07-13T13:50:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:18.0.0-4842.gf0b380e6.el8.noarch 2023-07-13T13:50:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-13T13:50:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.1-9.el8.x86_64 2023-07-13T13:50:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-13T13:50:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-13T13:50:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: jq-1.6-7.el8.x86_64 2023-07-13T13:50:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-13T13:50:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-13T13:50:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-13T13:50:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-13T13:50:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-13T13:50:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-13T13:50:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: libpq-13.5-1.el8.x86_64 2023-07-13T13:50:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-13T13:50:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-13T13:50:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-13T13:50:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-13T13:50:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-13T13:50:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-13T13:50:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-13T13:50:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-13T13:50:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-13T13:50:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-13T13:50:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-13T13:50:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-13T13:50:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-13T13:50:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-13T13:50:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-13T13:50:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-13T13:50:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-13T13:50:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-13T13:50:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-13T13:50:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-13T13:50:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-13T13:50:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-13T13:50:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-13T13:50:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-13T13:50:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-13T13:50:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-13T13:50:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-13T13:50:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-13T13:50:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-13T13:50:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-13T13:50:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-13T13:50:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-13T13:50:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-13T13:50:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-13T13:50:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-13T13:50:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-13T13:50:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-13T13:50:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-13T13:50:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-13T13:50:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-13T13:50:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-13T13:50:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-13T13:50:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-13T13:50:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-13T13:50:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-13T13:50:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-13T13:50:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-13T13:50:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-13T13:50:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-2.6-1.el8.noarch 2023-07-13T13:50:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-13T13:50:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-13T13:50:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-13T13:50:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-13T13:50:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-13T13:50:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-13T13:50:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-13T13:50:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-13T13:50:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-13T13:50:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-13T13:50:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-13T13:50:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-13T13:50:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-13T13:50:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-13T13:50:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-13T13:50:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-13T13:50:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-13T13:50:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-13T13:50:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-13T13:50:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-13T13:50:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-13T13:50:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-debuginfo-2:18.0.0-4842.gf0b380e6.el8.x86_64 2023-07-13T13:50:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-13T13:50:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-13T13:50:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-13T13:50:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-13T13:50:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-13T13:50:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-13T13:50:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:45.976 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-07-13T13:50:48.494 DEBUG:teuthology.parallel:result is None 2023-07-13T13:50:48.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f0b380e693e28c35a89e7c2062b0976b7def7973 2023-07-13T13:50:48.899 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-13T13:50:48.929 INFO:teuthology.orchestra.run.smithi118.stdout:18.0.0-4842.gf0b380e6.el8 2023-07-13T13:50:48.929 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4842.gf0b380e6.el8 2023-07-13T13:50:48.930 INFO:teuthology.task.install:The correct ceph version 18.0.0-4842.gf0b380e6 is installed. 2023-07-13T13:50:48.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f0b380e693e28c35a89e7c2062b0976b7def7973 2023-07-13T13:50:49.203 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-13T13:50:49.232 INFO:teuthology.orchestra.run.smithi123.stdout:18.0.0-4842.gf0b380e6.el8 2023-07-13T13:50:49.232 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4842.gf0b380e6.el8 2023-07-13T13:50:49.233 INFO:teuthology.task.install:The correct ceph version 18.0.0-4842.gf0b380e6 is installed. 2023-07-13T13:50:49.233 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-13T13:50:49.234 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:49.234 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-13T13:50:49.271 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:50:49.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-13T13:50:49.310 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-13T13:50:49.311 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:49.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-07-13T13:50:49.345 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-13T13:50:49.418 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:50:49.419 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2023-07-13T13:50:49.453 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-13T13:50:49.526 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-13T13:50:49.527 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:49.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-13T13:50:49.560 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-13T13:50:49.633 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:50:49.634 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-13T13:50:49.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-13T13:50:49.740 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-13T13:50:49.741 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:49.742 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-07-13T13:50:49.775 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-13T13:50:49.848 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:50:49.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2023-07-13T13:50:49.883 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-13T13:50:49.957 INFO:teuthology.run_tasks:Running task ceph... 2023-07-13T13:50:50.040 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-13T13:50:50.041 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2023-07-13T13:50:50.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2023-07-13T13:50:50.076 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-13T13:50:50.077 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-13T13:50:50.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-13T13:50:50.150 INFO:tasks.ceph:Creating extra log directories... 2023-07-13T13:50:50.151 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-13T13:50:50.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-13T13:50:50.230 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-13T13:50:50.231 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-13T13:50:50.231 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-13T13:50:50.231 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:50.232 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-13T13:50:50.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-13T13:50:50.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-13T13:50:50.424 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:50:50.425 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-13T13:50:50.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-13T13:50:50.571 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-13T13:50:50.605 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-13T13:50:50.606 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-13T13:50:50.606 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090', 'branch': 'main', 'description': 'fs:verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7336090', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'f0b380e693e28c35a89e7c2062b0976b7def7973', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'f0b380e693e28c35a89e7c2062b0976b7def7973'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '68df405e530cc8317c62abf2bfc4458a41023b59'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': 'f0b380e693e28c35a89e7c2062b0976b7def7973', 'sleep_before_teardown': 0, 'suite': 'fs:verify', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_68df405e530cc8317c62abf2bfc4458a41023b59/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '68df405e530cc8317c62abf2bfc4458a41023b59', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi118.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3Mna00yLVPHncl6oc7Y9Amf4aFlw2hLXHndF4YDriNgrX6lPR/c8ETczOKv7PcBKwOFgfZT123gd9GT2XHLJI5nFNMrPu6dkn+bvH2wz62D5SfL9yNu8hgDqjCAl7N5+TXa7uWUIi2WPq8wk27GQlqdg+I3vRlbvDTsThblukUualPREj0j/vXnBZ4YxDF8kS+R9o5mFwKWGrmOmupZf24YNGuKJ1L3L4d+WsDXnHGzyuR7twuD9o4AWQrSbhsfKNEk+gBCEda6gGMg6RHUrYCtKa8mHjK3VjS1p0rgnUJtnMoH2bjVb5QAiVIgayDMk9siq+CBcsctLnBEgxlC1JE5/BFNoln5MEsboigc5eSreCL8RfcnqvDWpes6OK2btpt7NN58Qtc9GICw1l1ZqpnjRHxGCoOrtieN8IyNUUA6QY5q/sQ2lnWaktE9rofCLkJ+5HlRnwuX9/+7/v+X5/idkDUi8bwj0JSU5kiHZ1nSFQprPI4YDNZOYmQRCcehs=', 'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHchmyXf71FoMjzc4gel+uknrOySkqwMGM2j7V6w3y5U1XIXal9UUqr+ZvMNTemEG+60j7l3jBN1EfuGxTjiNZA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'f0b380e693e28c35a89e7c2062b0976b7def7973'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '073e6eb1231451146b4a01d0b85b4f490f71d266', 'timestamp': '2023-07-13_12:11:45', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-13T13:50:50.607 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-13T13:50:50.609 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-13T13:50:50.659 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2023-07-13T13:50:50.671 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2023-07-13T13:50:50.728 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:50.729 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-07-13T13:50:50.763 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-13T13:50:50.764 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-07-13T13:50:50.825 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-13T13:50:50.825 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T13:50:50.825 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 411020 Links: 1 2023-07-13T13:50:50.826 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:50:50.826 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-07-13T13:50:50.826 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-07-13 13:50:33.377890154 +0000 2023-07-13T13:50:50.826 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-07-13 12:48:40.388315999 +0000 2023-07-13T13:50:50.826 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-07-13 12:48:40.388315999 +0000 2023-07-13T13:50:50.827 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-07-13T13:50:50.827 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-13T13:50:50.893 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-07-13T13:50:50.894 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-07-13T13:50:50.894 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 9.556e-05 s, 5.4 MB/s 2023-07-13T13:50:50.895 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-13T13:50:50.957 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-07-13T13:50:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-13T13:50:51.019 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T13:50:51.020 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 406416 Links: 1 2023-07-13T13:50:51.020 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:50:51.021 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-07-13T13:50:51.021 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-07-13 13:50:33.377890154 +0000 2023-07-13T13:50:51.021 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-07-13 12:48:40.946303396 +0000 2023-07-13T13:50:51.021 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-07-13 12:48:40.946303396 +0000 2023-07-13T13:50:51.022 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-07-13T13:50:51.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-13T13:50:51.089 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-07-13T13:50:51.089 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-07-13T13:50:51.090 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 9.2477e-05 s, 5.5 MB/s 2023-07-13T13:50:51.091 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-13T13:50:51.151 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-07-13T13:50:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-13T13:50:51.212 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T13:50:51.212 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 409996 Links: 1 2023-07-13T13:50:51.212 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:50:51.212 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-07-13T13:50:51.213 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-07-13 13:50:33.377890154 +0000 2023-07-13T13:50:51.213 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-07-13 12:48:41.487291178 +0000 2023-07-13T13:50:51.213 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-07-13 12:48:41.487291178 +0000 2023-07-13T13:50:51.213 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-07-13T13:50:51.213 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-13T13:50:51.280 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-07-13T13:50:51.281 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-07-13T13:50:51.281 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 9.011e-05 s, 5.7 MB/s 2023-07-13T13:50:51.282 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-13T13:50:51.342 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-07-13T13:50:51.402 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-13T13:50:51.403 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T13:50:51.403 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 411999 Links: 1 2023-07-13T13:50:51.403 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:50:51.403 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2023-07-13T13:50:51.404 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-07-13 13:50:33.377890154 +0000 2023-07-13T13:50:51.404 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-07-13 12:48:41.987279885 +0000 2023-07-13T13:50:51.404 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-07-13 12:48:41.987279885 +0000 2023-07-13T13:50:51.405 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-07-13T13:50:51.405 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-13T13:50:51.470 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-07-13T13:50:51.471 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-07-13T13:50:51.471 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000109604 s, 4.7 MB/s 2023-07-13T13:50:51.472 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-13T13:50:51.533 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-13T13:50:51.533 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:50:51.533 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2023-07-13T13:50:51.555 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-13T13:50:51.556 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2023-07-13T13:50:51.617 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-13T13:50:51.617 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T13:50:51.618 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 410829 Links: 1 2023-07-13T13:50:51.618 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:50:51.618 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-07-13T13:50:51.618 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-07-13 13:50:42.845768231 +0000 2023-07-13T13:50:51.618 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-07-13 12:48:36.913917214 +0000 2023-07-13T13:50:51.619 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-07-13 12:48:36.913917214 +0000 2023-07-13T13:50:51.619 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-07-13T13:50:51.619 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-13T13:50:51.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-07-13T13:50:51.690 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-07-13T13:50:51.690 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000227845 s, 2.2 MB/s 2023-07-13T13:50:51.691 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-13T13:50:51.755 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2023-07-13T13:50:51.817 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-13T13:50:51.818 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T13:50:51.818 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 402285 Links: 1 2023-07-13T13:50:51.818 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:50:51.818 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-07-13T13:50:51.818 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-07-13 13:50:42.845768231 +0000 2023-07-13T13:50:51.818 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-07-13 12:48:37.477903178 +0000 2023-07-13T13:50:51.819 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-07-13 12:48:37.477903178 +0000 2023-07-13T13:50:51.819 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-07-13T13:50:51.819 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-13T13:50:51.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-07-13T13:50:51.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-07-13T13:50:51.890 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000257549 s, 2.0 MB/s 2023-07-13T13:50:51.891 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-13T13:50:51.954 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2023-07-13T13:50:52.016 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-13T13:50:52.036 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T13:50:52.037 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 414908 Links: 1 2023-07-13T13:50:52.037 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:50:52.037 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-07-13T13:50:52.037 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-07-13 13:50:42.845768231 +0000 2023-07-13T13:50:52.037 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-07-13 12:48:38.006890013 +0000 2023-07-13T13:50:52.037 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-07-13 12:48:38.006890013 +0000 2023-07-13T13:50:52.038 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-07-13T13:50:52.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-13T13:50:52.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-07-13T13:50:52.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-07-13T13:50:52.090 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000214334 s, 2.4 MB/s 2023-07-13T13:50:52.090 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-13T13:50:52.154 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2023-07-13T13:50:52.215 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-13T13:50:52.216 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T13:50:52.216 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 413855 Links: 1 2023-07-13T13:50:52.216 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:50:52.216 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-07-13T13:50:52.216 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-07-13 13:50:42.845768231 +0000 2023-07-13T13:50:52.216 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-07-13 12:48:38.562876176 +0000 2023-07-13T13:50:52.217 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-07-13 12:48:38.562876176 +0000 2023-07-13T13:50:52.217 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-07-13T13:50:52.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-13T13:50:52.287 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-07-13T13:50:52.287 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-07-13T13:50:52.287 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000251013 s, 2.0 MB/s 2023-07-13T13:50:52.288 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-13T13:50:52.351 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-13T13:50:52.352 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-13T13:50:52.352 INFO:tasks.ceph:Generating config... 2023-07-13T13:50:52.353 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-13T13:50:52.353 INFO:tasks.ceph:[client] debug client = 20 2023-07-13T13:50:52.354 INFO:tasks.ceph:[client] debug ms = 1 2023-07-13T13:50:52.354 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-13T13:50:52.354 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-13T13:50:52.354 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-07-13T13:50:52.354 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-07-13T13:50:52.355 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-07-13T13:50:52.355 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-13T13:50:52.355 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-13T13:50:52.355 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-13T13:50:52.355 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-13T13:50:52.356 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-13T13:50:52.356 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-13T13:50:52.356 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-07-13T13:50:52.356 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-13T13:50:52.356 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-13T13:50:52.357 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-13T13:50:52.357 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-13T13:50:52.357 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-13T13:50:52.357 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-13T13:50:52.357 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-13T13:50:52.358 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-13T13:50:52.358 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-13T13:50:52.358 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-13T13:50:52.358 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-07-13T13:50:52.358 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-13T13:50:52.359 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-07-13T13:50:52.359 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-13T13:50:52.359 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-13T13:50:52.359 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-13T13:50:52.359 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-13T13:50:52.360 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-13T13:50:52.360 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-13T13:50:52.360 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-13T13:50:52.360 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-13T13:50:52.360 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-13T13:50:52.361 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-13T13:50:52.361 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-07-13T13:50:52.361 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-13T13:50:52.361 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-13T13:50:52.361 INFO:tasks.ceph:Setting up mon.a... 2023-07-13T13:50:52.362 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-13T13:50:52.545 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.keyring 2023-07-13T13:50:52.549 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-13T13:50:52.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-13T13:50:52.682 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.118'), ('mon.b', '172.21.15.123'), ('mon.c', '[v2:172.21.15.123:3301,v1:172.21.15.123:6790]')] 2023-07-13T13:50:52.682 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.118,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-13T13:50:52.683 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:52.684 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-13T13:50:52.702 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.118 --add b 172.21.15.123 --addv c '[v2:172.21.15.123:3301,v1:172.21.15.123:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:50:52.794 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:50:52.795 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: generated fsid 1835fe1d-409c-4aad-9a14-d592cbe8c9c2 2023-07-13T13:50:52.795 INFO:teuthology.orchestra.run.smithi118.stdout:setting min_mon_release = pacific 2023-07-13T13:50:52.795 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 0 2023-07-13T13:50:52.795 INFO:teuthology.orchestra.run.smithi118.stdout:fsid 1835fe1d-409c-4aad-9a14-d592cbe8c9c2 2023-07-13T13:50:52.795 INFO:teuthology.orchestra.run.smithi118.stdout:last_changed 2023-07-13T13:50:52.821444+0000 2023-07-13T13:50:52.795 INFO:teuthology.orchestra.run.smithi118.stdout:created 2023-07-13T13:50:52.821444+0000 2023-07-13T13:50:52.796 INFO:teuthology.orchestra.run.smithi118.stdout:min_mon_release 16 (pacific) 2023-07-13T13:50:52.796 INFO:teuthology.orchestra.run.smithi118.stdout:election_strategy: 1 2023-07-13T13:50:52.796 INFO:teuthology.orchestra.run.smithi118.stdout:0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.a 2023-07-13T13:50:52.796 INFO:teuthology.orchestra.run.smithi118.stdout:1: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2023-07-13T13:50:52.796 INFO:teuthology.orchestra.run.smithi118.stdout:2: [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] mon.c 2023-07-13T13:50:52.796 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-13T13:50:52.797 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-13T13:50:52.815 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1835fe1d-409c-4aad-9a14-d592cbe8c9c2... 2023-07-13T13:50:52.816 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-13T13:50:52.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-13T13:50:52.898 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-07-13T13:50:52.898 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-07-13T13:50:52.898 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-13T13:50:52.899 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-07-13T13:50:52.899 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.899 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-07-13T13:50:52.899 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.899 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-07-13T13:50:52.899 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.900 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-07-13T13:50:52.900 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-07-13T13:50:52.900 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.900 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-07-13T13:50:52.900 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-07-13T13:50:52.900 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.901 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-13T13:50:52.901 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-07-13T13:50:52.901 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.901 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-07-13T13:50:52.901 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-13T13:50:52.901 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.901 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-07-13T13:50:52.902 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.902 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-07-13T13:50:52.902 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-07-13T13:50:52.902 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-07-13T13:50:52.902 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-07-13T13:50:52.903 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-07-13T13:50:52.903 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-07-13T13:50:52.903 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-07-13T13:50:52.903 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-13T13:50:52.903 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-13T13:50:52.904 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-07-13T13:50:52.904 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.904 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-13T13:50:52.904 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.905 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-07-13T13:50:52.905 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.905 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-07-13T13:50:52.905 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.905 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-07-13T13:50:52.905 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-07-13T13:50:52.905 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-07-13T13:50:52.906 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.118,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-07-13T13:50:52.906 INFO:teuthology.orchestra.run.smithi118.stdout: mds beacon grace = 60 2023-07-13T13:50:52.906 INFO:teuthology.orchestra.run.smithi118.stdout: mds heartbeat grace = 60 2023-07-13T13:50:52.906 INFO:teuthology.orchestra.run.smithi118.stdout: osd heartbeat grace = 60 2023-07-13T13:50:52.906 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 1835fe1d-409c-4aad-9a14-d592cbe8c9c2 2023-07-13T13:50:52.906 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.906 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-07-13T13:50:52.907 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-07-13T13:50:52.907 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.907 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-07-13T13:50:52.907 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-07-13T13:50:52.907 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.907 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-07-13T13:50:52.907 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-07-13T13:50:52.907 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.908 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-07-13T13:50:52.908 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-07-13T13:50:52.908 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-07-13T13:50:52.908 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.908 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-07-13T13:50:52.908 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-07-13T13:50:52.909 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.909 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-07-13T13:50:52.909 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.909 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-07-13T13:50:52.909 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.909 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-07-13T13:50:52.909 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.910 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-07-13T13:50:52.910 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-07-13T13:50:52.910 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.910 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-07-13T13:50:52.910 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-07-13T13:50:52.911 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2023-07-13T13:50:52.911 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore compression mode = aggressive 2023-07-13T13:50:52.911 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2023-07-13T13:50:52.911 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2023-07-13T13:50:52.912 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2023-07-13T13:50:52.912 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-07-13T13:50:52.912 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-07-13T13:50:52.913 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2023-07-13T13:50:52.913 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2023-07-13T13:50:52.914 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2023-07-13T13:50:52.915 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2023-07-13T13:50:52.915 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2023-07-13T13:50:52.915 INFO:teuthology.orchestra.run.smithi118.stdout: osd fast shutdown = False 2023-07-13T13:50:52.915 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2023-07-13T13:50:52.916 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-07-13T13:50:52.916 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.916 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-07-13T13:50:52.916 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-07-13T13:50:52.917 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-07-13T13:50:52.917 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-07-13T13:50:52.917 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-07-13T13:50:52.917 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-07-13T13:50:52.918 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-07-13T13:50:52.918 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-07-13T13:50:52.918 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.918 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-07-13T13:50:52.918 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-07-13T13:50:52.918 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-07-13T13:50:52.918 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-07-13T13:50:52.918 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-07-13T13:50:52.919 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-07-13T13:50:52.919 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-07-13T13:50:52.919 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-07-13T13:50:52.919 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-07-13T13:50:52.919 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-07-13T13:50:52.920 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-07-13T13:50:52.920 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.920 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-13T13:50:52.920 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-07-13T13:50:52.920 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-07-13T13:50:52.920 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.920 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-07-13T13:50:52.921 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-13T13:50:52.921 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-13T13:50:52.921 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.921 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2023-07-13T13:50:52.921 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2023-07-13T13:50:52.921 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.921 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2023-07-13T13:50:52.922 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2023-07-13T13:50:52.922 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd crush smoke test = False 2023-07-13T13:50:52.922 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:50:52.922 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-07-13T13:50:52.922 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-07-13T13:50:52.922 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-07-13T13:50:52.922 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-07-13T13:50:52.923 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-13T13:50:52.923 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-13T13:50:52.923 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2023-07-13T13:50:52.923 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2023-07-13T13:50:52.923 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-07-13T13:50:52.923 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-07-13T13:50:52.924 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-07-13T13:50:52.924 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-07-13T13:50:52.924 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2023-07-13T13:50:52.925 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2023-07-13T13:50:52.925 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-07-13T13:50:52.925 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-07-13T13:50:52.925 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.e] 2023-07-13T13:50:52.926 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-07-13T13:50:52.926 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-07-13T13:50:52.926 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.f] 2023-07-13T13:50:52.927 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2023-07-13T13:50:52.927 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2023-07-13T13:50:52.927 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds balancer = 20 2023-07-13T13:50:52.927 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-07-13T13:50:52.928 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2023-07-13T13:50:52.928 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2023-07-13T13:50:52.928 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2023-07-13T13:50:52.929 INFO:teuthology.orchestra.run.smithi118.stdout: mds valgrind exit = True 2023-07-13T13:50:52.929 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2023-07-13T13:50:52.929 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2023-07-13T13:50:52.929 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2023-07-13T13:50:52.930 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2023-07-13T13:50:52.932 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2023-07-13T13:50:52.932 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2023-07-13T13:50:52.932 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-13T13:50:52.932 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2023-07-13T13:50:52.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.933 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2023-07-13T13:50:52.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.933 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2023-07-13T13:50:52.933 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.933 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2023-07-13T13:50:52.933 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2023-07-13T13:50:52.934 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.934 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2023-07-13T13:50:52.934 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2023-07-13T13:50:52.934 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.934 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-13T13:50:52.934 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2023-07-13T13:50:52.934 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.934 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2023-07-13T13:50:52.935 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-13T13:50:52.935 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.935 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2023-07-13T13:50:52.935 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.935 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2023-07-13T13:50:52.935 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2023-07-13T13:50:52.935 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2023-07-13T13:50:52.936 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2023-07-13T13:50:52.936 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2023-07-13T13:50:52.936 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2023-07-13T13:50:52.936 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2023-07-13T13:50:52.936 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-13T13:50:52.937 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-13T13:50:52.937 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2023-07-13T13:50:52.937 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.937 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-13T13:50:52.937 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.938 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2023-07-13T13:50:52.938 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.938 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2023-07-13T13:50:52.938 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.938 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2023-07-13T13:50:52.938 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2023-07-13T13:50:52.939 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2023-07-13T13:50:52.939 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.118,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-07-13T13:50:52.939 INFO:teuthology.orchestra.run.smithi123.stdout: mds beacon grace = 60 2023-07-13T13:50:52.939 INFO:teuthology.orchestra.run.smithi123.stdout: mds heartbeat grace = 60 2023-07-13T13:50:52.939 INFO:teuthology.orchestra.run.smithi123.stdout: osd heartbeat grace = 60 2023-07-13T13:50:52.939 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 1835fe1d-409c-4aad-9a14-d592cbe8c9c2 2023-07-13T13:50:52.939 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.939 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2023-07-13T13:50:52.940 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2023-07-13T13:50:52.940 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.940 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2023-07-13T13:50:52.940 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2023-07-13T13:50:52.940 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.940 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2023-07-13T13:50:52.940 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2023-07-13T13:50:52.941 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.941 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2023-07-13T13:50:52.941 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2023-07-13T13:50:52.941 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2023-07-13T13:50:52.941 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.941 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2023-07-13T13:50:52.941 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2023-07-13T13:50:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2023-07-13T13:50:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2023-07-13T13:50:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2023-07-13T13:50:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.942 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2023-07-13T13:50:52.943 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2023-07-13T13:50:52.943 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.943 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2023-07-13T13:50:52.943 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2023-07-13T13:50:52.943 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2023-07-13T13:50:52.943 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore compression mode = aggressive 2023-07-13T13:50:52.943 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2023-07-13T13:50:52.943 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 20 2023-07-13T13:50:52.944 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 20 2023-07-13T13:50:52.944 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-13T13:50:52.944 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2023-07-13T13:50:52.945 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 10 2023-07-13T13:50:52.945 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2023-07-13T13:50:52.945 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2023-07-13T13:50:52.945 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2023-07-13T13:50:52.946 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2023-07-13T13:50:52.946 INFO:teuthology.orchestra.run.smithi123.stdout: osd fast shutdown = False 2023-07-13T13:50:52.946 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2023-07-13T13:50:52.947 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-07-13T13:50:52.947 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.947 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2023-07-13T13:50:52.947 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-13T13:50:52.948 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2023-07-13T13:50:52.948 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-07-13T13:50:52.948 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-07-13T13:50:52.949 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-07-13T13:50:52.949 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-07-13T13:50:52.949 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2023-07-13T13:50:52.949 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.950 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2023-07-13T13:50:52.950 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-13T13:50:52.950 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-07-13T13:50:52.950 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2023-07-13T13:50:52.950 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-07-13T13:50:52.950 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2023-07-13T13:50:52.951 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2023-07-13T13:50:52.951 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-07-13T13:50:52.951 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2023-07-13T13:50:52.951 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2023-07-13T13:50:52.951 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-07-13T13:50:52.951 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.951 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-13T13:50:52.952 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2023-07-13T13:50:52.952 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2023-07-13T13:50:52.952 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.952 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2023-07-13T13:50:52.952 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-13T13:50:52.952 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-13T13:50:52.952 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.953 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2023-07-13T13:50:52.953 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2023-07-13T13:50:52.953 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.953 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2023-07-13T13:50:52.953 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2023-07-13T13:50:52.953 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd crush smoke test = False 2023-07-13T13:50:52.953 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-07-13T13:50:52.954 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2023-07-13T13:50:52.954 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2023-07-13T13:50:52.954 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2023-07-13T13:50:52.954 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2023-07-13T13:50:52.954 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-13T13:50:52.954 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-13T13:50:52.954 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2023-07-13T13:50:52.955 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2023-07-13T13:50:52.955 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-13T13:50:52.955 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-07-13T13:50:52.955 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-07-13T13:50:52.955 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2023-07-13T13:50:52.955 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2023-07-13T13:50:52.955 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2023-07-13T13:50:52.955 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-07-13T13:50:52.956 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2023-07-13T13:50:52.956 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.e] 2023-07-13T13:50:52.956 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-07-13T13:50:52.956 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2023-07-13T13:50:52.956 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.f] 2023-07-13T13:50:52.956 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2023-07-13T13:50:52.957 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2023-07-13T13:50:52.957 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2023-07-13T13:50:52.957 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-07-13T13:50:52.957 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2023-07-13T13:50:52.957 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2023-07-13T13:50:52.957 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2023-07-13T13:50:52.957 INFO:teuthology.orchestra.run.smithi123.stdout: mds valgrind exit = True 2023-07-13T13:50:52.957 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2023-07-13T13:50:52.958 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-07-13T13:50:52.958 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-07-13T13:50:52.958 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-07-13T13:50:52.958 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-13T13:50:52.958 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-13T13:50:53.125 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-13T13:50:53.126 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:53.126 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-13T13:50:53.144 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:53.145 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-13T13:50:53.202 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T13:50:53.203 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:53.203 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-13T13:50:53.203 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-13T13:50:53.365 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:50:53.366 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:50:53.413 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T13:50:53.414 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:50:53.414 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-13T13:50:53.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-13T13:50:53.460 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:50:53.461 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:50:53.522 INFO:tasks.ceph:Setting up mon nodes... 2023-07-13T13:50:53.523 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-13T13:50:53.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-13T13:50:53.583 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-13T13:50:53.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-13T13:50:53.678 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-13T13:50:53.681 INFO:tasks.ceph:Setting up mds nodes... 2023-07-13T13:50:53.681 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-13T13:50:53.741 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-13T13:50:53.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-13T13:50:53.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-13T13:50:53.866 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-13T13:50:53.869 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-13T13:50:53.895 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-07-13T13:50:53.988 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-07-13T13:50:53.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-07-13T13:50:54.016 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-13T13:50:54.082 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-13T13:50:54.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-13T13:50:54.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-13T13:50:54.211 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-13T13:50:54.213 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-13T13:50:54.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-07-13T13:50:54.334 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-07-13T13:50:54.336 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-07-13T13:50:54.364 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-13T13:50:54.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-13T13:50:54.417 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-13T13:50:54.431 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-13T13:50:54.431 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-13T13:50:54.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-13T13:50:54.460 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-13T13:50:54.461 INFO:tasks.ceph:role: osd.0 2023-07-13T13:50:54.461 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T13:50:54.461 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-13T13:50:54.529 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-13T13:50:54.529 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-13T13:50:54.529 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-13T13:50:54.530 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-13T13:50:54.530 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-13T13:50:54.530 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-07-13T13:50:54.530 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-13T13:50:54.530 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-13T13:50:54.530 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-13T13:50:54.530 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-13T13:50:54.552 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-07-13T13:50:54.553 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-07-13T13:50:54.554 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-13T13:50:54.635 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-13T13:50:54.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-13T13:50:54.774 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-13T13:50:54.774 INFO:tasks.ceph:role: osd.1 2023-07-13T13:50:54.774 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T13:50:54.775 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-13T13:50:54.840 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-13T13:50:54.840 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-13T13:50:54.840 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-13T13:50:54.841 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-13T13:50:54.841 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-13T13:50:54.841 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-07-13T13:50:54.841 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-13T13:50:54.841 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-13T13:50:54.841 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-13T13:50:54.841 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-13T13:50:54.863 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-07-13T13:50:54.864 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-07-13T13:50:54.865 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-13T13:50:54.944 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-13T13:50:55.015 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-13T13:50:55.083 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-13T13:50:55.083 INFO:tasks.ceph:role: osd.2 2023-07-13T13:50:55.083 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T13:50:55.084 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-13T13:50:55.149 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-13T13:50:55.149 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-13T13:50:55.150 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-13T13:50:55.150 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-13T13:50:55.150 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-13T13:50:55.150 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-07-13T13:50:55.150 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-13T13:50:55.150 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-13T13:50:55.150 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-13T13:50:55.151 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-13T13:50:55.174 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-07-13T13:50:55.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-07-13T13:50:55.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-13T13:50:55.256 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-13T13:50:55.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-13T13:50:55.392 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-13T13:50:55.393 INFO:tasks.ceph:role: osd.3 2023-07-13T13:50:55.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T13:50:55.394 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-13T13:50:55.459 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-13T13:50:55.460 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-13T13:50:55.460 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-13T13:50:55.460 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-13T13:50:55.460 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-13T13:50:55.460 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-07-13T13:50:55.460 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-13T13:50:55.461 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-13T13:50:55.461 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-13T13:50:55.461 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-13T13:50:55.484 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2023-07-13T13:50:55.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-07-13T13:50:55.485 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-13T13:50:55.565 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-13T13:50:55.635 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:50:55.727 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:55.753+0000 7faa1c4aa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-13T13:50:55.727 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:55.753+0000 7faa1c4aa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-13T13:50:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:55.753+0000 7faa1c4aa640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-13T13:50:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:55.753+0000 7faa1c4aa640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-13T13:50:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:55.753+0000 7faa1c4aa640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-13T13:50:55.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:55.753+0000 7faa1c4aa640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-13T13:50:58.578 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-13T13:50:58.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:50:58.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:58.733+0000 7f5335073640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-13T13:50:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:58.733+0000 7f5335073640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-13T13:50:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:58.733+0000 7f5335073640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-13T13:50:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:58.733+0000 7f5335073640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-13T13:50:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:58.733+0000 7f5335073640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-13T13:50:58.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:50:58.734+0000 7f5335073640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-13T13:51:01.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-13T13:51:01.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:51:01.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:01.705+0000 7ff1d23e9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-13T13:51:01.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:01.706+0000 7ff1d23e9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-13T13:51:01.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:01.706+0000 7ff1d23e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-13T13:51:01.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:01.706+0000 7ff1d23e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-13T13:51:01.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:01.706+0000 7ff1d23e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-13T13:51:01.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:01.706+0000 7ff1d23e9640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-13T13:51:04.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-13T13:51:04.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:51:04.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:04.691+0000 7f68587a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-13T13:51:04.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:04.692+0000 7f68587a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-13T13:51:04.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:04.692+0000 7f68587a8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-13T13:51:04.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:04.692+0000 7f68587a8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-13T13:51:04.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:04.692+0000 7f68587a8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-13T13:51:04.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:04.692+0000 7f68587a8640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-13T13:51:07.507 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-13T13:51:07.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-13T13:51:07.577 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-13T13:51:07.578 INFO:tasks.ceph:role: osd.4 2023-07-13T13:51:07.578 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T13:51:07.579 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-13T13:51:07.657 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-13T13:51:07.657 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-13T13:51:07.658 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-13T13:51:07.658 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-13T13:51:07.658 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-13T13:51:07.658 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-07-13T13:51:07.658 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-13T13:51:07.658 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-13T13:51:07.658 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-13T13:51:07.658 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-13T13:51:08.086 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-07-13T13:51:08.087 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-07-13T13:51:08.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-13T13:51:08.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-13T13:51:08.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-13T13:51:08.401 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-13T13:51:08.401 INFO:tasks.ceph:role: osd.5 2023-07-13T13:51:08.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T13:51:08.402 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-13T13:51:08.482 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-13T13:51:08.482 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-13T13:51:08.482 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-13T13:51:08.483 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-13T13:51:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-13T13:51:08.483 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-07-13T13:51:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-13T13:51:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-13T13:51:08.483 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-13T13:51:08.483 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-13T13:51:08.921 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-07-13T13:51:08.923 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-07-13T13:51:08.924 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-13T13:51:09.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-13T13:51:09.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-13T13:51:09.161 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-13T13:51:09.161 INFO:tasks.ceph:role: osd.6 2023-07-13T13:51:09.161 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T13:51:09.162 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-13T13:51:09.240 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-13T13:51:09.240 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-13T13:51:09.241 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-13T13:51:09.241 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-13T13:51:09.241 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-13T13:51:09.241 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-07-13T13:51:09.241 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-13T13:51:09.241 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-13T13:51:09.241 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-13T13:51:09.242 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-13T13:51:09.688 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-07-13T13:51:09.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-07-13T13:51:09.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-13T13:51:09.866 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-13T13:51:09.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-13T13:51:09.979 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-13T13:51:09.979 INFO:tasks.ceph:role: osd.7 2023-07-13T13:51:09.979 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T13:51:09.980 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-13T13:51:10.060 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-13T13:51:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-13T13:51:10.060 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-13T13:51:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-13T13:51:10.061 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-13T13:51:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-07-13T13:51:10.061 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-13T13:51:10.061 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-13T13:51:10.061 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-13T13:51:10.061 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-13T13:51:10.502 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-07-13T13:51:10.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-07-13T13:51:10.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-13T13:51:10.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-13T13:51:10.669 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:51:10.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:10.805+0000 7f8621f84640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-13T13:51:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:10.805+0000 7f8621f84640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-13T13:51:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:10.805+0000 7f8621f84640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-13T13:51:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:10.805+0000 7f8621f84640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-13T13:51:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:10.805+0000 7f8621f84640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-13T13:51:10.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:10.806+0000 7f8621f84640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-13T13:51:13.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-13T13:51:13.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:51:13.752 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:13.778+0000 7f9e61e94640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-13T13:51:13.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:13.778+0000 7f9e61e94640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-13T13:51:13.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:13.778+0000 7f9e61e94640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-13T13:51:13.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:13.778+0000 7f9e61e94640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-13T13:51:13.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:13.778+0000 7f9e61e94640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-13T13:51:13.753 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:13.779+0000 7f9e61e94640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-13T13:51:16.614 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-13T13:51:16.648 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:51:16.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:16.771+0000 7f635fa95640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-13T13:51:16.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:16.771+0000 7f635fa95640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-13T13:51:16.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:16.772+0000 7f635fa95640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-13T13:51:16.746 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:16.772+0000 7f635fa95640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-13T13:51:16.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:16.772+0000 7f635fa95640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-13T13:51:16.747 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:16.772+0000 7f635fa95640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-13T13:51:19.596 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-13T13:51:19.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:51:19.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:19.753+0000 7f63fffc5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-13T13:51:19.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:19.753+0000 7f63fffc5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-13T13:51:19.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:19.753+0000 7f63fffc5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-13T13:51:19.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:19.754+0000 7f63fffc5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-13T13:51:19.728 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:19.754+0000 7f63fffc5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-13T13:51:19.729 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:19.754+0000 7f63fffc5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-13T13:51:20.608 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:51:20.611 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:51:22.569 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-13T13:51:22.603 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-13T13:51:22.604 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:22.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-13T13:51:22.637 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:22.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-13T13:51:22.709 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:22.710 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-13T13:51:22.783 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:22.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-07-13T13:51:22.856 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:22.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-13T13:51:22.929 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:22.929 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-13T13:51:23.002 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:23.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-13T13:51:23.074 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:23.075 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-13T13:51:23.146 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:23.147 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-13T13:51:23.180 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:23.180 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-13T13:51:23.252 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:23.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-13T13:51:23.324 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:23.325 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-07-13T13:51:23.395 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:23.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-13T13:51:23.464 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:23.465 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-13T13:51:23.533 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:23.534 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-13T13:51:23.600 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:23.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-13T13:51:23.668 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:23.669 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-13T13:51:23.691 INFO:tasks.ceph:Adding keys to all mons... 2023-07-13T13:51:23.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-13T13:51:23.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-13T13:51:23.760 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2023-07-13T13:51:23.760 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA9AbBkZgteJBAAWd365zGxhD+Wa7KWLzyZRA== 2023-07-13T13:51:23.760 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-07-13T13:51:23.760 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA9AbBku8XOLRAAwkoSQrn/DE+ITfNqW5LAtA== 2023-07-13T13:51:23.760 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2023-07-13T13:51:23.761 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA9AbBkp7xENRAApMeV6OTkxJyjekXIumXY/g== 2023-07-13T13:51:23.761 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.e] 2023-07-13T13:51:23.761 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA+AbBkInPnABAAcNJfwo0uZnHGG7f2scozxw== 2023-07-13T13:51:23.761 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2023-07-13T13:51:23.761 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA/AbBklRbzLBAAIUJBFM5rcFCJcV5xg6Njzg== 2023-07-13T13:51:23.761 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2023-07-13T13:51:23.761 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBCAbBki7LBKxAAHZe7NarHbm+6p8ytJYiJrw== 2023-07-13T13:51:23.762 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2023-07-13T13:51:23.762 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBFAbBkHSYdKhAA5Afzc04Rvcth/Ddp1NoUzg== 2023-07-13T13:51:23.762 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2023-07-13T13:51:23.762 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBIAbBk5DtHKRAA07FW7hkgda/oGrqZfSPnGA== 2023-07-13T13:51:23.762 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2023-07-13T13:51:23.762 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA9AbBknRYBKhAAuscdfcuqjuz3PAHyzVkQQA== 2023-07-13T13:51:23.762 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-07-13T13:51:23.763 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA+AbBkMUx/BhAARkSFAHkggv4lOyznetZEEQ== 2023-07-13T13:51:23.763 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2023-07-13T13:51:23.763 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA+AbBktP8qDhAAbdhMQTB6UcI+ufbyKMhEFw== 2023-07-13T13:51:23.763 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.f] 2023-07-13T13:51:23.763 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA+AbBkwR6BFRAAzTbuSlHNN7EdvlYY4FZH/Q== 2023-07-13T13:51:23.763 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2023-07-13T13:51:23.763 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBOAbBkzZ//LxAA3cHpnEr8Hw8lHKlPKfMTQA== 2023-07-13T13:51:23.764 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2023-07-13T13:51:23.764 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBRAbBkzYd1LhAAlLp8sYRWMpJxngpzlA8N/A== 2023-07-13T13:51:23.764 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2023-07-13T13:51:23.764 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBUAbBkTKURLhAAOJSByOXbNwzNUZTfCu+boQ== 2023-07-13T13:51:23.764 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2023-07-13T13:51:23.764 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBXAbBkT6r9LBAAokPDMUV3geUXypKkQVF2Hg== 2023-07-13T13:51:23.764 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2023-07-13T13:51:23.765 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQA+AbBkFUZ9GhAAVHlVMMYRSppRv7cPt8Tc2w== 2023-07-13T13:51:23.766 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2023-07-13T13:51:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA9AbBkZgteJBAAWd365zGxhD+Wa7KWLzyZRA== 2023-07-13T13:51:23.766 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2023-07-13T13:51:23.766 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA9AbBku8XOLRAAwkoSQrn/DE+ITfNqW5LAtA== 2023-07-13T13:51:23.767 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2023-07-13T13:51:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA9AbBkp7xENRAApMeV6OTkxJyjekXIumXY/g== 2023-07-13T13:51:23.767 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.e] 2023-07-13T13:51:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA+AbBkInPnABAAcNJfwo0uZnHGG7f2scozxw== 2023-07-13T13:51:23.767 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2023-07-13T13:51:23.767 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA/AbBklRbzLBAAIUJBFM5rcFCJcV5xg6Njzg== 2023-07-13T13:51:23.767 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2023-07-13T13:51:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBCAbBki7LBKxAAHZe7NarHbm+6p8ytJYiJrw== 2023-07-13T13:51:23.768 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2023-07-13T13:51:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBFAbBkHSYdKhAA5Afzc04Rvcth/Ddp1NoUzg== 2023-07-13T13:51:23.768 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2023-07-13T13:51:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBIAbBk5DtHKRAA07FW7hkgda/oGrqZfSPnGA== 2023-07-13T13:51:23.768 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2023-07-13T13:51:23.768 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA9AbBknRYBKhAAuscdfcuqjuz3PAHyzVkQQA== 2023-07-13T13:51:23.769 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2023-07-13T13:51:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA+AbBkMUx/BhAARkSFAHkggv4lOyznetZEEQ== 2023-07-13T13:51:23.769 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2023-07-13T13:51:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA+AbBktP8qDhAAbdhMQTB6UcI+ufbyKMhEFw== 2023-07-13T13:51:23.769 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.f] 2023-07-13T13:51:23.769 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA+AbBkwR6BFRAAzTbuSlHNN7EdvlYY4FZH/Q== 2023-07-13T13:51:23.769 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2023-07-13T13:51:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBOAbBkzZ//LxAA3cHpnEr8Hw8lHKlPKfMTQA== 2023-07-13T13:51:23.770 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2023-07-13T13:51:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBRAbBkzYd1LhAAlLp8sYRWMpJxngpzlA8N/A== 2023-07-13T13:51:23.770 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2023-07-13T13:51:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBUAbBkTKURLhAAOJSByOXbNwzNUZTfCu+boQ== 2023-07-13T13:51:23.770 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2023-07-13T13:51:23.770 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBXAbBkT6r9LBAAokPDMUV3geUXypKkQVF2Hg== 2023-07-13T13:51:23.771 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2023-07-13T13:51:23.771 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQA+AbBkFUZ9GhAAVHlVMMYRSppRv7cPt8Tc2w== 2023-07-13T13:51:23.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-13T13:51:23.809 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-13T13:51:23.869 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:23.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:23.930 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:23.932 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:23.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:23.992 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:24.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.051 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.106 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.214 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.216 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-13T13:51:24.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-13T13:51:24.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:24.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:24.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:24.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:24.442 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:24.445 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-13T13:51:24.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.504 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.560 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.613 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.670 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-13T13:51:24.723 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-13T13:51:24.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-13T13:51:24.782 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-13T13:51:24.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-13T13:51:24.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-13T13:51:24.907 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-13T13:51:24.935 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-13T13:51:24.962 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-13T13:51:25.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-13T13:51:25.089 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-13T13:51:25.155 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-13T13:51:25.254 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-13T13:51:25.282 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:51:25.284 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-13T13:51:25.340 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-13T13:51:25.340 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-07-13T13:51:25.341 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-13T13:51:25.341 DEBUG:teuthology.orchestra.run.smithi118:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-07-13T13:51:25.343 INFO:tasks.ceph.mon.a:Started 2023-07-13T13:51:25.344 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-07-13T13:51:25.345 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-13T13:51:25.345 DEBUG:teuthology.orchestra.run.smithi123:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-07-13T13:51:25.383 INFO:tasks.ceph.mon.b:Started 2023-07-13T13:51:25.383 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-07-13T13:51:25.384 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-13T13:51:25.384 DEBUG:teuthology.orchestra.run.smithi123:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-07-13T13:51:25.387 INFO:tasks.ceph.mon.c:Started 2023-07-13T13:51:25.387 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-13T13:51:25.388 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-13T13:51:25.389 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-07-13T13:51:25.391 INFO:tasks.ceph.mgr.y:Started 2023-07-13T13:51:25.392 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-13T13:51:25.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-07-13T13:51:25.395 INFO:tasks.ceph.mgr.x:Started 2023-07-13T13:51:25.395 INFO:tasks.ceph:Setting crush tunables to default 2023-07-13T13:51:25.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd crush tunables default 2023-07-13T13:51:25.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd11b32700 1 Processor -- start 2023-07-13T13:51:25.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd11b32700 1 -- start start 2023-07-13T13:51:25.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd11b32700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 0x7fbd0c0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:25.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd11b32700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 0x7fbd0c0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:25.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd11b32700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0c6ca0 con 0x7fbd0c14f790 2023-07-13T13:51:25.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd11b32700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c6160 con 0x7fbd0c071cc0 2023-07-13T13:51:25.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd11b32700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0716a0 con 0x7fbd0c0720d0 2023-07-13T13:51:25.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbd0c14f790 legacy=0x7fbd0c070ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.118:6789/0 2023-07-13T13:51:25.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd0affd700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 msgr2=0x7fbd0c0c4380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.118:3300/0 2023-07-13T13:51:25.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 msgr2=0x7fbd0c0c48c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:25.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd0affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 0x7fbd0c0c4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:25.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.571+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 0x7fbd0c0c48c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:25.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.772+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbd0c14f790 legacy=0x7fbd0c070ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.118:6789/0 2023-07-13T13:51:25.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.772+0000 7fbd0affd700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 msgr2=0x7fbd0c0c4380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.118:3300/0 2023-07-13T13:51:25.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.772+0000 7fbd0affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 0x7fbd0c0c4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:25.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.772+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 msgr2=0x7fbd0c0c48c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:25.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:25.772+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 0x7fbd0c0c48c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.173+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbd0c14f790 legacy=0x7fbd0c070ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.118:6789/0 2023-07-13T13:51:26.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.173+0000 7fbd0affd700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 msgr2=0x7fbd0c0c4380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.118:3300/0 2023-07-13T13:51:26.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.173+0000 7fbd0affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 0x7fbd0c0c4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:26.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.173+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 msgr2=0x7fbd0c0c48c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:26.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.173+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 0x7fbd0c0c48c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:26.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.974+0000 7fbd0affd700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 msgr2=0x7fbd0c0c4380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.118:3300/0 2023-07-13T13:51:26.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.974+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbd0c14f790 legacy=0x7fbd0c070ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.118:6789/0 2023-07-13T13:51:26.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.974+0000 7fbd0affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 0x7fbd0c0c4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-13T13:51:26.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.974+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 msgr2=0x7fbd0c0c48c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:26.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:26.974+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 0x7fbd0c0c48c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-13T13:51:28.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.571+0000 7fbd097fa700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 msgr2=0x7fbd0c0c48c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:28.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.571+0000 7fbd097fa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbd0c0720d0 0x7fbd0c0c48c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:28.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.571+0000 7fbd097fa700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 msgr2=0x7fbd0c0c4380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:28.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.571+0000 7fbd097fa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd0c071cc0 0x7fbd0c0c4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:28.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.571+0000 7fbd097fa700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbd0c14f790 legacy=0x7fbd0c070ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:28.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.572+0000 7fbd097fa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 0x7fbcf8009930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:28.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.572+0000 7fbd097fa700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0c6370 con 0x7fbcf8003750 2023-07-13T13:51:28.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.572+0000 7fbd097fa700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c6160 con 0x7fbcf8007480 2023-07-13T13:51:28.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.572+0000 7fbd0affd700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 msgr2=0x7fbcf8009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2023-07-13T13:51:28.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.572+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf8003750 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2023-07-13T13:51:28.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.572+0000 7fbd0affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 0x7fbcf8009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:28.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.773+0000 7fbd0affd700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 msgr2=0x7fbcf8009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2023-07-13T13:51:28.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.773+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf8003750 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2023-07-13T13:51:28.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:28.773+0000 7fbd0affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 0x7fbcf8009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:29.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:29.174+0000 7fbd0affd700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 msgr2=0x7fbcf8009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2023-07-13T13:51:29.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:29.174+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf8003750 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2023-07-13T13:51:29.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:29.174+0000 7fbd0affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 0x7fbcf8009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:29.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:29.975+0000 7fbd0affd700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 msgr2=0x7fbcf8009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2023-07-13T13:51:29.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:29.975+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf8003750 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2023-07-13T13:51:29.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:29.975+0000 7fbd0affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 0x7fbcf8009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-13T13:51:31.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd097fa700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 msgr2=0x7fbcf8009930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:31.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd097fa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf8007480 0x7fbcf8009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:31.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd097fa700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf8003750 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:31.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd0bfff700 1 -- reap_dead start 2023-07-13T13:51:31.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd097fa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 0x7fbcf800e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:31.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd097fa700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0c6ca0 con 0x7fbcf8009ff0 2023-07-13T13:51:31.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd097fa700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0c6370 con 0x7fbcf800ab30 2023-07-13T13:51:31.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd097fa700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c6160 con 0x7fbcf80099c0 2023-07-13T13:51:31.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbcf8009ff0 legacy=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.118:6789/0 2023-07-13T13:51:31.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd0affd700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf800ab30 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2023-07-13T13:51:31.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 msgr2=0x7fbcf800e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:31.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.573+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 0x7fbcf800e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:31.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.774+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbcf8009ff0 legacy=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.118:6789/0 2023-07-13T13:51:31.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.774+0000 7fbd0affd700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf800ab30 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2023-07-13T13:51:31.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.774+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 msgr2=0x7fbcf800e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:31.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:31.774+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 0x7fbcf800e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:32.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:32.175+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbcf8009ff0 legacy=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.118:6789/0 2023-07-13T13:51:32.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:32.175+0000 7fbd0affd700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf800ab30 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2023-07-13T13:51:32.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:32.175+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 msgr2=0x7fbcf800e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:32.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:32.175+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 0x7fbcf800e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:32.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:32.976+0000 7fbd0b7fe700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbcf8009ff0 legacy=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.118:6789/0 2023-07-13T13:51:32.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:32.976+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 msgr2=0x7fbcf800e1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:32.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:32.976+0000 7fbd0affd700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf800ab30 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.123:6789/0 2023-07-13T13:51:32.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:32.976+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 0x7fbcf800e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-13T13:51:34.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd097fa700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 msgr2=0x7fbcf800e1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:34.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd097fa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf80099c0 0x7fbcf800e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:34.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd097fa700 1 -- >> v1:172.21.15.123:6789/0 conn(0x7fbcf800ab30 legacy=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:34.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd097fa700 1 -- >> v1:172.21.15.118:6789/0 conn(0x7fbcf8009ff0 legacy=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:34.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd097fa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 0x7fbcf800ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:34.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd097fa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 0x7fbcf800f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd097fa700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c6160 con 0x7fbcf800e8f0 2023-07-13T13:51:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd097fa700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0716a0 con 0x7fbcf800f420 2023-07-13T13:51:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd0b7fe700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 msgr2=0x7fbcf800ed30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.118:3300/0 2023-07-13T13:51:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd0b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 0x7fbcf800ed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd0affd700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 msgr2=0x7fbcf800f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2023-07-13T13:51:34.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.573+0000 7fbd0affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 0x7fbcf800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:34.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.774+0000 7fbd0b7fe700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 msgr2=0x7fbcf800ed30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.118:3300/0 2023-07-13T13:51:34.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.774+0000 7fbd0b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 0x7fbcf800ed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:34.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.774+0000 7fbd0affd700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 msgr2=0x7fbcf800f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2023-07-13T13:51:34.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:34.774+0000 7fbd0affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 0x7fbcf800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:35.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:35.175+0000 7fbd0b7fe700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 msgr2=0x7fbcf800ed30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.118:3300/0 2023-07-13T13:51:35.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:35.175+0000 7fbd0b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 0x7fbcf800ed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:35.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:35.175+0000 7fbd0affd700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 msgr2=0x7fbcf800f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2023-07-13T13:51:35.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:35.175+0000 7fbd0affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 0x7fbcf800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:35.541 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:00:10.075 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T13:51:35.784 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:00:10.284 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T13:51:35.789 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:00:10.289 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T13:51:35.879 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:00:10.413 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T13:51:35.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:35.976+0000 7fbd0b7fe700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 msgr2=0x7fbcf800ed30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.118:3300/0 2023-07-13T13:51:35.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:35.976+0000 7fbd0b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 0x7fbcf800ed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-13T13:51:35.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:35.976+0000 7fbd0affd700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 msgr2=0x7fbcf800f930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3300/0 2023-07-13T13:51:35.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:35.976+0000 7fbd0affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 0x7fbcf800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-13T13:51:36.126 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:00:10.626 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T13:51:36.132 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:00:10.632 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T13:51:37.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 -- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 msgr2=0x7fbcf800f930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:37.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbcf800f420 0x7fbcf800f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:37.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 -- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 msgr2=0x7fbcf800ed30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:37.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800e8f0 0x7fbcf800ed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:37.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd0bfff700 1 -- reap_dead start 2023-07-13T13:51:37.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:37.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:37.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf8010a40 con 0x7fbcf800f930 2023-07-13T13:51:37.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c6160 con 0x7fbcf800ed30 2023-07-13T13:51:37.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd097fa700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0716a0 con 0x7fbcf800e1f0 2023-07-13T13:51:37.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd0bfff700 1 -- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 msgr2=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.123:3301/0 2023-07-13T13:51:37.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.573+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:37.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.748+0000 7fbd0b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:37.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.763+0000 7fbd0b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58164/0 (socket says 172.21.15.118:58164) 2023-07-13T13:51:37.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.763+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 learned_addr learned my addr 172.21.15.118:0/1716883824 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:37.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.793+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:37.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.793+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:37.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.793+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:37.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.793+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:37.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.994+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:37.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.995+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:37.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.995+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:37.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.995+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:37.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:37.995+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:38.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.135+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:38.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.142+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 msgr2=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-13T13:51:38.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.142+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 msgr2=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:38.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.142+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:38.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.143+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.397+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.398+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.398+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.398+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:38.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.398+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:38.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.595+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.597+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 msgr2=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.597+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 msgr2=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.597+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:38.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:38.597+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:39.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.199+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:39.173 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.200+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:39.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.200+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:39.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.200+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:39.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.200+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-13T13:51:39.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.399+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:39.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.401+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 msgr2=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:39.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.401+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 msgr2=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:39.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.401+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:39.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:39.401+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-13T13:51:40.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.573+0000 7fbd097fa700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 msgr2=0x7fbcf8005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:40.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.573+0000 7fbd097fa700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf800e1f0 0x7fbcf8005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:40.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.573+0000 7fbd097fa700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 msgr2=0x7fbcf800a3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:40.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.573+0000 7fbd097fa700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.118:3300/0 conn(0x7fbcf800ed30 0x7fbcf800a3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:40.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.573+0000 7fbd097fa700 1 -- 172.21.15.118:0/1716883824 >> v1:172.21.15.118:6789/0 conn(0x7fbcf800f930 legacy=0x7fbcf800ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:40.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.573+0000 7fbd097fa700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:40.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.573+0000 7fbd097fa700 1 -- 172.21.15.118:0/1716883824 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0c6ca0 con 0x7fbcf8006a40 2023-07-13T13:51:40.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.573+0000 7fbd097fa700 1 -- 172.21.15.118:0/1716883824 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c6160 con 0x7fbcf8006100 2023-07-13T13:51:40.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.576+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:40.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.578+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 msgr2=0x7fbcf8006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:40.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.578+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 msgr2=0x7fbcf8006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:40.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.578+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:40.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.579+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-13T13:51:40.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.780+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:40.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.782+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 msgr2=0x7fbcf8006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:40.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.782+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 msgr2=0x7fbcf8006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:40.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.782+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:40.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:40.782+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-13T13:51:41.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.349+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.358+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 msgr2=0x7fbcf8006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-13T13:51:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.358+0000 7fbd0b7fe700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 msgr2=0x7fbcf8006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-13T13:51:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.358+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-13T13:51:41.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.358+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-13T13:51:41.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.576+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865273966 0 0) 0x7fbd0c0c6ca0 con 0x7fbcf8006a40 2023-07-13T13:51:41.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.576+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf40035b0 con 0x7fbcf8006a40 2023-07-13T13:51:41.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60825817 0 0) 0x7fbcf40035b0 con 0x7fbcf8006a40 2023-07-13T13:51:41.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 msgr2=0x7fbcf8006500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-13T13:51:41.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 --2- 172.21.15.118:0/1716883824 >> v2:172.21.15.123:3300/0 conn(0x7fbcf8006100 0x7fbcf8006500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:41.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0c6370 con 0x7fbcf8006a40 2023-07-13T13:51:41.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402946124 0 0) 0x7fbd00003f60 con 0x7fbcf8006a40 2023-07-13T13:51:41.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 >> v1:172.21.15.123:6789/0 conn(0x7fbcf8006a40 legacy=0x7fbcf8016ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:41.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 reap_dead start 2023-07-13T13:51:41.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 0x7fbcf4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:41.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4004850 0x7fbcf4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:41.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4005250 0x7fbcf400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:41.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c6160 con 0x7fbcf4003a30 2023-07-13T13:51:41.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf400c160 con 0x7fbcf4005250 2023-07-13T13:51:41.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.713+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf400c320 con 0x7fbcf4004850 2023-07-13T13:51:41.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.721+0000 7fbd0b7fe700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 0x7fbcf4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:41.769 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.796+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4005250 0x7fbcf400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:41.778 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.805+0000 7fbd0affd700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4004850 0x7fbcf4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:41.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.811+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4004850 msgr2=0x7fbcf4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:41.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.811+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4004850 0x7fbcf4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:41.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.811+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 msgr2=0x7fbcf4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:41.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.811+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 0x7fbcf4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:41.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.811+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1716883824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf40035b0 con 0x7fbcf4005250 2023-07-13T13:51:41.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.813+0000 7fbd0bfff700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4005250 0x7fbcf400ba10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0cc4e0 tx=0x7fbcf4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4abcad86a7574fa3 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:41.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.822+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04003dd0 con 0x7fbcf4005250 2023-07-13T13:51:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04012040 con 0x7fbcf4005250 2023-07-13T13:51:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd0a7fc700 1 -- 172.21.15.118:0/1716883824 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400cc60 con 0x7fbcf4005250 2023-07-13T13:51:41.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd11b32700 1 -- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4005250 msgr2=0x7fbcf400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:41.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd11b32700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4005250 0x7fbcf400ba10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0cc4e0 tx=0x7fbcf4005880 comp rx=0 tx=0).stop 2023-07-13T13:51:41.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd11b32700 1 -- 172.21.15.118:0/1716883824 shutdown_connections 2023-07-13T13:51:41.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd11b32700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4005250 0x7fbcf400ba10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:41.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd11b32700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4004850 0x7fbcf4004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:41.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd11b32700 1 --2- 172.21.15.118:0/1716883824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 0x7fbcf4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:41.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.825+0000 7fbd11b32700 1 -- 172.21.15.118:0/1716883824 >> 172.21.15.118:0/1716883824 conn(0x7fbd0c06cf60 msgr2=0x7fbd0c06b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:41.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.826+0000 7fbd11b32700 1 -- 172.21.15.118:0/1716883824 shutdown_connections 2023-07-13T13:51:41.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.826+0000 7fbd11b32700 1 -- 172.21.15.118:0/1716883824 wait complete. 2023-07-13T13:51:41.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.827+0000 7fbd11b32700 1 Processor -- start 2023-07-13T13:51:41.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.827+0000 7fbd11b32700 1 -- start start 2023-07-13T13:51:41.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.828+0000 7fbd11b32700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 0x7fbd0c1ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:41.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.828+0000 7fbd11b32700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4004850 0x7fbd0c1dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:41.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.828+0000 7fbd11b32700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4005250 0x7fbd0c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:41.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.828+0000 7fbd11b32700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c1545f0 con 0x7fbcf4003a30 2023-07-13T13:51:41.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.828+0000 7fbd11b32700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c1548d0 con 0x7fbcf4004850 2023-07-13T13:51:41.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.828+0000 7fbd11b32700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c154bb0 con 0x7fbcf4005250 2023-07-13T13:51:41.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.829+0000 7fbd0affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4004850 0x7fbd0c1dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:41.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.829+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4005250 0x7fbd0c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:41.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.829+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4005250 0x7fbd0c155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:35954/0 (socket says 172.21.15.118:35954) 2023-07-13T13:51:41.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.829+0000 7fbd0bfff700 1 -- 172.21.15.118:0/1585153799 learned_addr learned my addr 172.21.15.118:0/1585153799 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:41.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.843+0000 7fbd0affd700 1 -- 172.21.15.118:0/1585153799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4005250 msgr2=0x7fbd0c155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:41.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.843+0000 7fbd0affd700 1 --2- 172.21.15.118:0/1585153799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4005250 0x7fbd0c155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:41.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.843+0000 7fbd0affd700 1 -- 172.21.15.118:0/1585153799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 msgr2=0x7fbd0c1ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:41.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.843+0000 7fbd0affd700 1 --2- 172.21.15.118:0/1585153799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 0x7fbd0c1ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:41.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.843+0000 7fbd0affd700 1 -- 172.21.15.118:0/1585153799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c154e90 con 0x7fbcf4004850 2023-07-13T13:51:41.818 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.846+0000 7fbd0affd700 1 --2- 172.21.15.118:0/1585153799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4004850 0x7fbd0c1dfbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800f8a0 tx=0x7fbd0000ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:41.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.850+0000 7fbcf3fff700 1 -- 172.21.15.118:0/1585153799 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0000cba0 con 0x7fbcf4004850 2023-07-13T13:51:41.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.850+0000 7fbcf3fff700 1 -- 172.21.15.118:0/1585153799 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00013070 con 0x7fbcf4004850 2023-07-13T13:51:41.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.850+0000 7fbcf3fff700 1 -- 172.21.15.118:0/1585153799 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0001a480 con 0x7fbcf4004850 2023-07-13T13:51:41.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.850+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c155170 con 0x7fbcf4004850 2023-07-13T13:51:41.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.850+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c1eee20 con 0x7fbcf4004850 2023-07-13T13:51:41.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:41.851+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c0c6630 con 0x7fbcf4004850 2023-07-13T13:51:42.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.082+0000 7fbcf3fff700 1 -- 172.21.15.118:0/1585153799 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbd0001a8e0 con 0x7fbcf4004850 2023-07-13T13:51:42.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.090+0000 7fbcf3fff700 1 -- 172.21.15.118:0/1585153799 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbd00015070 con 0x7fbcf4004850 2023-07-13T13:51:42.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.090+0000 7fbcf3fff700 1 -- 172.21.15.118:0/1585153799 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbd0c0c6630 con 0x7fbcf4004850 2023-07-13T13:51:42.077 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:42.105+0000 7f10db495200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T13:51:42.111 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:42.137+0000 7f4689bdb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T13:51:42.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.167+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbd0c155690 con 0x7fbcf4004850 2023-07-13T13:51:42.281 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:42.308+0000 7f10db495200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T13:51:42.305 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:42.331+0000 7f4689bdb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T13:51:42.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.662+0000 7fbcf3fff700 1 -- 172.21.15.118:0/1585153799 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbd0c155690 con 0x7fbcf4004850 2023-07-13T13:51:42.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4004850 msgr2=0x7fbd0c1dfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:42.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 --2- 172.21.15.118:0/1585153799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4004850 0x7fbd0c1dfbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800f8a0 tx=0x7fbd0000ed40 comp rx=0 tx=0).stop 2023-07-13T13:51:42.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 shutdown_connections 2023-07-13T13:51:42.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 --2- 172.21.15.118:0/1585153799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbcf4005250 0x7fbd0c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 --2- 172.21.15.118:0/1585153799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcf4003a30 0x7fbd0c1ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 --2- 172.21.15.118:0/1585153799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcf4004850 0x7fbd0c1dfbf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 >> 172.21.15.118:0/1585153799 conn(0x7fbd0c06cf60 msgr2=0x7fbd0c0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 shutdown_connections 2023-07-13T13:51:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:42.663+0000 7fbd11b32700 1 -- 172.21.15.118:0/1585153799 wait complete. 2023-07-13T13:51:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:adjusted tunables profile to default 2023-07-13T13:51:42.649 INFO:tasks.ceph:check_enable_crimson: False 2023-07-13T13:51:42.649 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-13T13:51:42.650 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:42.650 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-13T13:51:42.678 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:42.704+0000 7f4689bdb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T13:51:42.679 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:42.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-13T13:51:42.711 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:42.738+0000 7f10db495200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T13:51:42.737 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:42.738 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-13T13:51:42.804 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:51:42.804 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-13T13:51:42.871 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:42.872 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-13T13:51:42.899 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:42.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-13T13:51:42.967 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:42.967 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-13T13:51:43.033 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-07-13T13:51:43.034 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-13T13:51:43.101 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new f3621acd-3f8b-4f13-842f-b77d2af53155 0 2023-07-13T13:51:43.195 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:43.221+0000 7f4689bdb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T13:51:43.204 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:43.231+0000 7f10db495200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T13:51:43.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.289+0000 7f72c2ba9700 1 Processor -- start 2023-07-13T13:51:43.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.290+0000 7f72c2ba9700 1 -- start start 2023-07-13T13:51:43.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.290+0000 7f72c2ba9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc0ca880 0x7f72bc0b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.290+0000 7f72c2ba9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72bc15c920 0x7f72bc158870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.290+0000 7f72c2ba9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0c8740 con 0x7f72bc0c8370 2023-07-13T13:51:43.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.290+0000 7f72c2ba9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc0b3180 con 0x7f72bc15c920 2023-07-13T13:51:43.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.290+0000 7f72c2ba9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc15cd80 con 0x7f72bc0ca880 2023-07-13T13:51:43.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.291+0000 7f72c1146700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72bc15c920 0x7f72bc158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.265 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.291+0000 7f72c0945700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f72bc0c8370 0x7f72bc0c9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.123:52552/0 (socket says 172.21.15.123:52552) 2023-07-13T13:51:43.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.291+0000 7f72c0945700 1 -- 172.21.15.123:0/1155045613 learned_addr learned my addr 172.21.15.123:0/1155045613 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-13T13:51:43.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.291+0000 7f72bbfff700 1 --2- 172.21.15.123:0/1155045613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc0ca880 0x7f72bc0b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.294+0000 7f72c1146700 1 -- 172.21.15.123:0/1155045613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc0ca880 msgr2=0x7f72bc0b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.294+0000 7f72c1146700 1 --2- 172.21.15.123:0/1155045613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc0ca880 0x7f72bc0b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.294+0000 7f72c1146700 1 -- 172.21.15.123:0/1155045613 >> v1:172.21.15.118:6789/0 conn(0x7f72bc0c8370 legacy=0x7f72bc0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:43.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.294+0000 7f72c1146700 1 -- 172.21.15.123:0/1155045613 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc15be80 con 0x7f72bc15c920 2023-07-13T13:51:43.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.296+0000 7f72c1146700 1 --2- 172.21.15.123:0/1155045613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc15c920 0x7f72bc158870 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009d90 tx=0x7f72b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b20243049d1b22f server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:43.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.298+0000 7f72bb7fe700 1 -- 172.21.15.123:0/1155045613 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400e070 con 0x7f72bc15c920 2023-07-13T13:51:43.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.299+0000 7f72bb7fe700 1 -- 172.21.15.123:0/1155045613 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b400bb20 con 0x7f72bc15c920 2023-07-13T13:51:43.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.299+0000 7f72bb7fe700 1 -- 172.21.15.123:0/1155045613 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4012430 con 0x7f72bc15c920 2023-07-13T13:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.300+0000 7f72c2ba9700 1 -- 172.21.15.123:0/1155045613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc15c920 msgr2=0x7f72bc158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.300+0000 7f72c2ba9700 1 --2- 172.21.15.123:0/1155045613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc15c920 0x7f72bc158870 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009d90 tx=0x7f72b400b330 comp rx=0 tx=0).stop 2023-07-13T13:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.300+0000 7f72c2ba9700 1 -- 172.21.15.123:0/1155045613 shutdown_connections 2023-07-13T13:51:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.300+0000 7f72c2ba9700 1 --2- 172.21.15.123:0/1155045613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc15c920 0x7f72bc158870 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.300+0000 7f72c2ba9700 1 --2- 172.21.15.123:0/1155045613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc0ca880 0x7f72bc0b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.300+0000 7f72c2ba9700 1 -- 172.21.15.123:0/1155045613 >> 172.21.15.123:0/1155045613 conn(0x7f72bc065af0 msgr2=0x7f72bc065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:43.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.300+0000 7f72c2ba9700 1 -- 172.21.15.123:0/1155045613 shutdown_connections 2023-07-13T13:51:43.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.300+0000 7f72c2ba9700 1 -- 172.21.15.123:0/1155045613 wait complete. 2023-07-13T13:51:43.275 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.302+0000 7f72c2ba9700 1 Processor -- start 2023-07-13T13:51:43.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.302+0000 7f72c2ba9700 1 -- start start 2023-07-13T13:51:43.276 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.303+0000 7f72c2ba9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72bc0c8370 0x7f72bc1e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.303+0000 7f72c2ba9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc0ca880 0x7f72bc152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.303+0000 7f72c2ba9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc15c920 0x7f72bc1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.303+0000 7f72c2ba9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0c5740 con 0x7f72bc0c8370 2023-07-13T13:51:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.303+0000 7f72c2ba9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc06bf90 con 0x7f72bc0ca880 2023-07-13T13:51:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.303+0000 7f72c2ba9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc155af0 con 0x7f72bc15c920 2023-07-13T13:51:43.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.303+0000 7f72bbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc0ca880 0x7f72bc152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.303+0000 7f72c1146700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc15c920 0x7f72bc1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.304+0000 7f72bbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc0ca880 0x7f72bc152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32908/0 (socket says 172.21.15.123:32908) 2023-07-13T13:51:43.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.304+0000 7f72bbfff700 1 -- 172.21.15.123:0/271553841 learned_addr learned my addr 172.21.15.123:0/271553841 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.307+0000 7f72c0945700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72bc0c8370 0x7f72bc1e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.309+0000 7f72bbfff700 1 -- 172.21.15.123:0/271553841 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc15c920 msgr2=0x7f72bc1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:43.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.309+0000 7f72bbfff700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc15c920 0x7f72bc1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.309+0000 7f72bbfff700 1 -- 172.21.15.123:0/271553841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72bc0c8370 msgr2=0x7f72bc1e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:43.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.309+0000 7f72bbfff700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72bc0c8370 0x7f72bc1e5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.309+0000 7f72bbfff700 1 -- 172.21.15.123:0/271553841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4009a70 con 0x7f72bc0ca880 2023-07-13T13:51:43.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.309+0000 7f72c1146700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc15c920 0x7f72bc1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:51:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.312+0000 7f72bbfff700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc0ca880 0x7f72bc152ac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72a800e9b0 tx=0x7f72a800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.316+0000 7f72b97fa700 1 -- 172.21.15.123:0/271553841 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8009710 con 0x7f72bc0ca880 2023-07-13T13:51:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.316+0000 7f72b97fa700 1 -- 172.21.15.123:0/271553841 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a800ee50 con 0x7f72bc0ca880 2023-07-13T13:51:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.316+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc0c5180 con 0x7f72bc0ca880 2023-07-13T13:51:43.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.316+0000 7f72b97fa700 1 -- 172.21.15.123:0/271553841 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a800ca50 con 0x7f72bc0ca880 2023-07-13T13:51:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.316+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc1e37e0 con 0x7f72bc0ca880 2023-07-13T13:51:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.317+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc1e3610 con 0x7f72bc0ca880 2023-07-13T13:51:43.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.424+0000 7f72b97fa700 1 -- 172.21.15.123:0/271553841 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72a8005a20 con 0x7f72bc0ca880 2023-07-13T13:51:43.398 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.424+0000 7f72b97fa700 1 -- 172.21.15.123:0/271553841 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f72a80137b0 con 0x7f72bc0ca880 2023-07-13T13:51:43.399 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.424+0000 7f72b97fa700 1 -- 172.21.15.123:0/271553841 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f72a8021060 con 0x7f72bc0ca880 2023-07-13T13:51:43.399 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:43.426+0000 7f10db495200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T13:51:43.399 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:43.426+0000 7f4689bdb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T13:51:43.483 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.509+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f3621acd-3f8b-4f13-842f-b77d2af53155", "id": 0} v 0) v1 -- 0x7f72bc15c0d0 con 0x7f72bc0ca880 2023-07-13T13:51:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.706+0000 7f72b97fa700 1 -- 172.21.15.123:0/271553841 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3621acd-3f8b-4f13-842f-b77d2af53155", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72a8017070 con 0x7f72bc0ca880 2023-07-13T13:51:43.680 INFO:teuthology.orchestra.run.smithi123.stdout:0 2023-07-13T13:51:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc0ca880 msgr2=0x7f72bc152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc0ca880 0x7f72bc152ac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72a800e9b0 tx=0x7f72a800ecc0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 shutdown_connections 2023-07-13T13:51:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72bc15c920 0x7f72bc1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72bc0c8370 0x7f72bc1e5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 --2- 172.21.15.123:0/271553841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72bc0ca880 0x7f72bc152ac0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 >> 172.21.15.123:0/271553841 conn(0x7f72bc065af0 msgr2=0x7f72bc0cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 shutdown_connections 2023-07-13T13:51:43.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.707+0000 7f72c2ba9700 1 -- 172.21.15.123:0/271553841 wait complete. 2023-07-13T13:51:43.693 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 8c95fa14-1c18-4706-8f63-f39c33c31218 1 2023-07-13T13:51:43.772 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:43.799+0000 7f10db495200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T13:51:43.783 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:43.810+0000 7f4689bdb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T13:51:43.820 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.847+0000 7f25f15e9700 1 Processor -- start 2023-07-13T13:51:43.821 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.847+0000 7f25f15e9700 1 -- start start 2023-07-13T13:51:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25f15e9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f25ec1507d0 0x7f25ec15a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25f15e9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25ec1565e0 0x7f25ec06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25f15e9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec0c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25f15e9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ec0c1820 con 0x7f25ec1565e0 2023-07-13T13:51:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25f15e9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ec0c1b00 con 0x7f25ec1507d0 2023-07-13T13:51:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25f15e9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0c1de0 con 0x7f25ec070000 2023-07-13T13:51:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25ea7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25ec1565e0 0x7f25ec06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25eaffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f25ec1507d0 0x7f25ec15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.848+0000 7f25eb7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec0c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.849+0000 7f25eb7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec0c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:38870/0 (socket says 172.21.15.123:38870) 2023-07-13T13:51:43.823 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.849+0000 7f25eb7fe700 1 -- 172.21.15.123:0/1126630171 learned_addr learned my addr 172.21.15.123:0/1126630171 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.851+0000 7f25eb7fe700 1 -- 172.21.15.123:0/1126630171 >> v2:172.21.15.123:3300/0 conn(0x7f25ec1507d0 msgr2=0x7f25ec15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.851+0000 7f25eb7fe700 1 --2- 172.21.15.123:0/1126630171 >> v2:172.21.15.123:3300/0 conn(0x7f25ec1507d0 0x7f25ec15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.851+0000 7f25eb7fe700 1 -- 172.21.15.123:0/1126630171 >> v2:172.21.15.118:3300/0 conn(0x7f25ec1565e0 msgr2=0x7f25ec06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.851+0000 7f25eb7fe700 1 --2- 172.21.15.123:0/1126630171 >> v2:172.21.15.118:3300/0 conn(0x7f25ec1565e0 0x7f25ec06fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.826 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.851+0000 7f25eb7fe700 1 -- 172.21.15.123:0/1126630171 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec159d00 con 0x7f25ec070000 2023-07-13T13:51:43.827 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.853+0000 7f25eb7fe700 1 --2- 172.21.15.123:0/1126630171 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec0c6fc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f25ec071cd0 tx=0x7f25e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e5e05b3a41a8be6 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:43.830 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.857+0000 7f25e9ffb700 1 -- 172.21.15.123:0/1126630171 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400e070 con 0x7f25ec070000 2023-07-13T13:51:43.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25e9ffb700 1 -- 172.21.15.123:0/1126630171 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400b910 con 0x7f25ec070000 2023-07-13T13:51:43.833 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25e9ffb700 1 -- 172.21.15.123:0/1126630171 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400bcc0 con 0x7f25ec070000 2023-07-13T13:51:43.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 -- 172.21.15.123:0/1126630171 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 msgr2=0x7f25ec0c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:43.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 --2- 172.21.15.123:0/1126630171 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec0c6fc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f25ec071cd0 tx=0x7f25e400b330 comp rx=0 tx=0).stop 2023-07-13T13:51:43.834 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 -- 172.21.15.123:0/1126630171 shutdown_connections 2023-07-13T13:51:43.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 --2- 172.21.15.123:0/1126630171 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec0c6fc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 --2- 172.21.15.123:0/1126630171 >> v2:172.21.15.123:3300/0 conn(0x7f25ec1507d0 0x7f25ec15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 --2- 172.21.15.123:0/1126630171 >> v2:172.21.15.118:3300/0 conn(0x7f25ec1565e0 0x7f25ec06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 -- 172.21.15.123:0/1126630171 >> 172.21.15.123:0/1126630171 conn(0x7f25ec06e060 msgr2=0x7f25ec06eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:43.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 -- 172.21.15.123:0/1126630171 shutdown_connections 2023-07-13T13:51:43.835 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.860+0000 7f25f15e9700 1 -- 172.21.15.123:0/1126630171 wait complete. 2023-07-13T13:51:43.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.862+0000 7f25f15e9700 1 Processor -- start 2023-07-13T13:51:43.836 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.862+0000 7f25f15e9700 1 -- start start 2023-07-13T13:51:43.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.863+0000 7f25f15e9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec1464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.863+0000 7f25f15e9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ec1507d0 0x7f25ec1ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.863+0000 7f25f15e9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25ec1565e0 0x7f25ec1df720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:43.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.863+0000 7f25f15e9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0b14a0 con 0x7f25ec1565e0 2023-07-13T13:51:43.837 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.863+0000 7f25f15e9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0b21b0 con 0x7f25ec1507d0 2023-07-13T13:51:43.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.863+0000 7f25f15e9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0b2470 con 0x7f25ec070000 2023-07-13T13:51:43.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.863+0000 7f25eb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25ec1565e0 0x7f25ec1df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.863+0000 7f25ea7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ec1507d0 0x7f25ec1ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:43.838 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.864+0000 7f25eb7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25ec1565e0 0x7f25ec1df720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.123:35916/0 (socket says 172.21.15.123:35916) 2023-07-13T13:51:43.839 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.864+0000 7f25eb7fe700 1 -- 172.21.15.123:0/1711645753 learned_addr learned my addr 172.21.15.123:0/1711645753 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.867+0000 7f25eb7fe700 1 -- 172.21.15.123:0/1711645753 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 msgr2=0x7f25ec1464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.867+0000 7f25eb7fe700 1 --2- 172.21.15.123:0/1711645753 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec1464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.867+0000 7f25eb7fe700 1 -- 172.21.15.123:0/1711645753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ec1507d0 msgr2=0x7f25ec1ebe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:43.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.867+0000 7f25eb7fe700 1 --2- 172.21.15.123:0/1711645753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ec1507d0 0x7f25ec1ebe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:43.842 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.868+0000 7f25eb7fe700 1 -- 172.21.15.123:0/1711645753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4009b30 con 0x7f25ec1565e0 2023-07-13T13:51:43.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.870+0000 7f25eb7fe700 1 --2- 172.21.15.123:0/1711645753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25ec1565e0 0x7f25ec1df720 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0c1f20 tx=0x7f25e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.874+0000 7f25d37fe700 1 -- 172.21.15.123:0/1711645753 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e40092e0 con 0x7f25ec1565e0 2023-07-13T13:51:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.874+0000 7f25d37fe700 1 -- 172.21.15.123:0/1711645753 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400ce80 con 0x7f25ec1565e0 2023-07-13T13:51:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.874+0000 7f25d37fe700 1 -- 172.21.15.123:0/1711645753 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4004490 con 0x7f25ec1565e0 2023-07-13T13:51:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.874+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec0af7a0 con 0x7f25ec1565e0 2023-07-13T13:51:43.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.874+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ec0b1740 con 0x7f25ec1565e0 2023-07-13T13:51:43.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.875+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ec0b1960 con 0x7f25ec1565e0 2023-07-13T13:51:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.879+0000 7f25d37fe700 1 -- 172.21.15.123:0/1711645753 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f25e401c440 con 0x7f25ec1565e0 2023-07-13T13:51:43.853 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:43.879+0000 7f25d37fe700 1 -- 172.21.15.123:0/1711645753 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f25e402e7e0 con 0x7f25ec1565e0 2023-07-13T13:51:43.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.004+0000 7f25d37fe700 1 -- 172.21.15.123:0/1711645753 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f25e4020030 con 0x7f25ec1565e0 2023-07-13T13:51:44.060 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.086+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c95fa14-1c18-4706-8f63-f39c33c31218", "id": 1} v 0) v1 -- 0x7f25ec0c2090 con 0x7f25ec1565e0 2023-07-13T13:51:44.131 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.157+0000 7f25d37fe700 1 -- 172.21.15.123:0/1711645753 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c95fa14-1c18-4706-8f63-f39c33c31218", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f25e402ec30 con 0x7f25ec1565e0 2023-07-13T13:51:44.131 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-07-13T13:51:44.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25ec1565e0 msgr2=0x7f25ec1df720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 --2- 172.21.15.123:0/1711645753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25ec1565e0 0x7f25ec1df720 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0c1f20 tx=0x7f25e4004ad0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.132 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 shutdown_connections 2023-07-13T13:51:44.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 --2- 172.21.15.123:0/1711645753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25ec1565e0 0x7f25ec1df720 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 --2- 172.21.15.123:0/1711645753 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f25ec070000 0x7f25ec1464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 --2- 172.21.15.123:0/1711645753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25ec1507d0 0x7f25ec1ebe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 >> 172.21.15.123:0/1711645753 conn(0x7f25ec06e060 msgr2=0x7f25ec0c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:44.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 shutdown_connections 2023-07-13T13:51:44.133 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.158+0000 7f25f15e9700 1 -- 172.21.15.123:0/1711645753 wait complete. 2023-07-13T13:51:44.146 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 440590bc-7a10-4ddb-b42c-f77cbd1d914d 2 2023-07-13T13:51:44.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.294+0000 7f6164c35700 1 Processor -- start 2023-07-13T13:51:44.268 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.294+0000 7f6164c35700 1 -- start start 2023-07-13T13:51:44.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.295+0000 7f6164c35700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f61601529b0 0x7f61600c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.295+0000 7f6164c35700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6160159500 0x7f61600c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.295+0000 7f6164c35700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600af1f0 con 0x7f6160152d80 2023-07-13T13:51:44.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.295+0000 7f6164c35700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6160158810 con 0x7f61601529b0 2023-07-13T13:51:44.269 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.295+0000 7f6164c35700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61600c1b20 con 0x7f6160159500 2023-07-13T13:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.295+0000 7f615ed9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6160159500 0x7f61600c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.296+0000 7f615e59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f61601529b0 0x7f61600c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.296+0000 7f615dd9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6160152d80 0x7f616015bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49590/0 (socket says 172.21.15.123:49590) 2023-07-13T13:51:44.270 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.296+0000 7f615dd9b700 1 -- 172.21.15.123:0/3439647145 learned_addr learned my addr 172.21.15.123:0/3439647145 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-13T13:51:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.298+0000 7f615ed9d700 1 -- 172.21.15.123:0/3439647145 >> v2:172.21.15.118:3300/0 conn(0x7f61601529b0 msgr2=0x7f61600c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.298+0000 7f615ed9d700 1 --2- 172.21.15.123:0/3439647145 >> v2:172.21.15.118:3300/0 conn(0x7f61601529b0 0x7f61600c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.298+0000 7f615ed9d700 1 -- 172.21.15.123:0/3439647145 >> v1:172.21.15.123:6789/0 conn(0x7f6160152d80 legacy=0x7f616015bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.273 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.298+0000 7f615ed9d700 1 -- 172.21.15.123:0/3439647145 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600c1e00 con 0x7f6160159500 2023-07-13T13:51:44.274 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.300+0000 7f615ed9d700 1 --2- 172.21.15.123:0/3439647145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6160159500 0x7f61600c6fc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6158009d90 tx=0x7f615800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29da1a98b4a867cf server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:44.278 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f615d59a700 1 -- 172.21.15.123:0/3439647145 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800e070 con 0x7f6160159500 2023-07-13T13:51:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f615d59a700 1 -- 172.21.15.123:0/3439647145 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800bb20 con 0x7f6160159500 2023-07-13T13:51:44.279 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f615d59a700 1 -- 172.21.15.123:0/3439647145 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158012430 con 0x7f6160159500 2023-07-13T13:51:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f6164c35700 1 -- 172.21.15.123:0/3439647145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6160159500 msgr2=0x7f61600c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f6164c35700 1 --2- 172.21.15.123:0/3439647145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6160159500 0x7f61600c6fc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6158009d90 tx=0x7f615800b330 comp rx=0 tx=0).stop 2023-07-13T13:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f6164c35700 1 -- 172.21.15.123:0/3439647145 shutdown_connections 2023-07-13T13:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f6164c35700 1 --2- 172.21.15.123:0/3439647145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6160159500 0x7f61600c6fc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f6164c35700 1 --2- 172.21.15.123:0/3439647145 >> v2:172.21.15.118:3300/0 conn(0x7f61601529b0 0x7f61600c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.305+0000 7f6164c35700 1 -- 172.21.15.123:0/3439647145 >> 172.21.15.123:0/3439647145 conn(0x7f616006e060 msgr2=0x7f616006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:44.281 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.306+0000 7f6164c35700 1 -- 172.21.15.123:0/3439647145 shutdown_connections 2023-07-13T13:51:44.282 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.306+0000 7f6164c35700 1 -- 172.21.15.123:0/3439647145 wait complete. 2023-07-13T13:51:44.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.307+0000 7f6164c35700 1 Processor -- start 2023-07-13T13:51:44.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.307+0000 7f6164c35700 1 -- start start 2023-07-13T13:51:44.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f6164c35700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61601529b0 0x7f6160147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f6164c35700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6160152d80 0x7f616006fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.283 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f6164c35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6160159500 0x7f6160070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f6164c35700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600cbbc0 con 0x7f6160159500 2023-07-13T13:51:44.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f6164c35700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600cb5e0 con 0x7f6160152d80 2023-07-13T13:51:44.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f6164c35700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61601f1ea0 con 0x7f61601529b0 2023-07-13T13:51:44.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f615e59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61601529b0 0x7f6160147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f615dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6160152d80 0x7f616006fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.308+0000 7f615ed9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6160159500 0x7f6160070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.284 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.309+0000 7f615e59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61601529b0 0x7f6160147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:38890/0 (socket says 172.21.15.123:38890) 2023-07-13T13:51:44.285 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.309+0000 7f615e59c700 1 -- 172.21.15.123:0/4258967092 learned_addr learned my addr 172.21.15.123:0/4258967092 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.312+0000 7f615e59c700 1 -- 172.21.15.123:0/4258967092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6160152d80 msgr2=0x7f616006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.312+0000 7f615e59c700 1 --2- 172.21.15.123:0/4258967092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6160152d80 0x7f616006fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.312+0000 7f615e59c700 1 -- 172.21.15.123:0/4258967092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6160159500 msgr2=0x7f6160070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.286 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.312+0000 7f615e59c700 1 --2- 172.21.15.123:0/4258967092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6160159500 0x7f6160070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.287 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.312+0000 7f615e59c700 1 -- 172.21.15.123:0/4258967092 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009a70 con 0x7f61601529b0 2023-07-13T13:51:44.288 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.315+0000 7f615e59c700 1 --2- 172.21.15.123:0/4258967092 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61601529b0 0x7f6160147900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f615000e9b0 tx=0x7f615000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:44.290 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.317+0000 7f614effd700 1 -- 172.21.15.123:0/4258967092 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150009710 con 0x7f61601529b0 2023-07-13T13:51:44.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.317+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61601f2180 con 0x7f61601529b0 2023-07-13T13:51:44.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.317+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6160147e40 con 0x7f61601529b0 2023-07-13T13:51:44.291 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.318+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616004e280 con 0x7f61601529b0 2023-07-13T13:51:44.467 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:44.494+0000 7f10db495200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T13:51:44.514 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:44.540+0000 7f4689bdb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T13:51:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.544+0000 7f614effd700 1 -- 172.21.15.123:0/4258967092 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000ee50 con 0x7f61601529b0 2023-07-13T13:51:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.544+0000 7f614effd700 1 -- 172.21.15.123:0/4258967092 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150005c20 con 0x7f61601529b0 2023-07-13T13:51:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.544+0000 7f614effd700 1 -- 172.21.15.123:0/4258967092 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f615000cbb0 con 0x7f61601529b0 2023-07-13T13:51:44.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.544+0000 7f614effd700 1 -- 172.21.15.123:0/4258967092 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f6150006780 con 0x7f61601529b0 2023-07-13T13:51:44.519 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.544+0000 7f614effd700 1 -- 172.21.15.123:0/4258967092 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6150021060 con 0x7f61601529b0 2023-07-13T13:51:44.539 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:44.567+0000 7f10db495200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T13:51:44.589 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:44.616+0000 7f4689bdb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T13:51:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.630+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "440590bc-7a10-4ddb-b42c-f77cbd1d914d", "id": 2} v 0) v1 -- 0x7f616006de40 con 0x7f61601529b0 2023-07-13T13:51:44.675 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:44.702+0000 7f10db495200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T13:51:44.732 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:44.758+0000 7f4689bdb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T13:51:44.752 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:44.779+0000 7f10db495200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T13:51:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.780+0000 7f614effd700 1 -- 172.21.15.123:0/4258967092 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "440590bc-7a10-4ddb-b42c-f77cbd1d914d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6150017070 con 0x7f61601529b0 2023-07-13T13:51:44.754 INFO:teuthology.orchestra.run.smithi123.stdout:2 2023-07-13T13:51:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61601529b0 msgr2=0x7f6160147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 --2- 172.21.15.123:0/4258967092 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61601529b0 0x7f6160147900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f615000e9b0 tx=0x7f615000ecc0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 shutdown_connections 2023-07-13T13:51:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 --2- 172.21.15.123:0/4258967092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6160159500 0x7f6160070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 --2- 172.21.15.123:0/4258967092 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f61601529b0 0x7f6160147900 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 --2- 172.21.15.123:0/4258967092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6160152d80 0x7f616006fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 >> 172.21.15.123:0/4258967092 conn(0x7f616006e060 msgr2=0x7f616014cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 shutdown_connections 2023-07-13T13:51:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.781+0000 7f6164c35700 1 -- 172.21.15.123:0/4258967092 wait complete. 2023-07-13T13:51:44.767 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new f0d830ad-d6c9-4d6c-aa48-c354454d4657 3 2023-07-13T13:51:44.814 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:44.840+0000 7f4689bdb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T13:51:44.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.921+0000 7f47a2bd3700 1 Processor -- start 2023-07-13T13:51:44.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.921+0000 7f47a2bd3700 1 -- start start 2023-07-13T13:51:44.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.922+0000 7f47a2bd3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f479c1507d0 0x7f479c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.896 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.923+0000 7f47a2bd3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0c1820 con 0x7f479c1565e0 2023-07-13T13:51:44.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.923+0000 7f47a2bd3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0c1b00 con 0x7f479c0c6fc0 2023-07-13T13:51:44.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.923+0000 7f47a2bd3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0c1de0 con 0x7f479c1507d0 2023-07-13T13:51:44.897 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.923+0000 7f47a1170700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f479c0c6fc0 0x7f479c160f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49600/0 (socket says 172.21.15.123:49600) 2023-07-13T13:51:44.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.923+0000 7f47a1170700 1 -- 172.21.15.123:0/159821129 learned_addr learned my addr 172.21.15.123:0/159821129 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-13T13:51:44.898 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.923+0000 7f47a096f700 1 --2- 172.21.15.123:0/159821129 >> v2:172.21.15.118:3300/0 conn(0x7f479c1507d0 0x7f479c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.926+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166641937 0 0) 0x7f479c0c1b00 con 0x7f479c0c6fc0 2023-07-13T13:51:44.900 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.926+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f478c0035b0 con 0x7f479c0c6fc0 2023-07-13T13:51:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.930+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807259343 0 0) 0x7f478c0035b0 con 0x7f479c0c6fc0 2023-07-13T13:51:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.930+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 >> v2:172.21.15.118:3300/0 conn(0x7f479c1507d0 msgr2=0x7f479c15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.930+0000 7f479b7fe700 1 --2- 172.21.15.123:0/159821129 >> v2:172.21.15.118:3300/0 conn(0x7f479c1507d0 0x7f479c15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.930+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 >> v1:172.21.15.118:6789/0 conn(0x7f479c1565e0 legacy=0x7f479c06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.930+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c159d00 con 0x7f479c0c6fc0 2023-07-13T13:51:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.930+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402946124 0 0) 0x7f47940019f0 con 0x7f479c0c6fc0 2023-07-13T13:51:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.930+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 >> v1:172.21.15.123:6789/0 conn(0x7f479c0c6fc0 legacy=0x7f479c160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.931+0000 7f479b7fe700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f478c003a50 0x7f478c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.931+0000 7f479b7fe700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f478c004850 0x7f478c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.931+0000 7f479b7fe700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c005250 0x7f478c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.931+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0c1de0 con 0x7f478c003a50 2023-07-13T13:51:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.931+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c00c160 con 0x7f478c005250 2023-07-13T13:51:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.931+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c00c320 con 0x7f478c004850 2023-07-13T13:51:44.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.931+0000 7f479bfff700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f478c004850 0x7f478c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.932+0000 7f47a1170700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c005250 0x7f478c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.908 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.935+0000 7f479bfff700 1 -- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c005250 msgr2=0x7f478c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.935+0000 7f479bfff700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c005250 0x7f478c00ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.935+0000 7f479bfff700 1 -- 172.21.15.123:0/159821129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f478c003a50 msgr2=0x7f478c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.935+0000 7f479bfff700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f478c003a50 0x7f478c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.935+0000 7f479bfff700 1 -- 172.21.15.123:0/159821129 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c0035b0 con 0x7f478c004850 2023-07-13T13:51:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.935+0000 7f47a1170700 1 -- 172.21.15.123:0/159821129 reap_dead start 2023-07-13T13:51:44.911 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.937+0000 7f479bfff700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f478c004850 0x7f478c004cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f47880017c0 tx=0x7f478c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acd647911c92a164 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.942+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880052d0 con 0x7f478c004850 2023-07-13T13:51:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.942+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788005430 con 0x7f478c004850 2023-07-13T13:51:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.942+0000 7f479b7fe700 1 -- 172.21.15.123:0/159821129 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880038c0 con 0x7f478c004850 2023-07-13T13:51:44.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.943+0000 7f47a2bd3700 1 -- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f478c004850 msgr2=0x7f478c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.943+0000 7f47a2bd3700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f478c004850 0x7f478c004cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f47880017c0 tx=0x7f478c005880 comp rx=0 tx=0).stop 2023-07-13T13:51:44.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.943+0000 7f47a2bd3700 1 -- 172.21.15.123:0/159821129 shutdown_connections 2023-07-13T13:51:44.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.943+0000 7f47a2bd3700 1 --2- 172.21.15.123:0/159821129 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f478c004850 0x7f478c004cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.917 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.943+0000 7f47a2bd3700 1 -- 172.21.15.123:0/159821129 >> 172.21.15.123:0/159821129 conn(0x7f479c06e060 msgr2=0x7f479c06eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:44.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.943+0000 7f47a2bd3700 1 -- 172.21.15.123:0/159821129 shutdown_connections 2023-07-13T13:51:44.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.943+0000 7f47a2bd3700 1 -- 172.21.15.123:0/159821129 wait complete. 2023-07-13T13:51:44.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.944+0000 7f47a2bd3700 1 Processor -- start 2023-07-13T13:51:44.918 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.944+0000 7f47a2bd3700 1 -- start start 2023-07-13T13:51:44.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.945+0000 7f47a2bd3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c004850 0x7f479c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.945+0000 7f47a2bd3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f479c14c060 0x7f479c1df180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.945+0000 7f47a2bd3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f479c1efbc0 0x7f479c1f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:44.920 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.945+0000 7f47a2bd3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c1ef770 con 0x7f479c1efbc0 2023-07-13T13:51:44.920 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.945+0000 7f47a2bd3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c14d260 con 0x7f478c004850 2023-07-13T13:51:44.920 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.945+0000 7f47a2bd3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0ae840 con 0x7f479c14c060 2023-07-13T13:51:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.946+0000 7f47a1170700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f479c1efbc0 0x7f479c1f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.946+0000 7f47a096f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c004850 0x7f479c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.946+0000 7f479bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f479c14c060 0x7f479c1df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.946+0000 7f47a1170700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f479c1efbc0 0x7f479c1f0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.123:35972/0 (socket says 172.21.15.123:35972) 2023-07-13T13:51:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.946+0000 7f479bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f479c14c060 0x7f479c1df180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:38900/0 (socket says 172.21.15.123:38900) 2023-07-13T13:51:44.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.946+0000 7f47a1170700 1 -- 172.21.15.123:0/1967124328 learned_addr learned my addr 172.21.15.123:0/1967124328 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.950+0000 7f479bfff700 1 -- 172.21.15.123:0/1967124328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c004850 msgr2=0x7f479c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.950+0000 7f479bfff700 1 --2- 172.21.15.123:0/1967124328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c004850 0x7f479c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.950+0000 7f479bfff700 1 -- 172.21.15.123:0/1967124328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f479c1efbc0 msgr2=0x7f479c1f0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.950+0000 7f479bfff700 1 --2- 172.21.15.123:0/1967124328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f479c1efbc0 0x7f479c1f0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:44.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.950+0000 7f479bfff700 1 -- 172.21.15.123:0/1967124328 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c1ebfd0 con 0x7f479c14c060 2023-07-13T13:51:44.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.952+0000 7f479bfff700 1 --2- 172.21.15.123:0/1967124328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f479c14c060 0x7f479c1df180 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4788014000 tx=0x7f4788001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.957+0000 7f47997fa700 1 -- 172.21.15.123:0/1967124328 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788007240 con 0x7f479c14c060 2023-07-13T13:51:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.957+0000 7f47997fa700 1 -- 172.21.15.123:0/1967124328 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47880073a0 con 0x7f479c14c060 2023-07-13T13:51:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.957+0000 7f47997fa700 1 -- 172.21.15.123:0/1967124328 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788007730 con 0x7f479c14c060 2023-07-13T13:51:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.957+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c14c460 con 0x7f479c14c060 2023-07-13T13:51:44.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.957+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c14c9c0 con 0x7f479c14c060 2023-07-13T13:51:44.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:44.958+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c0ae840 con 0x7f479c14c060 2023-07-13T13:51:44.940 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:44.967+0000 7f10db495200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T13:51:45.001 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:45.028+0000 7f4689bdb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T13:51:45.018 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:45.045+0000 7f10db495200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T13:51:45.038 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.064+0000 7f47997fa700 1 -- 172.21.15.123:0/1967124328 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4788003980 con 0x7f479c14c060 2023-07-13T13:51:45.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.064+0000 7f47997fa700 1 -- 172.21.15.123:0/1967124328 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4788031910 con 0x7f479c14c060 2023-07-13T13:51:45.039 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.064+0000 7f47997fa700 1 -- 172.21.15.123:0/1967124328 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f478802c060 con 0x7f479c14c060 2023-07-13T13:51:45.082 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:45.108+0000 7f4689bdb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T13:51:45.095 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:45.122+0000 7f10db495200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T13:51:45.120 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.146+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0d830ad-d6c9-4d6c-aa48-c354454d4657", "id": 3} v 0) v1 -- 0x7f479c1ef540 con 0x7f479c14c060 2023-07-13T13:51:45.161 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:45.187+0000 7f4689bdb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T13:51:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.224+0000 7f47997fa700 1 -- 172.21.15.123:0/1967124328 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0d830ad-d6c9-4d6c-aa48-c354454d4657", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f479c1ef540 con 0x7f479c14c060 2023-07-13T13:51:45.198 INFO:teuthology.orchestra.run.smithi123.stdout:3 2023-07-13T13:51:45.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f479c14c060 msgr2=0x7f479c1df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 --2- 172.21.15.123:0/1967124328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f479c14c060 0x7f479c1df180 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4788014000 tx=0x7f4788001120 comp rx=0 tx=0).stop 2023-07-13T13:51:45.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 shutdown_connections 2023-07-13T13:51:45.199 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 --2- 172.21.15.123:0/1967124328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f478c004850 0x7f479c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 --2- 172.21.15.123:0/1967124328 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f479c1efbc0 0x7f479c1f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 --2- 172.21.15.123:0/1967124328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f479c14c060 0x7f479c1df180 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 >> 172.21.15.123:0/1967124328 conn(0x7f479c06e060 msgr2=0x7f479c1549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:45.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 shutdown_connections 2023-07-13T13:51:45.200 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.225+0000 7f47a2bd3700 1 -- 172.21.15.123:0/1967124328 wait complete. 2023-07-13T13:51:45.210 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new ebf94a9d-f1d8-4b84-a42e-c08b4842272c 4 2023-07-13T13:51:45.213 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:45.240+0000 7f10db495200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T13:51:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.356+0000 7f691dce6700 1 Processor -- start 2023-07-13T13:51:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.356+0000 7f691dce6700 1 -- start start 2023-07-13T13:51:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.357+0000 7f691dce6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f69180b36d0 0x7f691815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.357+0000 7f691dce6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69180b3aa0 0x7f6918159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.357+0000 7f691dce6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6918158740 con 0x7f69180ce7e0 2023-07-13T13:51:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.357+0000 7f691dce6700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69180c3af0 con 0x7f69180b36d0 2023-07-13T13:51:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.357+0000 7f691dce6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69180c3dd0 con 0x7f69180b3aa0 2023-07-13T13:51:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.358+0000 7f6916ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69180b3aa0 0x7f6918159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.358+0000 7f69177fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f69180b36d0 0x7f691815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.358+0000 7f6916ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69180b3aa0 0x7f6918159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32962/0 (socket says 172.21.15.123:32962) 2023-07-13T13:51:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.358+0000 7f6916ffd700 1 -- 172.21.15.123:0/4150084850 learned_addr learned my addr 172.21.15.123:0/4150084850 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.361+0000 7f6916ffd700 1 -- 172.21.15.123:0/4150084850 >> v2:172.21.15.118:3300/0 conn(0x7f69180b36d0 msgr2=0x7f691815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.361+0000 7f6916ffd700 1 --2- 172.21.15.123:0/4150084850 >> v2:172.21.15.118:3300/0 conn(0x7f69180b36d0 0x7f691815bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.361+0000 7f6916ffd700 1 -- 172.21.15.123:0/4150084850 >> v1:172.21.15.118:6789/0 conn(0x7f69180ce7e0 legacy=0x7f691806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.361+0000 7f6916ffd700 1 -- 172.21.15.123:0/4150084850 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180c40b0 con 0x7f69180b3aa0 2023-07-13T13:51:45.337 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.362+0000 7f6916ffd700 1 --2- 172.21.15.123:0/4150084850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b3aa0 0x7f6918159200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f691806d1b0 tx=0x7f6908009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5f3995bbfe7306c server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:45.338 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.364+0000 7f69167fc700 1 -- 172.21.15.123:0/4150084850 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908011830 con 0x7f69180b3aa0 2023-07-13T13:51:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f69167fc700 1 -- 172.21.15.123:0/4150084850 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6908011990 con 0x7f69180b3aa0 2023-07-13T13:51:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f69167fc700 1 -- 172.21.15.123:0/4150084850 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908011d20 con 0x7f69180b3aa0 2023-07-13T13:51:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f691dce6700 1 -- 172.21.15.123:0/4150084850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b3aa0 msgr2=0x7f6918159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f691dce6700 1 --2- 172.21.15.123:0/4150084850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b3aa0 0x7f6918159200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f691806d1b0 tx=0x7f6908009bd0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.340 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f691dce6700 1 -- 172.21.15.123:0/4150084850 shutdown_connections 2023-07-13T13:51:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f691dce6700 1 --2- 172.21.15.123:0/4150084850 >> v2:172.21.15.118:3300/0 conn(0x7f69180b36d0 0x7f691815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f691dce6700 1 --2- 172.21.15.123:0/4150084850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b3aa0 0x7f6918159200 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f691dce6700 1 -- 172.21.15.123:0/4150084850 >> 172.21.15.123:0/4150084850 conn(0x7f6918071840 msgr2=0x7f691806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f691dce6700 1 -- 172.21.15.123:0/4150084850 shutdown_connections 2023-07-13T13:51:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.366+0000 7f691dce6700 1 -- 172.21.15.123:0/4150084850 wait complete. 2023-07-13T13:51:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.368+0000 7f691dce6700 1 Processor -- start 2023-07-13T13:51:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.368+0000 7f691dce6700 1 -- start start 2023-07-13T13:51:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.368+0000 7f691dce6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b36d0 0x7f69180cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.368+0000 7f691dce6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69180b3aa0 0x7f69180c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.368+0000 7f691dce6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69180ce7e0 0x7f69181e1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.368+0000 7f691dce6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69181e3c40 con 0x7f69180b3aa0 2023-07-13T13:51:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.368+0000 7f691dce6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69181ee250 con 0x7f69180b36d0 2023-07-13T13:51:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.368+0000 7f691dce6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69181ee4f0 con 0x7f69180ce7e0 2023-07-13T13:51:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.369+0000 7f69177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b36d0 0x7f69180cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.369+0000 7f6916ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69180b3aa0 0x7f69180c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.369+0000 7f6917fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69180ce7e0 0x7f69181e1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.369+0000 7f69177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b36d0 0x7f69180cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32974/0 (socket says 172.21.15.123:32974) 2023-07-13T13:51:45.344 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.369+0000 7f69177fe700 1 -- 172.21.15.123:0/2049043387 learned_addr learned my addr 172.21.15.123:0/2049043387 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.373+0000 7f69177fe700 1 -- 172.21.15.123:0/2049043387 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69180ce7e0 msgr2=0x7f69181e1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.373+0000 7f69177fe700 1 --2- 172.21.15.123:0/2049043387 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69180ce7e0 0x7f69181e1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.373+0000 7f69177fe700 1 -- 172.21.15.123:0/2049043387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69180b3aa0 msgr2=0x7f69180c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.373+0000 7f69177fe700 1 --2- 172.21.15.123:0/2049043387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69180b3aa0 0x7f69180c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.347 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.373+0000 7f69177fe700 1 -- 172.21.15.123:0/2049043387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908009550 con 0x7f69180b36d0 2023-07-13T13:51:45.349 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.376+0000 7f69177fe700 1 --2- 172.21.15.123:0/2049043387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b36d0 0x7f69180cd8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f690000e870 tx=0x7f690000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.378+0000 7f690ffff700 1 -- 172.21.15.123:0/2049043387 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900009590 con 0x7f69180b36d0 2023-07-13T13:51:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.378+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69181ee7d0 con 0x7f69180b36d0 2023-07-13T13:51:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.378+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69180cab40 con 0x7f69180b36d0 2023-07-13T13:51:45.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.379+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691804e280 con 0x7f69180b36d0 2023-07-13T13:51:45.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.379+0000 7f690ffff700 1 -- 172.21.15.123:0/2049043387 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900005a20 con 0x7f69180b36d0 2023-07-13T13:51:45.353 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.379+0000 7f690ffff700 1 -- 172.21.15.123:0/2049043387 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900005db0 con 0x7f69180b36d0 2023-07-13T13:51:45.399 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:45.426+0000 7f10db495200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T13:51:45.441 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:45.467+0000 7f4689bdb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T13:51:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.486+0000 7f690ffff700 1 -- 172.21.15.123:0/2049043387 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f69000139e0 con 0x7f69180b36d0 2023-07-13T13:51:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.486+0000 7f690ffff700 1 -- 172.21.15.123:0/2049043387 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f6900006730 con 0x7f69180b36d0 2023-07-13T13:51:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.486+0000 7f690ffff700 1 -- 172.21.15.123:0/2049043387 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6900021060 con 0x7f69180b36d0 2023-07-13T13:51:45.480 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:45.507+0000 7f10db495200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T13:51:45.549 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.576+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ebf94a9d-f1d8-4b84-a42e-c08b4842272c", "id": 4} v 0) v1 -- 0x7f6918158520 con 0x7f69180b36d0 2023-07-13T13:51:45.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.651+0000 7f690ffff700 1 -- 172.21.15.123:0/2049043387 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ebf94a9d-f1d8-4b84-a42e-c08b4842272c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6900017070 con 0x7f69180b36d0 2023-07-13T13:51:45.625 INFO:teuthology.orchestra.run.smithi123.stdout:4 2023-07-13T13:51:45.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.652+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b36d0 msgr2=0x7f69180cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.652+0000 7f691dce6700 1 --2- 172.21.15.123:0/2049043387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b36d0 0x7f69180cd8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f690000e870 tx=0x7f690000eb80 comp rx=0 tx=0).stop 2023-07-13T13:51:45.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.654+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 shutdown_connections 2023-07-13T13:51:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.654+0000 7f691dce6700 1 --2- 172.21.15.123:0/2049043387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69180b36d0 0x7f69180cd8b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.654+0000 7f691dce6700 1 --2- 172.21.15.123:0/2049043387 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f69180ce7e0 0x7f69181e1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.654+0000 7f691dce6700 1 --2- 172.21.15.123:0/2049043387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69180b3aa0 0x7f69180c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.654+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 >> 172.21.15.123:0/2049043387 conn(0x7f6918071840 msgr2=0x7f691815bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.654+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 shutdown_connections 2023-07-13T13:51:45.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.654+0000 7f691dce6700 1 -- 172.21.15.123:0/2049043387 wait complete. 2023-07-13T13:51:45.636 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:45.663+0000 7f4689bdb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T13:51:45.640 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new c6b6800f-c001-406d-8677-d60d889f5c9b 5 2023-07-13T13:51:45.722 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:45.749+0000 7f4689bdb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T13:51:45.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.789+0000 7f3adecda700 1 Processor -- start 2023-07-13T13:51:45.763 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.789+0000 7f3adecda700 1 -- start start 2023-07-13T13:51:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.790+0000 7f3adecda700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3ad814f790 0x7f3ad8070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.790+0000 7f3adecda700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3ad80720d0 0x7f3ad80c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.790+0000 7f3adecda700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad80c6ca0 con 0x7f3ad8071cc0 2023-07-13T13:51:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.790+0000 7f3adecda700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad80c6160 con 0x7f3ad80720d0 2023-07-13T13:51:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.790+0000 7f3adecda700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad8071430 con 0x7f3ad814f790 2023-07-13T13:51:45.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.791+0000 7f3adca76700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3ad814f790 0x7f3ad8070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.791+0000 7f3ad7fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3ad8071cc0 0x7f3ad80c4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49612/0 (socket says 172.21.15.123:49612) 2023-07-13T13:51:45.765 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.791+0000 7f3ad7fff700 1 -- 172.21.15.123:0/533217127 learned_addr learned my addr 172.21.15.123:0/533217127 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-07-13T13:51:45.768 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.795+0000 7f3adca76700 1 -- 172.21.15.123:0/533217127 >> v2:172.21.15.118:3300/0 conn(0x7f3ad80720d0 msgr2=0x7f3ad80c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:45.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.795+0000 7f3adca76700 1 --2- 172.21.15.123:0/533217127 >> v2:172.21.15.118:3300/0 conn(0x7f3ad80720d0 0x7f3ad80c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.795+0000 7f3adca76700 1 -- 172.21.15.123:0/533217127 >> v1:172.21.15.123:6789/0 conn(0x7f3ad8071cc0 legacy=0x7f3ad80c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.769 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.795+0000 7f3adca76700 1 -- 172.21.15.123:0/533217127 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad80716a0 con 0x7f3ad814f790 2023-07-13T13:51:45.773 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.799+0000 7f3adca76700 1 --2- 172.21.15.123:0/533217127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad814f790 0x7f3ad8070ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3ad806b800 tx=0x7f3acc009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae4fad2928ae7a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:45.776 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:45.803+0000 7f10db495200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T13:51:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.805+0000 7f3ad77fe700 1 -- 172.21.15.123:0/533217127 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc005e30 con 0x7f3ad814f790 2023-07-13T13:51:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.805+0000 7f3ad77fe700 1 -- 172.21.15.123:0/533217127 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc006030 con 0x7f3ad814f790 2023-07-13T13:51:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.805+0000 7f3ad77fe700 1 -- 172.21.15.123:0/533217127 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0063c0 con 0x7f3ad814f790 2023-07-13T13:51:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.806+0000 7f3adecda700 1 -- 172.21.15.123:0/533217127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad814f790 msgr2=0x7f3ad8070ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.806+0000 7f3adecda700 1 --2- 172.21.15.123:0/533217127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad814f790 0x7f3ad8070ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3ad806b800 tx=0x7f3acc009b00 comp rx=0 tx=0).stop 2023-07-13T13:51:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.806+0000 7f3adecda700 1 -- 172.21.15.123:0/533217127 shutdown_connections 2023-07-13T13:51:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.806+0000 7f3adecda700 1 --2- 172.21.15.123:0/533217127 >> v2:172.21.15.118:3300/0 conn(0x7f3ad80720d0 0x7f3ad80c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.806+0000 7f3adecda700 1 --2- 172.21.15.123:0/533217127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad814f790 0x7f3ad8070ef0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.806+0000 7f3adecda700 1 -- 172.21.15.123:0/533217127 >> 172.21.15.123:0/533217127 conn(0x7f3ad806cf60 msgr2=0x7f3ad806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.806+0000 7f3adecda700 1 -- 172.21.15.123:0/533217127 shutdown_connections 2023-07-13T13:51:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.806+0000 7f3adecda700 1 -- 172.21.15.123:0/533217127 wait complete. 2023-07-13T13:51:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.808+0000 7f3adecda700 1 Processor -- start 2023-07-13T13:51:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.808+0000 7f3adecda700 1 -- start start 2023-07-13T13:51:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.809+0000 7f3adecda700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad8071cc0 0x7f3ad81e2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.809+0000 7f3adecda700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80720d0 0x7f3ad81e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.809+0000 7f3adecda700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ad814f790 0x7f3ad81df2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.809+0000 7f3adecda700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80cb0b0 con 0x7f3ad8071cc0 2023-07-13T13:51:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.809+0000 7f3adecda700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80c8680 con 0x7f3ad80720d0 2023-07-13T13:51:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.809+0000 7f3adecda700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80cadd0 con 0x7f3ad814f790 2023-07-13T13:51:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.809+0000 7f3add277700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ad814f790 0x7f3ad81df2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.810+0000 7f3adca76700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad8071cc0 0x7f3ad81e2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.810+0000 7f3add277700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ad814f790 0x7f3ad81df2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:38922/0 (socket says 172.21.15.123:38922) 2023-07-13T13:51:45.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.810+0000 7f3add277700 1 -- 172.21.15.123:0/3297534821 learned_addr learned my addr 172.21.15.123:0/3297534821 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:45.785 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.812+0000 7f3ad7fff700 1 --2- 172.21.15.123:0/3297534821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80720d0 0x7f3ad81e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.814+0000 7f3add277700 1 -- 172.21.15.123:0/3297534821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80720d0 msgr2=0x7f3ad81e3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.814+0000 7f3add277700 1 --2- 172.21.15.123:0/3297534821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80720d0 0x7f3ad81e3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.814+0000 7f3add277700 1 -- 172.21.15.123:0/3297534821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad8071cc0 msgr2=0x7f3ad81e2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:45.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.814+0000 7f3add277700 1 --2- 172.21.15.123:0/3297534821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad8071cc0 0x7f3ad81e2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:45.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.814+0000 7f3add277700 1 -- 172.21.15.123:0/3297534821 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc009430 con 0x7f3ad814f790 2023-07-13T13:51:45.790 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.817+0000 7f3add277700 1 --2- 172.21.15.123:0/3297534821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ad814f790 0x7f3ad81df2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000b970 tx=0x7f3ad000bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:45.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.821+0000 7f3ad57fa700 1 -- 172.21.15.123:0/3297534821 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000c930 con 0x7f3ad814f790 2023-07-13T13:51:45.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.821+0000 7f3ad57fa700 1 -- 172.21.15.123:0/3297534821 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad000cab0 con 0x7f3ad814f790 2023-07-13T13:51:45.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.821+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad80c9390 con 0x7f3ad814f790 2023-07-13T13:51:45.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.821+0000 7f3ad57fa700 1 -- 172.21.15.123:0/3297534821 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000ce60 con 0x7f3ad814f790 2023-07-13T13:51:45.795 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.821+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad8147160 con 0x7f3ad814f790 2023-07-13T13:51:45.796 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.822+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad804e280 con 0x7f3ad814f790 2023-07-13T13:51:45.798 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.824+0000 7f3ad57fa700 1 -- 172.21.15.123:0/3297534821 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3ad001e740 con 0x7f3ad814f790 2023-07-13T13:51:45.855 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:45.882+0000 7f10db495200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T13:51:45.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.933+0000 7f3ad57fa700 1 -- 172.21.15.123:0/3297534821 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3ad0006e40 con 0x7f3ad814f790 2023-07-13T13:51:45.907 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:45.933+0000 7f3ad57fa700 1 -- 172.21.15.123:0/3297534821 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3ad0019070 con 0x7f3ad814f790 2023-07-13T13:51:45.990 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.017+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c6b6800f-c001-406d-8677-d60d889f5c9b", "id": 5} v 0) v1 -- 0x7f3ad806f800 con 0x7f3ad814f790 2023-07-13T13:51:46.026 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:46.052+0000 7f4689bdb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T13:51:46.099 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:46.125+0000 7f4689bdb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T13:51:46.105 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.131+0000 7f3ad57fa700 1 -- 172.21.15.123:0/3297534821 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6b6800f-c001-406d-8677-d60d889f5c9b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ad001eb20 con 0x7f3ad814f790 2023-07-13T13:51:46.106 INFO:teuthology.orchestra.run.smithi123.stdout:5 2023-07-13T13:51:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.132+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ad814f790 msgr2=0x7f3ad81df2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.132+0000 7f3adecda700 1 --2- 172.21.15.123:0/3297534821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ad814f790 0x7f3ad81df2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000b970 tx=0x7f3ad000bc80 comp rx=0 tx=0).stop 2023-07-13T13:51:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.132+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 shutdown_connections 2023-07-13T13:51:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.132+0000 7f3adecda700 1 --2- 172.21.15.123:0/3297534821 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ad814f790 0x7f3ad81df2b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.132+0000 7f3adecda700 1 --2- 172.21.15.123:0/3297534821 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ad8071cc0 0x7f3ad81e2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.132+0000 7f3adecda700 1 --2- 172.21.15.123:0/3297534821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ad80720d0 0x7f3ad81e3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.132+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 >> 172.21.15.123:0/3297534821 conn(0x7f3ad806cf60 msgr2=0x7f3ad80c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.133+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 shutdown_connections 2023-07-13T13:51:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.133+0000 7f3adecda700 1 -- 172.21.15.123:0/3297534821 wait complete. 2023-07-13T13:51:46.118 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 4d277993-aa04-4411-9955-36f262d9c671 6 2023-07-13T13:51:46.239 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.266+0000 7ff65eed7700 1 Processor -- start 2023-07-13T13:51:46.240 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.266+0000 7ff65eed7700 1 -- start start 2023-07-13T13:51:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.267+0000 7ff65eed7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff658070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.267+0000 7ff65eed7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff658071cc0 0x7ff6580c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.267+0000 7ff65eed7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6580c6ca0 con 0x7ff6580720d0 2023-07-13T13:51:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.267+0000 7ff65eed7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6580c6160 con 0x7ff658071cc0 2023-07-13T13:51:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.267+0000 7ff65eed7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff658071430 con 0x7ff65814f790 2023-07-13T13:51:46.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.268+0000 7ff657fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff658071cc0 0x7ff6580c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.268+0000 7ff65cc73700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff658070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.268+0000 7ff65cc73700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff658070ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:39424/0 (socket says 172.21.15.123:39424) 2023-07-13T13:51:46.242 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.268+0000 7ff65cc73700 1 -- 172.21.15.123:0/4238995943 learned_addr learned my addr 172.21.15.123:0/4238995943 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:46.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.271+0000 7ff65cc73700 1 -- 172.21.15.123:0/4238995943 >> v2:172.21.15.118:3300/0 conn(0x7ff658071cc0 msgr2=0x7ff6580c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:46.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.271+0000 7ff65cc73700 1 --2- 172.21.15.123:0/4238995943 >> v2:172.21.15.118:3300/0 conn(0x7ff658071cc0 0x7ff6580c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.244 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.271+0000 7ff65cc73700 1 -- 172.21.15.123:0/4238995943 >> v1:172.21.15.118:6789/0 conn(0x7ff6580720d0 legacy=0x7ff6580c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.245 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.271+0000 7ff65cc73700 1 -- 172.21.15.123:0/4238995943 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6580716a0 con 0x7ff65814f790 2023-07-13T13:51:46.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.272+0000 7ff65cc73700 1 --2- 172.21.15.123:0/4238995943 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff658070ef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff64c006fd0 tx=0x7ff64c00be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97a2eb2ab3716284 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.276+0000 7ff6577fe700 1 -- 172.21.15.123:0/4238995943 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c005e30 con 0x7ff65814f790 2023-07-13T13:51:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.276+0000 7ff6577fe700 1 -- 172.21.15.123:0/4238995943 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c004030 con 0x7ff65814f790 2023-07-13T13:51:46.250 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.276+0000 7ff6577fe700 1 -- 172.21.15.123:0/4238995943 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0043e0 con 0x7ff65814f790 2023-07-13T13:51:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.277+0000 7ff65eed7700 1 -- 172.21.15.123:0/4238995943 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 msgr2=0x7ff658070ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.277+0000 7ff65eed7700 1 --2- 172.21.15.123:0/4238995943 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff658070ef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff64c006fd0 tx=0x7ff64c00be70 comp rx=0 tx=0).stop 2023-07-13T13:51:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.277+0000 7ff65eed7700 1 -- 172.21.15.123:0/4238995943 shutdown_connections 2023-07-13T13:51:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.277+0000 7ff65eed7700 1 --2- 172.21.15.123:0/4238995943 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff658070ef0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.277+0000 7ff65eed7700 1 --2- 172.21.15.123:0/4238995943 >> v2:172.21.15.118:3300/0 conn(0x7ff658071cc0 0x7ff6580c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.277+0000 7ff65eed7700 1 -- 172.21.15.123:0/4238995943 >> 172.21.15.123:0/4238995943 conn(0x7ff65806cf60 msgr2=0x7ff65806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.277+0000 7ff65eed7700 1 -- 172.21.15.123:0/4238995943 shutdown_connections 2023-07-13T13:51:46.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.277+0000 7ff65eed7700 1 -- 172.21.15.123:0/4238995943 wait complete. 2023-07-13T13:51:46.252 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.278+0000 7ff65eed7700 1 Processor -- start 2023-07-13T13:51:46.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.278+0000 7ff65eed7700 1 -- start start 2023-07-13T13:51:46.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.279+0000 7ff65eed7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff658071cc0 0x7ff6581eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.279+0000 7ff65eed7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6580720d0 0x7ff65814c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.279+0000 7ff65eed7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff6581460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.279+0000 7ff65eed7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814d690 con 0x7ff6580720d0 2023-07-13T13:51:46.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.279+0000 7ff65eed7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6581ee000 con 0x7ff658071cc0 2023-07-13T13:51:46.253 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.279+0000 7ff65eed7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814e680 con 0x7ff65814f790 2023-07-13T13:51:46.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.279+0000 7ff657fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6580720d0 0x7ff65814c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.279+0000 7ff65cc73700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff658071cc0 0x7ff6581eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.280+0000 7ff65d474700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff6581460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.254 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.280+0000 7ff657fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6580720d0 0x7ff65814c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.123:39648/0 (socket says 172.21.15.123:39648) 2023-07-13T13:51:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.280+0000 7ff657fff700 1 -- 172.21.15.123:0/10128512 learned_addr learned my addr 172.21.15.123:0/10128512 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.283+0000 7ff657fff700 1 -- 172.21.15.123:0/10128512 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 msgr2=0x7ff6581460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.283+0000 7ff657fff700 1 --2- 172.21.15.123:0/10128512 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff6581460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.283+0000 7ff657fff700 1 -- 172.21.15.123:0/10128512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff658071cc0 msgr2=0x7ff6581eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.283+0000 7ff657fff700 1 --2- 172.21.15.123:0/10128512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff658071cc0 0x7ff6581eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.257 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.283+0000 7ff657fff700 1 -- 172.21.15.123:0/10128512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c00b7a0 con 0x7ff6580720d0 2023-07-13T13:51:46.259 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.286+0000 7ff657fff700 1 --2- 172.21.15.123:0/10128512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6580720d0 0x7ff65814c650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e870 tx=0x7ff64400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:46.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.289+0000 7ff6557fa700 1 -- 172.21.15.123:0/10128512 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644009590 con 0x7ff6580720d0 2023-07-13T13:51:46.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.289+0000 7ff6557fa700 1 -- 172.21.15.123:0/10128512 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff644013680 con 0x7ff6580720d0 2023-07-13T13:51:46.263 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.289+0000 7ff6557fa700 1 -- 172.21.15.123:0/10128512 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6440139f0 con 0x7ff6580720d0 2023-07-13T13:51:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.289+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65814e960 con 0x7ff6580720d0 2023-07-13T13:51:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.289+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6581ee2c0 con 0x7ff6580720d0 2023-07-13T13:51:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.291+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65804e280 con 0x7ff6580720d0 2023-07-13T13:51:46.266 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.293+0000 7ff6557fa700 1 -- 172.21.15.123:0/10128512 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff644005a20 con 0x7ff6580720d0 2023-07-13T13:51:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.293+0000 7ff6557fa700 1 -- 172.21.15.123:0/10128512 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ff644006700 con 0x7ff6580720d0 2023-07-13T13:51:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.394+0000 7ff6557fa700 1 -- 172.21.15.123:0/10128512 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff644021060 con 0x7ff6580720d0 2023-07-13T13:51:46.383 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:46.411+0000 7f10db495200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T13:51:46.450 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.477+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4d277993-aa04-4411-9955-36f262d9c671", "id": 6} v 0) v1 -- 0x7ff658071a30 con 0x7ff6580720d0 2023-07-13T13:51:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.537+0000 7ff6557fa700 1 -- 172.21.15.123:0/10128512 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d277993-aa04-4411-9955-36f262d9c671", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff644017070 con 0x7ff6580720d0 2023-07-13T13:51:46.511 INFO:teuthology.orchestra.run.smithi123.stdout:6 2023-07-13T13:51:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6580720d0 msgr2=0x7ff65814c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 --2- 172.21.15.123:0/10128512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6580720d0 0x7ff65814c650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e870 tx=0x7ff64400eb80 comp rx=0 tx=0).stop 2023-07-13T13:51:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 shutdown_connections 2023-07-13T13:51:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 --2- 172.21.15.123:0/10128512 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff658071cc0 0x7ff6581eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 --2- 172.21.15.123:0/10128512 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff65814f790 0x7ff6581460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 --2- 172.21.15.123:0/10128512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6580720d0 0x7ff65814c650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 >> 172.21.15.123:0/10128512 conn(0x7ff65806cf60 msgr2=0x7ff65806aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 shutdown_connections 2023-07-13T13:51:46.514 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.538+0000 7ff65eed7700 1 -- 172.21.15.123:0/10128512 wait complete. 2023-07-13T13:51:46.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 6e123750-7e4c-4c05-ad3a-cce706495fd4 7 2023-07-13T13:51:46.647 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:46.673+0000 7f4689bdb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T13:51:46.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.676+0000 7f5a36870700 1 Processor -- start 2023-07-13T13:51:46.650 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.676+0000 7f5a36870700 1 -- start start 2023-07-13T13:51:46.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.677+0000 7f5a36870700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a30152970 0x7f5a30071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.677+0000 7f5a36870700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a30158640 0x7f5a300c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.677+0000 7f5a36870700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a30158b80 con 0x7f5a30070dd0 2023-07-13T13:51:46.651 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.677+0000 7f5a36870700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a30158e60 con 0x7f5a30152970 2023-07-13T13:51:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.677+0000 7f5a36870700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a30159140 con 0x7f5a30158640 2023-07-13T13:51:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.677+0000 7f5a34e0d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a30158640 0x7f5a300c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.677+0000 7f5a2ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a30152970 0x7f5a30071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.652 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.678+0000 7f5a34e0d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a30158640 0x7f5a300c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49406/0 (socket says 172.21.15.123:49406) 2023-07-13T13:51:46.653 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.678+0000 7f5a34e0d700 1 -- 172.21.15.123:0/342332351 learned_addr learned my addr 172.21.15.123:0/342332351 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:46.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.681+0000 7f5a34e0d700 1 -- 172.21.15.123:0/342332351 >> v2:172.21.15.118:3300/0 conn(0x7f5a30152970 msgr2=0x7f5a30071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:46.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.681+0000 7f5a34e0d700 1 --2- 172.21.15.123:0/342332351 >> v2:172.21.15.118:3300/0 conn(0x7f5a30152970 0x7f5a30071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.681+0000 7f5a34e0d700 1 -- 172.21.15.123:0/342332351 >> v1:172.21.15.123:6789/0 conn(0x7f5a30070dd0 legacy=0x7f5a30069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:46.655 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.681+0000 7f5a34e0d700 1 -- 172.21.15.123:0/342332351 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30159420 con 0x7f5a30158640 2023-07-13T13:51:46.656 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.683+0000 7f5a34e0d700 1 --2- 172.21.15.123:0/342332351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30158640 0x7f5a300c8470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5a300719a0 tx=0x7f5a2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d114c43b106e5102 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:46.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.689+0000 7f5a2effd700 1 -- 172.21.15.123:0/342332351 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800e070 con 0x7f5a30158640 2023-07-13T13:51:46.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.689+0000 7f5a2effd700 1 -- 172.21.15.123:0/342332351 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28003a20 con 0x7f5a30158640 2023-07-13T13:51:46.663 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.689+0000 7f5a2effd700 1 -- 172.21.15.123:0/342332351 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28003dd0 con 0x7f5a30158640 2023-07-13T13:51:46.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.690+0000 7f5a36870700 1 -- 172.21.15.123:0/342332351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30158640 msgr2=0x7f5a300c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.690+0000 7f5a36870700 1 --2- 172.21.15.123:0/342332351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30158640 0x7f5a300c8470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5a300719a0 tx=0x7f5a2800b330 comp rx=0 tx=0).stop 2023-07-13T13:51:46.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.690+0000 7f5a36870700 1 -- 172.21.15.123:0/342332351 shutdown_connections 2023-07-13T13:51:46.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.690+0000 7f5a36870700 1 --2- 172.21.15.123:0/342332351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30158640 0x7f5a300c8470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.664 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.690+0000 7f5a36870700 1 --2- 172.21.15.123:0/342332351 >> v2:172.21.15.118:3300/0 conn(0x7f5a30152970 0x7f5a30071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.690+0000 7f5a36870700 1 -- 172.21.15.123:0/342332351 >> 172.21.15.123:0/342332351 conn(0x7f5a3006cf60 msgr2=0x7f5a3006b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:46.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.690+0000 7f5a36870700 1 -- 172.21.15.123:0/342332351 shutdown_connections 2023-07-13T13:51:46.665 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.690+0000 7f5a36870700 1 -- 172.21.15.123:0/342332351 wait complete. 2023-07-13T13:51:46.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.691+0000 7f5a36870700 1 Processor -- start 2023-07-13T13:51:46.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.691+0000 7f5a36870700 1 -- start start 2023-07-13T13:51:46.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.692+0000 7f5a36870700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a30070dd0 0x7f5a300c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.692+0000 7f5a36870700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30152970 0x7f5a301e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.692+0000 7f5a36870700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a30158640 0x7f5a301f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:46.666 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.692+0000 7f5a36870700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3014b500 con 0x7f5a30070dd0 2023-07-13T13:51:46.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.692+0000 7f5a36870700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30149570 con 0x7f5a30152970 2023-07-13T13:51:46.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.692+0000 7f5a36870700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300c3e90 con 0x7f5a30158640 2023-07-13T13:51:46.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.693+0000 7f5a2f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30152970 0x7f5a301e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.667 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.693+0000 7f5a34e0d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a30158640 0x7f5a301f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.693+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a30070dd0 0x7f5a300c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:46.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.693+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a30070dd0 0x7f5a300c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.123:39668/0 (socket says 172.21.15.123:39668) 2023-07-13T13:51:46.668 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.693+0000 7f5a2ffff700 1 -- 172.21.15.123:0/1710822263 learned_addr learned my addr 172.21.15.123:0/1710822263 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-07-13T13:51:46.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.698+0000 7f5a2ffff700 1 -- 172.21.15.123:0/1710822263 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a30158640 msgr2=0x7f5a301f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.698+0000 7f5a2ffff700 1 --2- 172.21.15.123:0/1710822263 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a30158640 0x7f5a301f13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.698+0000 7f5a2ffff700 1 -- 172.21.15.123:0/1710822263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30152970 msgr2=0x7f5a301e1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.698+0000 7f5a2ffff700 1 --2- 172.21.15.123:0/1710822263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30152970 0x7f5a301e1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.672 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.698+0000 7f5a2ffff700 1 -- 172.21.15.123:0/1710822263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28009b30 con 0x7f5a30070dd0 2023-07-13T13:51:46.675 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.701+0000 7f5a2ffff700 1 --2- 172.21.15.123:0/1710822263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a30070dd0 0x7f5a300c4320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000e990 tx=0x7f5a2000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:46.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.703+0000 7f5a2cff9700 1 -- 172.21.15.123:0/1710822263 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200096f0 con 0x7f5a30070dd0 2023-07-13T13:51:46.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.703+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300c4860 con 0x7f5a30070dd0 2023-07-13T13:51:46.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.704+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3014af40 con 0x7f5a30070dd0 2023-07-13T13:51:46.678 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.704+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3004e280 con 0x7f5a30070dd0 2023-07-13T13:51:46.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.705+0000 7f5a2cff9700 1 -- 172.21.15.123:0/1710822263 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2000c690 con 0x7f5a30070dd0 2023-07-13T13:51:46.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.705+0000 7f5a2cff9700 1 -- 172.21.15.123:0/1710822263 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2000ca00 con 0x7f5a30070dd0 2023-07-13T13:51:46.711 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:46.738+0000 7f10db495200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T13:51:46.779 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.806+0000 7f5a2cff9700 1 -- 172.21.15.123:0/1710822263 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a20026480 con 0x7f5a30070dd0 2023-07-13T13:51:46.780 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.806+0000 7f5a2cff9700 1 -- 172.21.15.123:0/1710822263 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f5a20013c00 con 0x7f5a30070dd0 2023-07-13T13:51:46.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.813+0000 7f5a2cff9700 1 -- 172.21.15.123:0/1710822263 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5a20021060 con 0x7f5a30070dd0 2023-07-13T13:51:46.863 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:46.890+0000 7f10db495200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T13:51:46.895 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.921+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6e123750-7e4c-4c05-ad3a-cce706495fd4", "id": 7} v 0) v1 -- 0x7f5a300cc050 con 0x7f5a30070dd0 2023-07-13T13:51:46.956 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.982+0000 7f5a2cff9700 1 -- 172.21.15.123:0/1710822263 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e123750-7e4c-4c05-ad3a-cce706495fd4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a2002b0b0 con 0x7f5a30070dd0 2023-07-13T13:51:46.956 INFO:teuthology.orchestra.run.smithi123.stdout:7 2023-07-13T13:51:46.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a30070dd0 msgr2=0x7f5a300c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:46.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 --2- 172.21.15.123:0/1710822263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a30070dd0 0x7f5a300c4320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000e990 tx=0x7f5a2000eca0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.957 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 shutdown_connections 2023-07-13T13:51:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 --2- 172.21.15.123:0/1710822263 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5a30158640 0x7f5a301f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 --2- 172.21.15.123:0/1710822263 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a30070dd0 0x7f5a300c4320 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 --2- 172.21.15.123:0/1710822263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a30152970 0x7f5a301e1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 >> 172.21.15.123:0/1710822263 conn(0x7f5a3006cf60 msgr2=0x7f5a3006b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 shutdown_connections 2023-07-13T13:51:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2023-07-13T13:51:46.983+0000 7f5a36870700 1 -- 172.21.15.123:0/1710822263 wait complete. 2023-07-13T13:51:46.971 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-13T13:51:46.971 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-07-13T13:51:46.973 INFO:tasks.ceph.osd.0:Started 2023-07-13T13:51:46.973 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-13T13:51:46.974 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-07-13T13:51:46.974 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:47.001+0000 7f4689bdb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T13:51:46.975 INFO:tasks.ceph.osd.1:Started 2023-07-13T13:51:46.976 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-13T13:51:46.976 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-07-13T13:51:46.978 INFO:tasks.ceph.osd.2:Started 2023-07-13T13:51:46.978 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-13T13:51:46.978 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-07-13T13:51:46.980 INFO:tasks.ceph.osd.3:Started 2023-07-13T13:51:46.980 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-13T13:51:46.981 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-07-13T13:51:46.982 INFO:tasks.ceph.osd.4:Started 2023-07-13T13:51:46.983 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-13T13:51:46.983 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-07-13T13:51:46.985 INFO:tasks.ceph.osd.5:Started 2023-07-13T13:51:46.985 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-13T13:51:46.985 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-07-13T13:51:46.987 INFO:tasks.ceph.osd.6:Started 2023-07-13T13:51:46.987 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-13T13:51:46.988 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-07-13T13:51:46.989 INFO:tasks.ceph.osd.7:Started 2023-07-13T13:51:46.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:51:47.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.179+0000 7fae91604700 1 Processor -- start 2023-07-13T13:51:47.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.179+0000 7fae91604700 1 -- start start 2023-07-13T13:51:47.153 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:47.179+0000 7f4689bdb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T13:51:47.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae91604700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fae8c0711f0 0x7fae8c158760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:47.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae91604700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c158ca0 0x7fae8c151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:47.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae91604700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c159120 con 0x7fae8c070e20 2023-07-13T13:51:47.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae91604700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c06b2a0 con 0x7fae8c0711f0 2023-07-13T13:51:47.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae91604700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0c2100 con 0x7fae8c158ca0 2023-07-13T13:51:47.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae8affd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fae8c070e20 0x7fae8c0c19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:42136/0 (socket says 172.21.15.118:42136) 2023-07-13T13:51:47.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae8affd700 1 -- 172.21.15.118:0/1196401119 learned_addr learned my addr 172.21.15.118:0/1196401119 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:51:47.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae8a7fc700 1 --2- 172.21.15.118:0/1196401119 >> v2:172.21.15.123:3300/0 conn(0x7fae8c0711f0 0x7fae8c158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:47.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.180+0000 7fae8b7fe700 1 --2- 172.21.15.118:0/1196401119 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c158ca0 0x7fae8c151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:47.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.183+0000 7fae89ffb700 1 -- 172.21.15.118:0/1196401119 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516361130 0 0) 0x7fae8c159120 con 0x7fae8c070e20 2023-07-13T13:51:47.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.183+0000 7fae8a7fc700 1 -- 172.21.15.118:0/1196401119 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c158ca0 msgr2=0x7fae8c151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:47.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.183+0000 7fae8a7fc700 1 --2- 172.21.15.118:0/1196401119 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c158ca0 0x7fae8c151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:47.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.183+0000 7fae8a7fc700 1 -- 172.21.15.118:0/1196401119 >> v1:172.21.15.118:6789/0 conn(0x7fae8c070e20 legacy=0x7fae8c0c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:47.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.183+0000 7fae8a7fc700 1 -- 172.21.15.118:0/1196401119 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c0c8950 con 0x7fae8c0711f0 2023-07-13T13:51:47.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.185+0000 7fae8a7fc700 1 --2- 172.21.15.118:0/1196401119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c0711f0 0x7fae8c158760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae80009840 tx=0x7fae80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627b9b10b815f188 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:47.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.188+0000 7fae89ffb700 1 -- 172.21.15.118:0/1196401119 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80011830 con 0x7fae8c0711f0 2023-07-13T13:51:47.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.188+0000 7fae89ffb700 1 -- 172.21.15.118:0/1196401119 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae80011990 con 0x7fae8c0711f0 2023-07-13T13:51:47.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.188+0000 7fae89ffb700 1 -- 172.21.15.118:0/1196401119 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80011d20 con 0x7fae8c0711f0 2023-07-13T13:51:47.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.189+0000 7fae91604700 1 -- 172.21.15.118:0/1196401119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c0711f0 msgr2=0x7fae8c158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:47.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.189+0000 7fae91604700 1 --2- 172.21.15.118:0/1196401119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c0711f0 0x7fae8c158760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae80009840 tx=0x7fae80009b50 comp rx=0 tx=0).stop 2023-07-13T13:51:47.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.189+0000 7fae91604700 1 -- 172.21.15.118:0/1196401119 shutdown_connections 2023-07-13T13:51:47.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.189+0000 7fae91604700 1 --2- 172.21.15.118:0/1196401119 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c158ca0 0x7fae8c151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:47.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.189+0000 7fae91604700 1 --2- 172.21.15.118:0/1196401119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c0711f0 0x7fae8c158760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:47.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.189+0000 7fae91604700 1 -- 172.21.15.118:0/1196401119 >> 172.21.15.118:0/1196401119 conn(0x7fae8c06cb20 msgr2=0x7fae8c06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:47.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.189+0000 7fae91604700 1 -- 172.21.15.118:0/1196401119 shutdown_connections 2023-07-13T13:51:47.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.189+0000 7fae91604700 1 -- 172.21.15.118:0/1196401119 wait complete. 2023-07-13T13:51:47.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.191+0000 7fae91604700 1 Processor -- start 2023-07-13T13:51:47.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.191+0000 7fae91604700 1 -- start start 2023-07-13T13:51:47.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.192+0000 7fae91604700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c070e20 0x7fae8c1f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.192+0000 7fae91604700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c0711f0 0x7fae8c0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.192+0000 7fae91604700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c158ca0 0x7fae8c150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.192+0000 7fae91604700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c144d00 con 0x7fae8c158ca0 2023-07-13T13:51:47.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.192+0000 7fae91604700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c146f80 con 0x7fae8c070e20 2023-07-13T13:51:47.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.192+0000 7fae91604700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c145ef0 con 0x7fae8c0711f0 2023-07-13T13:51:47.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.192+0000 7fae8affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c070e20 0x7fae8c1f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:47.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.192+0000 7fae8b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c158ca0 0x7fae8c150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:47.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.193+0000 7fae8a7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c0711f0 0x7fae8c0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:47.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.193+0000 7fae8affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c070e20 0x7fae8c1f0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:39994/0 (socket says 172.21.15.118:39994) 2023-07-13T13:51:47.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.193+0000 7fae8affd700 1 -- 172.21.15.118:0/1470671426 learned_addr learned my addr 172.21.15.118:0/1470671426 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:47.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.196+0000 7fae8affd700 1 -- 172.21.15.118:0/1470671426 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c0711f0 msgr2=0x7fae8c0c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:47.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.196+0000 7fae8affd700 1 --2- 172.21.15.118:0/1470671426 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c0711f0 0x7fae8c0c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:47.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.196+0000 7fae8affd700 1 -- 172.21.15.118:0/1470671426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c158ca0 msgr2=0x7fae8c150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:47.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.196+0000 7fae8affd700 1 --2- 172.21.15.118:0/1470671426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c158ca0 0x7fae8c150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:47.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.196+0000 7fae8affd700 1 -- 172.21.15.118:0/1470671426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800094a0 con 0x7fae8c070e20 2023-07-13T13:51:47.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.199+0000 7fae8affd700 1 --2- 172.21.15.118:0/1470671426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c070e20 0x7fae8c1f0e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c750 tx=0x7fae7c00ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:47.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.202+0000 7fae737fe700 1 -- 172.21.15.118:0/1470671426 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c004c80 con 0x7fae8c070e20 2023-07-13T13:51:47.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.202+0000 7fae737fe700 1 -- 172.21.15.118:0/1470671426 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c004e00 con 0x7fae8c070e20 2023-07-13T13:51:47.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.202+0000 7fae737fe700 1 -- 172.21.15.118:0/1470671426 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c007310 con 0x7fae8c070e20 2023-07-13T13:51:47.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.202+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c0c49b0 con 0x7fae8c070e20 2023-07-13T13:51:47.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.202+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c0c4c90 con 0x7fae8c070e20 2023-07-13T13:51:47.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.203+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c04e210 con 0x7fae8c070e20 2023-07-13T13:51:47.269 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:47.296+0000 7f10db495200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T13:51:47.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.301+0000 7fae737fe700 1 -- 172.21.15.118:0/1470671426 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae7c01d3f0 con 0x7fae8c070e20 2023-07-13T13:51:47.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.305+0000 7fae737fe700 1 -- 172.21.15.118:0/1470671426 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fae7c013a90 con 0x7fae8c070e20 2023-07-13T13:51:47.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.305+0000 7fae737fe700 1 -- 172.21.15.118:0/1470671426 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fae7c013d00 con 0x7fae8c070e20 2023-07-13T13:51:47.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.373+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae8c0c7b70 con 0x7fae8c070e20 2023-07-13T13:51:47.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.434+0000 7fae737fe700 1 -- 172.21.15.118:0/1470671426 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fae7c0133c0 con 0x7fae8c070e20 2023-07-13T13:51:47.408 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:51:47.408 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:51:46.930035+0000","last_up_change":"0.000000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:51:47.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c070e20 msgr2=0x7fae8c1f0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:47.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 --2- 172.21.15.118:0/1470671426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c070e20 0x7fae8c1f0e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c750 tx=0x7fae7c00ca60 comp rx=0 tx=0).stop 2023-07-13T13:51:47.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 shutdown_connections 2023-07-13T13:51:47.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 --2- 172.21.15.118:0/1470671426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae8c070e20 0x7fae8c1f0e20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:47.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 --2- 172.21.15.118:0/1470671426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae8c158ca0 0x7fae8c150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:47.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 --2- 172.21.15.118:0/1470671426 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae8c0711f0 0x7fae8c0c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:47.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 >> 172.21.15.118:0/1470671426 conn(0x7fae8c06cb20 msgr2=0x7fae8c0c1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:47.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 shutdown_connections 2023-07-13T13:51:47.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:47.435+0000 7fae91604700 1 -- 172.21.15.118:0/1470671426 wait complete. 2023-07-13T13:51:47.417 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:47.445+0000 7f10db495200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T13:51:47.420 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-13T13:51:47.420 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-13T13:51:47.526 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:47.552+0000 7f4689bdb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T13:51:47.576 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:47.603+0000 7f10db495200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T13:51:47.598 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-07-13T13:51:47.625+0000 7f46b4f9f640 -1 Falling back to public interface 2023-07-13T13:51:47.606 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-07-13T13:51:47.632+0000 7f352c5d1640 -1 Falling back to public interface 2023-07-13T13:51:47.621 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-07-13T13:51:47.648+0000 7fe251078640 -1 Falling back to public interface 2023-07-13T13:51:47.645 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T13:51:47.671+0000 7fc4ac32a640 -1 Falling back to public interface 2023-07-13T13:51:47.646 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-07-13T13:51:47.672+0000 7f12af1aa640 -1 Falling back to public interface 2023-07-13T13:51:47.646 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-07-13T13:51:47.672+0000 7f2d5e965640 -1 Falling back to public interface 2023-07-13T13:51:47.646 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-07-13T13:51:47.673+0000 7f2d55d0c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-07-13T13:51:47.647 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-07-13T13:51:47.673+0000 7fd993393640 -1 Falling back to public interface 2023-07-13T13:51:47.670 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-07-13T13:51:47.698+0000 7f6a5b2be640 -1 Falling back to public interface 2023-07-13T13:51:47.685 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:47.711+0000 7f4689bdb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T13:51:47.841 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:47.867+0000 7f4689bdb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T13:51:47.894 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:47.921+0000 7f10db495200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T13:51:48.155 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-07-13T13:51:48.182+0000 7f4689bdb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T13:51:48.226 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-13T13:51:48.339 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.366+0000 7f5e8a3a4700 1 Processor -- start 2023-07-13T13:51:48.340 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.366+0000 7f5e8a3a4700 1 -- start start 2023-07-13T13:51:48.340 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.367+0000 7f5e8a3a4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5e841529c0 0x7f5e840c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:48.341 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.367+0000 7f5e8a3a4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5e8415c2e0 0x7f5e8415c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:48.341 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.367+0000 7f5e8a3a4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8415cc60 con 0x7f5e840c4c10 2023-07-13T13:51:48.341 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.367+0000 7f5e8a3a4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840b1ee0 con 0x7f5e8415c2e0 2023-07-13T13:51:48.341 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.367+0000 7f5e8a3a4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840cf6e0 con 0x7f5e841529c0 2023-07-13T13:51:48.341 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.367+0000 7f5e88941700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5e8415c2e0 0x7f5e8415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:48.341 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.368+0000 7f5e83fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5e841529c0 0x7f5e840c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:48.342 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.368+0000 7f5e83fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5e841529c0 0x7f5e840c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:40016/0 (socket says 172.21.15.118:40016) 2023-07-13T13:51:48.342 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.368+0000 7f5e83fff700 1 -- 172.21.15.118:0/2152039761 learned_addr learned my addr 172.21.15.118:0/2152039761 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:48.344 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.371+0000 7f5e88941700 1 -- 172.21.15.118:0/2152039761 >> v2:172.21.15.123:3300/0 conn(0x7f5e841529c0 msgr2=0x7f5e840c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:48.345 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.371+0000 7f5e88941700 1 --2- 172.21.15.118:0/2152039761 >> v2:172.21.15.123:3300/0 conn(0x7f5e841529c0 0x7f5e840c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:48.345 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.371+0000 7f5e88941700 1 -- 172.21.15.118:0/2152039761 >> v1:172.21.15.118:6789/0 conn(0x7f5e840c4c10 legacy=0x7f5e8406b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:48.345 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.372+0000 7f5e88941700 1 -- 172.21.15.118:0/2152039761 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8415be00 con 0x7f5e8415c2e0 2023-07-13T13:51:48.347 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.375+0000 7f5e88941700 1 --2- 172.21.15.118:0/2152039761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8415c2e0 0x7f5e8415c720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5e84071eb0 tx=0x7f5e7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab54bb5be28d151 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:48.352 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.379+0000 7f5e82ffd700 1 -- 172.21.15.118:0/2152039761 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00e070 con 0x7f5e8415c2e0 2023-07-13T13:51:48.352 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.379+0000 7f5e82ffd700 1 -- 172.21.15.118:0/2152039761 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00bb20 con 0x7f5e8415c2e0 2023-07-13T13:51:48.352 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.379+0000 7f5e82ffd700 1 -- 172.21.15.118:0/2152039761 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c012430 con 0x7f5e8415c2e0 2023-07-13T13:51:48.353 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.380+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2152039761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8415c2e0 msgr2=0x7f5e8415c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:48.353 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.380+0000 7f5e8a3a4700 1 --2- 172.21.15.118:0/2152039761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8415c2e0 0x7f5e8415c720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5e84071eb0 tx=0x7f5e7c00b330 comp rx=0 tx=0).stop 2023-07-13T13:51:48.353 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.380+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2152039761 shutdown_connections 2023-07-13T13:51:48.353 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.380+0000 7f5e8a3a4700 1 --2- 172.21.15.118:0/2152039761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e8415c2e0 0x7f5e8415c720 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:48.353 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.380+0000 7f5e8a3a4700 1 --2- 172.21.15.118:0/2152039761 >> v2:172.21.15.123:3300/0 conn(0x7f5e841529c0 0x7f5e840c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:48.354 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.380+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2152039761 >> 172.21.15.118:0/2152039761 conn(0x7f5e84071660 msgr2=0x7f5e8406ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:48.354 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.380+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2152039761 shutdown_connections 2023-07-13T13:51:48.354 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.380+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2152039761 wait complete. 2023-07-13T13:51:48.355 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.381+0000 7f5e8a3a4700 1 Processor -- start 2023-07-13T13:51:48.355 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.381+0000 7f5e8a3a4700 1 -- start start 2023-07-13T13:51:48.355 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.382+0000 7f5e8a3a4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e840c4c10 0x7f5e841e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:48.355 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.382+0000 7f5e8a3a4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e841529c0 0x7f5e840b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:48.355 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.382+0000 7f5e8a3a4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8415c2e0 0x7f5e841eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:48.355 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.382+0000 7f5e8a3a4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b3330 con 0x7f5e840c4c10 2023-07-13T13:51:48.355 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.382+0000 7f5e8a3a4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e841e43f0 con 0x7f5e8415c2e0 2023-07-13T13:51:48.356 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.382+0000 7f5e8a3a4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b3760 con 0x7f5e841529c0 2023-07-13T13:51:48.356 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.382+0000 7f5e83fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e840c4c10 0x7f5e841e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:48.356 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.383+0000 7f5e88941700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8415c2e0 0x7f5e841eeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:48.357 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.383+0000 7f5e83fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e840c4c10 0x7f5e841e31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41698/0 (socket says 172.21.15.118:41698) 2023-07-13T13:51:48.357 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.383+0000 7f5e83fff700 1 -- 172.21.15.118:0/2095804069 learned_addr learned my addr 172.21.15.118:0/2095804069 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:48.359 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.386+0000 7f5e83fff700 1 -- 172.21.15.118:0/2095804069 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e841529c0 msgr2=0x7f5e840b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:48.359 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.386+0000 7f5e83fff700 1 --2- 172.21.15.118:0/2095804069 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e841529c0 0x7f5e840b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:48.359 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.386+0000 7f5e83fff700 1 -- 172.21.15.118:0/2095804069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8415c2e0 msgr2=0x7f5e841eeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:48.360 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.386+0000 7f5e83fff700 1 --2- 172.21.15.118:0/2095804069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8415c2e0 0x7f5e841eeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:48.360 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.386+0000 7f5e83fff700 1 -- 172.21.15.118:0/2095804069 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c009a70 con 0x7f5e840c4c10 2023-07-13T13:51:48.361 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.388+0000 7f5e83fff700 1 --2- 172.21.15.118:0/2095804069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e840c4c10 0x7f5e841e31b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800e940 tx=0x7f5e7800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:48.365 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.392+0000 7f5e80ff9700 1 -- 172.21.15.118:0/2095804069 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800ee90 con 0x7f5e840c4c10 2023-07-13T13:51:48.365 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.392+0000 7f5e80ff9700 1 -- 172.21.15.118:0/2095804069 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7800c850 con 0x7f5e840c4c10 2023-07-13T13:51:48.365 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.392+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e841ef050 con 0x7f5e840c4c10 2023-07-13T13:51:48.366 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.392+0000 7f5e80ff9700 1 -- 172.21.15.118:0/2095804069 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800cc00 con 0x7f5e840c4c10 2023-07-13T13:51:48.366 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.392+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e840b2960 con 0x7f5e840c4c10 2023-07-13T13:51:48.366 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.393+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e840b3f20 con 0x7f5e840c4c10 2023-07-13T13:51:48.376 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.404+0000 7f5e80ff9700 1 -- 172.21.15.118:0/2095804069 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 2) v1 ==== 44470+0+0 (secure 0 0 0) 0x7f5e7800cd60 con 0x7f5e840c4c10 2023-07-13T13:51:48.378 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.406+0000 7f5e80ff9700 1 -- 172.21.15.118:0/2095804069 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5e78012c10 con 0x7f5e840c4c10 2023-07-13T13:51:48.395 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:48.423+0000 7f10cd86b700 -1 mgr handle_mgr_map I was active but no longer am 2023-07-13T13:51:48.484 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.511+0000 7f5e80ff9700 1 -- 172.21.15.118:0/2095804069 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5e78013470 con 0x7f5e840c4c10 2023-07-13T13:51:48.557 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.584+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e841ef050 con 0x7f5e840c4c10 2023-07-13T13:51:48.612 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:48.639+0000 7feaecaf9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T13:51:48.619 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.646+0000 7f5e80ff9700 1 -- 172.21.15.118:0/2095804069 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5e841ef050 con 0x7f5e840c4c10 2023-07-13T13:51:48.619 INFO:teuthology.misc.health.smithi118.stdout: 2023-07-13T13:51:48.619 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":10,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:51:46.930035+0000","last_up_change":"0.000000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:51:48.620 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e840c4c10 msgr2=0x7f5e841e31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:48.621 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 --2- 172.21.15.118:0/2095804069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e840c4c10 0x7f5e841e31b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800e940 tx=0x7f5e7800ec50 comp rx=0 tx=0).stop 2023-07-13T13:51:48.621 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 shutdown_connections 2023-07-13T13:51:48.621 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 --2- 172.21.15.118:0/2095804069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e8415c2e0 0x7f5e841eeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:48.621 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 --2- 172.21.15.118:0/2095804069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e840c4c10 0x7f5e841e31b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:48.621 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 --2- 172.21.15.118:0/2095804069 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5e841529c0 0x7f5e840b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:48.622 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 >> 172.21.15.118:0/2095804069 conn(0x7f5e84071660 msgr2=0x7f5e8414d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:48.622 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 shutdown_connections 2023-07-13T13:51:48.622 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:48.647+0000 7f5e8a3a4700 1 -- 172.21.15.118:0/2095804069 wait complete. 2023-07-13T13:51:48.632 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-13T13:51:48.768 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:48.788+0000 7feaecaf9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T13:51:49.043 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:49.070+0000 7feaecaf9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T13:51:49.474 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:49.501+0000 7feaecaf9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T13:51:49.614 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:49.641+0000 7feaecaf9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T13:51:49.956 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:49.983+0000 7feaecaf9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T13:51:50.695 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:51:50.696 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:50.723+0000 7feaecaf9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T13:51:50.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:51:50.769 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:50.796+0000 7feaecaf9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T13:51:50.887 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-07-13T13:51:50.914+0000 7fe251078640 -1 osd.1 0 log_to_monitors true 2023-07-13T13:51:50.910 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:50.935+0000 7feaecaf9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T13:51:50.915 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-07-13T13:51:50.943+0000 7fd993393640 -1 osd.0 0 log_to_monitors true 2023-07-13T13:51:50.986 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:51.013+0000 7feaecaf9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T13:51:51.067 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-07-13T13:51:51.095+0000 7f46b4f9f640 -1 osd.6 0 log_to_monitors true 2023-07-13T13:51:51.098 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-07-13T13:51:51.126+0000 7f352c5d1640 -1 osd.4 0 log_to_monitors true 2023-07-13T13:51:51.126 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T13:51:51.153+0000 7fc4ac32a640 -1 osd.5 0 log_to_monitors true 2023-07-13T13:51:51.153 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-07-13T13:51:51.180+0000 7f6a5b2be640 -1 osd.7 0 log_to_monitors true 2023-07-13T13:51:51.182 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:51.210+0000 7feaecaf9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T13:51:51.188 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-07-13T13:51:51.215+0000 7f12af1aa640 -1 osd.2 0 log_to_monitors true 2023-07-13T13:51:51.191 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-07-13T13:51:51.219+0000 7f2d5e965640 -1 osd.3 0 log_to_monitors true 2023-07-13T13:51:51.274 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:51.301+0000 7feaecaf9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T13:51:51.359 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:51.386+0000 7feaecaf9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T13:51:51.443 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:51.471+0000 7feaecaf9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T13:51:51.605 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:51.632+0000 7feaecaf9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T13:51:51.685 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:51.712+0000 7feaecaf9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T13:51:51.965 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:51.992+0000 7feaecaf9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T13:51:52.036 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:52.063+0000 7feaecaf9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T13:51:52.580 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:52.607+0000 7feaecaf9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T13:51:52.998 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:53.025+0000 7feaecaf9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T13:51:53.100 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-07-13T13:51:53.127+0000 7fe245419700 -1 osd.1 0 waiting for initial osdmap 2023-07-13T13:51:53.154 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:53.181+0000 7feaecaf9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T13:51:53.162 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-07-13T13:51:53.189+0000 7fe23cff3700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-13T13:51:53.531 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:53.558+0000 7feaecaf9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T13:51:53.555 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-07-13T13:51:53.582+0000 7fd987734700 -1 osd.0 0 waiting for initial osdmap 2023-07-13T13:51:53.650 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-07-13T13:51:53.678+0000 7fd97f30e700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-13T13:51:53.699 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:53.726+0000 7feaecaf9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T13:51:53.897 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:53.924+0000 7feaecaf9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T13:51:54.306 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:54.333+0000 7feaecaf9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T13:51:54.446 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-07-13T13:51:54.472+0000 7f2d52d06700 -1 osd.3 0 waiting for initial osdmap 2023-07-13T13:51:54.522 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-07-13T13:51:54.549+0000 7f2d4a8e0700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-13T13:51:54.850 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-07-13T13:51:54.876+0000 7f12a354b700 -1 osd.2 0 waiting for initial osdmap 2023-07-13T13:51:54.905 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-07-13T13:51:54.932+0000 7f129b125700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-13T13:51:54.923 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-07-13T13:51:54.950+0000 7f3520972700 -1 osd.4 0 waiting for initial osdmap 2023-07-13T13:51:54.924 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-07-13T13:51:54.950+0000 7f6a4f65f700 -1 osd.7 0 waiting for initial osdmap 2023-07-13T13:51:54.938 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-07-13T13:51:54.964+0000 7f46a9340700 -1 osd.6 0 waiting for initial osdmap 2023-07-13T13:51:54.958 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-07-13T13:51:54.985+0000 7f351854c700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-13T13:51:54.959 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-07-13T13:51:54.985+0000 7f6a47239700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-13T13:51:54.962 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-07-13T13:51:54.989+0000 7f46a0f1a700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-13T13:51:54.974 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T13:51:55.000+0000 7fc4a06cb700 -1 osd.5 0 waiting for initial osdmap 2023-07-13T13:51:54.991 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T13:51:55.018+0000 7fc4982a5700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-13T13:51:55.438 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-13T13:51:55.555 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.582+0000 7fd58da27700 1 Processor -- start 2023-07-13T13:51:55.556 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.582+0000 7fd58da27700 1 -- start start 2023-07-13T13:51:55.556 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.582+0000 7fd58da27700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd5881529c0 0x7fd5880c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:55.557 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.582+0000 7fd58da27700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5880c4c10 0x7fd58806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:55.557 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.582+0000 7fd58da27700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd58806be80 0x7fd58815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:55.557 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.582+0000 7fd58da27700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880b1ee0 con 0x7fd58806be80 2023-07-13T13:51:55.557 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.582+0000 7fd58da27700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880cf6e0 con 0x7fd5881529c0 2023-07-13T13:51:55.557 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.582+0000 7fd58da27700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58815be00 con 0x7fd5880c4c10 2023-07-13T13:51:55.561 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.588+0000 7fd586ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd5881529c0 0x7fd5880c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:55.561 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.588+0000 7fd5867fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5880c4c10 0x7fd58806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:55.562 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.588+0000 7fd5867fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5880c4c10 0x7fd58806b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:51086/0 (socket says 172.21.15.118:51086) 2023-07-13T13:51:55.562 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.588+0000 7fd5867fc700 1 -- 172.21.15.118:0/3109913201 learned_addr learned my addr 172.21.15.118:0/3109913201 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:55.565 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.591+0000 7fd586ffd700 1 -- 172.21.15.118:0/3109913201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5880c4c10 msgr2=0x7fd58806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:55.565 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.591+0000 7fd586ffd700 1 --2- 172.21.15.118:0/3109913201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5880c4c10 0x7fd58806b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:55.565 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.591+0000 7fd586ffd700 1 -- 172.21.15.118:0/3109913201 >> v2:172.21.15.118:3300/0 conn(0x7fd58806be80 msgr2=0x7fd58815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:55.565 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.591+0000 7fd586ffd700 1 --2- 172.21.15.118:0/3109913201 >> v2:172.21.15.118:3300/0 conn(0x7fd58806be80 0x7fd58815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:55.566 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.591+0000 7fd586ffd700 1 -- 172.21.15.118:0/3109913201 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880ceb80 con 0x7fd5881529c0 2023-07-13T13:51:55.570 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.596+0000 7fd586ffd700 1 --2- 172.21.15.118:0/3109913201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5881529c0 0x7fd5880c9240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd588071eb0 tx=0x7fd578009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae784f777f73df32 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:55.582 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd585ffb700 1 -- 172.21.15.118:0/3109913201 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578011830 con 0x7fd5881529c0 2023-07-13T13:51:55.583 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd585ffb700 1 -- 172.21.15.118:0/3109913201 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578011990 con 0x7fd5881529c0 2023-07-13T13:51:55.583 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd585ffb700 1 -- 172.21.15.118:0/3109913201 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578011d20 con 0x7fd5881529c0 2023-07-13T13:51:55.583 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 -- 172.21.15.118:0/3109913201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5881529c0 msgr2=0x7fd5880c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:55.584 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 --2- 172.21.15.118:0/3109913201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5881529c0 0x7fd5880c9240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd588071eb0 tx=0x7fd578009b20 comp rx=0 tx=0).stop 2023-07-13T13:51:55.584 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 -- 172.21.15.118:0/3109913201 shutdown_connections 2023-07-13T13:51:55.584 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 --2- 172.21.15.118:0/3109913201 >> v2:172.21.15.118:3300/0 conn(0x7fd58806be80 0x7fd58815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:55.584 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 --2- 172.21.15.118:0/3109913201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5881529c0 0x7fd5880c9240 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:55.584 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 --2- 172.21.15.118:0/3109913201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5880c4c10 0x7fd58806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:55.584 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 -- 172.21.15.118:0/3109913201 >> 172.21.15.118:0/3109913201 conn(0x7fd588071660 msgr2=0x7fd58806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:55.585 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 -- 172.21.15.118:0/3109913201 shutdown_connections 2023-07-13T13:51:55.585 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.609+0000 7fd58da27700 1 -- 172.21.15.118:0/3109913201 wait complete. 2023-07-13T13:51:55.585 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.611+0000 7fd58da27700 1 Processor -- start 2023-07-13T13:51:55.585 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.611+0000 7fd58da27700 1 -- start start 2023-07-13T13:51:55.586 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.611+0000 7fd58da27700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58806be80 0x7fd5881445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:55.586 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.611+0000 7fd58da27700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5880c4c10 0x7fd5881e2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:55.586 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.611+0000 7fd58da27700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5881529c0 0x7fd58814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:55.586 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.611+0000 7fd58da27700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880cd220 con 0x7fd58806be80 2023-07-13T13:51:55.586 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.611+0000 7fd58da27700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588144b00 con 0x7fd5880c4c10 2023-07-13T13:51:55.586 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.611+0000 7fd58da27700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880ce420 con 0x7fd5881529c0 2023-07-13T13:51:55.587 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.612+0000 7fd5867fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5880c4c10 0x7fd5881e2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:55.587 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.612+0000 7fd5877fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5881529c0 0x7fd58814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:55.587 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.612+0000 7fd5867fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5880c4c10 0x7fd5881e2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:58698/0 (socket says 172.21.15.118:58698) 2023-07-13T13:51:55.587 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.612+0000 7fd5867fc700 1 -- 172.21.15.118:0/3344356158 learned_addr learned my addr 172.21.15.118:0/3344356158 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:55.590 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.616+0000 7fd5867fc700 1 -- 172.21.15.118:0/3344356158 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5881529c0 msgr2=0x7fd58814a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:55.590 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.616+0000 7fd5867fc700 1 --2- 172.21.15.118:0/3344356158 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5881529c0 0x7fd58814a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:55.590 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.616+0000 7fd5867fc700 1 -- 172.21.15.118:0/3344356158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58806be80 msgr2=0x7fd5881445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:55.590 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.616+0000 7fd5867fc700 1 --2- 172.21.15.118:0/3344356158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58806be80 0x7fd5881445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:55.590 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.616+0000 7fd5867fc700 1 -- 172.21.15.118:0/3344356158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780094a0 con 0x7fd5880c4c10 2023-07-13T13:51:55.592 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.619+0000 7fd5867fc700 1 --2- 172.21.15.118:0/3344356158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5880c4c10 0x7fd5881e2970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00e940 tx=0x7fd57c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:55.596 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.622+0000 7fd56ffff700 1 -- 172.21.15.118:0/3344356158 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0096a0 con 0x7fd5880c4c10 2023-07-13T13:51:55.597 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.623+0000 7fd56ffff700 1 -- 172.21.15.118:0/3344356158 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c00ee90 con 0x7fd5880c4c10 2023-07-13T13:51:55.597 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.623+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5881e1170 con 0x7fd5880c4c10 2023-07-13T13:51:55.597 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.623+0000 7fd56ffff700 1 -- 172.21.15.118:0/3344356158 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00ca90 con 0x7fd5880c4c10 2023-07-13T13:51:55.597 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.623+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5881e13c0 con 0x7fd5880c4c10 2023-07-13T13:51:55.597 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.623+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5880743b0 con 0x7fd5880c4c10 2023-07-13T13:51:55.692 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.719+0000 7fd56ffff700 1 -- 172.21.15.118:0/3344356158 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 88748+0+0 (secure 0 0 0) 0x7fd57c00cbf0 con 0x7fd5880c4c10 2023-07-13T13:51:55.697 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.723+0000 7fd56ffff700 1 -- 172.21.15.118:0/3344356158 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7fd57c05c7f0 con 0x7fd5880c4c10 2023-07-13T13:51:55.721 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.747+0000 7fd56ffff700 1 -- 172.21.15.118:0/3344356158 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd57c0549a0 con 0x7fd5880c4c10 2023-07-13T13:51:55.793 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:55.819+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5880cc880 con 0x7fd5880c4c10 2023-07-13T13:51:56.213 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.239+0000 7fd56ffff700 1 -- 172.21.15.118:0/3344356158 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12752 (secure 0 0 0) 0x7fd57c017090 con 0x7fd5880c4c10 2023-07-13T13:51:56.213 INFO:teuthology.misc.health.smithi118.stdout: 2023-07-13T13:51:56.214 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":15,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:51:55.598839+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:51:56.214 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5880c4c10 msgr2=0x7fd5881e2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:56.215 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 --2- 172.21.15.118:0/3344356158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5880c4c10 0x7fd5881e2970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00e940 tx=0x7fd57c00ec50 comp rx=0 tx=0).stop 2023-07-13T13:51:56.215 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 shutdown_connections 2023-07-13T13:51:56.215 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 --2- 172.21.15.118:0/3344356158 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5881529c0 0x7fd58814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:56.215 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 --2- 172.21.15.118:0/3344356158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd58806be80 0x7fd5881445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:56.215 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 --2- 172.21.15.118:0/3344356158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5880c4c10 0x7fd5881e2970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:56.215 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 >> 172.21.15.118:0/3344356158 conn(0x7fd588071660 msgr2=0x7fd58814ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:56.215 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 shutdown_connections 2023-07-13T13:51:56.216 INFO:teuthology.misc.health.smithi118.stderr:2023-07-13T13:51:56.240+0000 7fd58da27700 1 -- 172.21.15.118:0/3344356158 wait complete. 2023-07-13T13:51:56.225 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-13T13:51:56.226 INFO:tasks.ceph:Creating RBD pool 2023-07-13T13:51:56.226 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-13T13:51:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.376+0000 7f1d2bc70700 1 Processor -- start 2023-07-13T13:51:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.377+0000 7f1d2bc70700 1 -- start start 2023-07-13T13:51:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.377+0000 7f1d2bc70700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24152d80 0x7f1d240c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.377+0000 7f1d2bc70700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d24159500 0x7f1d240c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.377+0000 7f1d2bc70700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d240af1f0 con 0x7f1d241529b0 2023-07-13T13:51:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.378+0000 7f1d2bc70700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d24158810 con 0x7f1d24159500 2023-07-13T13:51:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.378+0000 7f1d2bc70700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d240c1b20 con 0x7f1d24152d80 2023-07-13T13:51:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.378+0000 7f1d29a0c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1d241529b0 0x7f1d2415bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:49246/0 (socket says 172.21.15.118:49246) 2023-07-13T13:51:56.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.378+0000 7f1d29a0c700 1 -- 172.21.15.118:0/4287627500 learned_addr learned my addr 172.21.15.118:0/4287627500 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:51:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.384+0000 7f1d2920b700 1 --2- 172.21.15.118:0/4287627500 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24152d80 0x7f1d240c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:56.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.390+0000 7f1d2920b700 1 -- 172.21.15.118:0/4287627500 >> v2:172.21.15.118:3300/0 conn(0x7f1d24159500 msgr2=0x7f1d240c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:56.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.390+0000 7f1d2920b700 1 --2- 172.21.15.118:0/4287627500 >> v2:172.21.15.118:3300/0 conn(0x7f1d24159500 0x7f1d240c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:56.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.390+0000 7f1d2920b700 1 -- 172.21.15.118:0/4287627500 >> v1:172.21.15.123:6789/0 conn(0x7f1d241529b0 legacy=0x7f1d2415bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:56.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.390+0000 7f1d2920b700 1 -- 172.21.15.118:0/4287627500 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d240c1e00 con 0x7f1d24152d80 2023-07-13T13:51:56.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.392+0000 7f1d2920b700 1 --2- 172.21.15.118:0/4287627500 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24152d80 0x7f1d240c1500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009840 tx=0x7f1d14009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e7f93ca3982cffa server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:56.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.394+0000 7f1d28a0a700 1 -- 172.21.15.118:0/4287627500 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14011830 con 0x7f1d24152d80 2023-07-13T13:51:56.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.396+0000 7f1d28a0a700 1 -- 172.21.15.118:0/4287627500 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d14011990 con 0x7f1d24152d80 2023-07-13T13:51:56.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.396+0000 7f1d28a0a700 1 -- 172.21.15.118:0/4287627500 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14011d20 con 0x7f1d24152d80 2023-07-13T13:51:56.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.397+0000 7f1d2bc70700 1 -- 172.21.15.118:0/4287627500 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24152d80 msgr2=0x7f1d240c1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:56.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.397+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/4287627500 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24152d80 0x7f1d240c1500 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009840 tx=0x7f1d14009b50 comp rx=0 tx=0).stop 2023-07-13T13:51:56.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.397+0000 7f1d2bc70700 1 -- 172.21.15.118:0/4287627500 shutdown_connections 2023-07-13T13:51:56.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.397+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/4287627500 >> v2:172.21.15.118:3300/0 conn(0x7f1d24159500 0x7f1d240c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:56.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.397+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/4287627500 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24152d80 0x7f1d240c1500 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:56.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.397+0000 7f1d2bc70700 1 -- 172.21.15.118:0/4287627500 >> 172.21.15.118:0/4287627500 conn(0x7f1d2406e060 msgr2=0x7f1d2406eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:56.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.397+0000 7f1d2bc70700 1 -- 172.21.15.118:0/4287627500 shutdown_connections 2023-07-13T13:51:56.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.397+0000 7f1d2bc70700 1 -- 172.21.15.118:0/4287627500 wait complete. 2023-07-13T13:51:56.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.398+0000 7f1d2bc70700 1 Processor -- start 2023-07-13T13:51:56.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.398+0000 7f1d2bc70700 1 -- start start 2023-07-13T13:51:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.399+0000 7f1d2bc70700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d241529b0 0x7f1d240ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.399+0000 7f1d2bc70700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d24152d80 0x7f1d240ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.399+0000 7f1d2bc70700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24159500 0x7f1d24145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.399+0000 7f1d2bc70700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d24147410 con 0x7f1d24152d80 2023-07-13T13:51:56.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.399+0000 7f1d2bc70700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d240ad440 con 0x7f1d241529b0 2023-07-13T13:51:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.399+0000 7f1d2bc70700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d240ad700 con 0x7f1d24159500 2023-07-13T13:51:56.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.400+0000 7f1d2a20d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24159500 0x7f1d24145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.400+0000 7f1d29a0c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d241529b0 0x7f1d240ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.400+0000 7f1d2a20d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24159500 0x7f1d24145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:51114/0 (socket says 172.21.15.118:51114) 2023-07-13T13:51:56.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.400+0000 7f1d2a20d700 1 -- 172.21.15.118:0/1510045624 learned_addr learned my addr 172.21.15.118:0/1510045624 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:56.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.404+0000 7f1d2a20d700 1 -- 172.21.15.118:0/1510045624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d241529b0 msgr2=0x7f1d240ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:56.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.404+0000 7f1d2a20d700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d241529b0 0x7f1d240ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:56.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.404+0000 7f1d2a20d700 1 -- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d24152d80 msgr2=0x7f1d240ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:56.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.404+0000 7f1d2a20d700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d24152d80 0x7f1d240ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:56.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.404+0000 7f1d2a20d700 1 -- 172.21.15.118:0/1510045624 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d140094a0 con 0x7f1d24159500 2023-07-13T13:51:56.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.406+0000 7f1d2a20d700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24159500 0x7f1d24145100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00b9e0 tx=0x7f1d1c00bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:56.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.410+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00d8e0 con 0x7f1d24159500 2023-07-13T13:51:56.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.410+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c00da60 con 0x7f1d24159500 2023-07-13T13:51:56.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.410+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d24157e20 con 0x7f1d24159500 2023-07-13T13:51:56.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.410+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c00de10 con 0x7f1d24159500 2023-07-13T13:51:56.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.410+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d24147900 con 0x7f1d24159500 2023-07-13T13:51:56.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.411+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2404e280 con 0x7f1d24159500 2023-07-13T13:51:56.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.535+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 4) v1 ==== 88748+0+0 (secure 0 0 0) 0x7f1d1c015420 con 0x7f1d24159500 2023-07-13T13:51:56.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.536+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f1d1c011070 con 0x7f1d24159500 2023-07-13T13:51:56.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.540+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1d1c054bd0 con 0x7f1d24159500 2023-07-13T13:51:56.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:56.609+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1d241585f0 con 0x7f1d24159500 2023-07-13T13:51:56.888 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:56.914+0000 7feaadfb5700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-13T13:51:56.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:57.010+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mgrmap(e 5) v1 ==== 88875+0+0 (secure 0 0 0) 0x7f1d1c054850 con 0x7f1d24159500 2023-07-13T13:51:56.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:57.011+0000 7f1d1a7fc700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d0806d8e0 0x7f1d0806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:56.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:57.011+0000 7f1d29a0c700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d0806d8e0 0x7f1d0806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:56.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:57.011+0000 7f1d29a0c700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d0806d8e0 0x7f1d0806fcc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005910 tx=0x7f1d20009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:57.044 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T13:51:57.071+0000 7feaadfb5700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-13T13:51:57.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:57.964+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 8 ==== mgrmap(e 6) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f1d1c076f30 con 0x7f1d24159500 2023-07-13T13:51:58.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.452+0000 7f1d1a7fc700 1 -- 172.21.15.118:0/1510045624 <== mon.2 v2:172.21.15.123:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1d1c055db0 con 0x7f1d24159500 2023-07-13T13:51:58.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d0806d8e0 msgr2=0x7f1d0806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:58.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d0806d8e0 0x7f1d0806fcc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005910 tx=0x7f1d20009040 comp rx=0 tx=0).stop 2023-07-13T13:51:58.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24159500 msgr2=0x7f1d24145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:58.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24159500 0x7f1d24145100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c00b9e0 tx=0x7f1d1c00bcf0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 shutdown_connections 2023-07-13T13:51:58.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d0806d8e0 0x7f1d0806fcc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d241529b0 0x7f1d240ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d24159500 0x7f1d24145100 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 --2- 172.21.15.118:0/1510045624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d24152d80 0x7f1d240ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 >> 172.21.15.118:0/1510045624 conn(0x7f1d2406e060 msgr2=0x7f1d2406fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:58.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 shutdown_connections 2023-07-13T13:51:58.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.453+0000 7f1d2bc70700 1 -- 172.21.15.118:0/1510045624 wait complete. 2023-07-13T13:51:58.429 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'rbd' created 2023-07-13T13:51:58.439 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-13T13:51:58.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.593+0000 7f73707f8700 1 Processor -- start 2023-07-13T13:51:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.593+0000 7f73707f8700 1 -- start start 2023-07-13T13:51:58.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.594+0000 7f73707f8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73681565e0 0x7f736806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.594+0000 7f73707f8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7368070000 0x7f73680c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.594+0000 7f73707f8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73680c1820 con 0x7f73681507d0 2023-07-13T13:51:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.594+0000 7f73707f8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7368070400 con 0x7f7368070000 2023-07-13T13:51:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.594+0000 7f73707f8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73680c1b00 con 0x7f73681565e0 2023-07-13T13:51:58.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.595+0000 7f736dd93700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73681565e0 0x7f736806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:58.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.595+0000 7f736dd93700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73681565e0 0x7f736806fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:58728/0 (socket says 172.21.15.118:58728) 2023-07-13T13:51:58.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.595+0000 7f736dd93700 1 -- 172.21.15.118:0/1130573255 learned_addr learned my addr 172.21.15.118:0/1130573255 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.598+0000 7f736ed95700 1 --2- 172.21.15.118:0/1130573255 >> v2:172.21.15.118:3300/0 conn(0x7f7368070000 0x7f73680c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.598+0000 7f736dd93700 1 -- 172.21.15.118:0/1130573255 >> v2:172.21.15.118:3300/0 conn(0x7f7368070000 msgr2=0x7f73680c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.598+0000 7f736dd93700 1 --2- 172.21.15.118:0/1130573255 >> v2:172.21.15.118:3300/0 conn(0x7f7368070000 0x7f73680c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.598+0000 7f736dd93700 1 -- 172.21.15.118:0/1130573255 >> v1:172.21.15.123:6789/0 conn(0x7f73681507d0 legacy=0x7f736815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:58.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.598+0000 7f736dd93700 1 -- 172.21.15.118:0/1130573255 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73680c1de0 con 0x7f73681565e0 2023-07-13T13:51:58.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.600+0000 7f736dd93700 1 --2- 172.21.15.118:0/1130573255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f736806fac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7368070a80 tx=0x7f7358009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9136f0c297178038 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:58.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.610+0000 7f736d592700 1 -- 172.21.15.118:0/1130573255 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800b870 con 0x7f73681565e0 2023-07-13T13:51:58.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.610+0000 7f736d592700 1 -- 172.21.15.118:0/1130573255 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735800b9d0 con 0x7f73681565e0 2023-07-13T13:51:58.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.610+0000 7f736d592700 1 -- 172.21.15.118:0/1130573255 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800bd60 con 0x7f73681565e0 2023-07-13T13:51:58.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.610+0000 7f73707f8700 1 -- 172.21.15.118:0/1130573255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 msgr2=0x7f736806fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:58.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.610+0000 7f73707f8700 1 --2- 172.21.15.118:0/1130573255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f736806fac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7368070a80 tx=0x7f7358009bd0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.611+0000 7f73707f8700 1 -- 172.21.15.118:0/1130573255 shutdown_connections 2023-07-13T13:51:58.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.611+0000 7f73707f8700 1 --2- 172.21.15.118:0/1130573255 >> v2:172.21.15.118:3300/0 conn(0x7f7368070000 0x7f73680c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.611+0000 7f73707f8700 1 --2- 172.21.15.118:0/1130573255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f736806fac0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.611+0000 7f73707f8700 1 -- 172.21.15.118:0/1130573255 >> 172.21.15.118:0/1130573255 conn(0x7f736806e060 msgr2=0x7f736806eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:58.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.611+0000 7f73707f8700 1 -- 172.21.15.118:0/1130573255 shutdown_connections 2023-07-13T13:51:58.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.611+0000 7f73707f8700 1 -- 172.21.15.118:0/1130573255 wait complete. 2023-07-13T13:51:58.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.612+0000 7f73707f8700 1 Processor -- start 2023-07-13T13:51:58.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.612+0000 7f73707f8700 1 -- start start 2023-07-13T13:51:58.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.612+0000 7f73707f8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7368070000 0x7f73680b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:58.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.612+0000 7f73707f8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73681507d0 0x7f73680cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:58.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.612+0000 7f73707f8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f73680cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:58.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.612+0000 7f73707f8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73680ca9c0 con 0x7f73681507d0 2023-07-13T13:51:58.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.612+0000 7f73707f8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73680b0e50 con 0x7f73681565e0 2023-07-13T13:51:58.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.612+0000 7f73707f8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73680ca420 con 0x7f7368070000 2023-07-13T13:51:58.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.613+0000 7f736e594700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7368070000 0x7f73680b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:58.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.613+0000 7f736ed95700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f73680cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.613+0000 7f736ed95700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f73680cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:58740/0 (socket says 172.21.15.118:58740) 2023-07-13T13:51:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.613+0000 7f736ed95700 1 -- 172.21.15.118:0/2310113719 learned_addr learned my addr 172.21.15.118:0/2310113719 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.617+0000 7f736ed95700 1 -- 172.21.15.118:0/2310113719 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7368070000 msgr2=0x7f73680b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:58.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.617+0000 7f736ed95700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7368070000 0x7f73680b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.617+0000 7f736ed95700 1 -- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73681507d0 msgr2=0x7f73680cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:58.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.617+0000 7f736ed95700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73681507d0 0x7f73680cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:58.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.617+0000 7f736ed95700 1 -- 172.21.15.118:0/2310113719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7358009550 con 0x7f73681565e0 2023-07-13T13:51:58.595 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.620+0000 7f736ed95700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f73680cbed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f736000cd70 tx=0x7f736000a570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:58.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.674+0000 7f735effd700 1 -- 172.21.15.118:0/2310113719 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360003a20 con 0x7f73681565e0 2023-07-13T13:51:58.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.674+0000 7f735effd700 1 -- 172.21.15.118:0/2310113719 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360003b80 con 0x7f73681565e0 2023-07-13T13:51:58.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.674+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73680af910 con 0x7f73681565e0 2023-07-13T13:51:58.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.674+0000 7f735effd700 1 -- 172.21.15.118:0/2310113719 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360004020 con 0x7f73681565e0 2023-07-13T13:51:58.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.674+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73680b0a70 con 0x7f73681565e0 2023-07-13T13:51:58.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.675+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73680caf20 con 0x7f73681565e0 2023-07-13T13:51:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.940+0000 7f735effd700 1 -- 172.21.15.118:0/2310113719 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 6) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f7360004180 con 0x7f73681565e0 2023-07-13T13:51:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.940+0000 7f735effd700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f734c06ac50 0x7f734c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.940+0000 7f736e594700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f734c06ac50 0x7f734c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:58.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.941+0000 7f736e594700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f734c06ac50 0x7f734c06d100 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7364007fd0 tx=0x7f7364009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.943+0000 7f735effd700 1 -- 172.21.15.118:0/2310113719 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f7360012070 con 0x7f73681565e0 2023-07-13T13:51:58.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:58.953+0000 7f735effd700 1 -- 172.21.15.118:0/2310113719 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7360055070 con 0x7f73681565e0 2023-07-13T13:51:59.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.151+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f73680b0f90 con 0x7f73681565e0 2023-07-13T13:51:59.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.761+0000 7f735effd700 1 -- 172.21.15.118:0/2310113719 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f73680b0f90 con 0x7f73681565e0 2023-07-13T13:51:59.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f734c06ac50 msgr2=0x7f734c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:59.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f734c06ac50 0x7f734c06d100 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7364007fd0 tx=0x7f7364009040 comp rx=0 tx=0).stop 2023-07-13T13:51:59.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 msgr2=0x7f73680cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:59.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f73680cbed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f736000cd70 tx=0x7f736000a570 comp rx=0 tx=0).stop 2023-07-13T13:51:59.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 shutdown_connections 2023-07-13T13:51:59.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f734c06ac50 0x7f734c06d100 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73681565e0 0x7f73680cbed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7368070000 0x7f73680b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 --2- 172.21.15.118:0/2310113719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f73681507d0 0x7f73680cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 >> 172.21.15.118:0/2310113719 conn(0x7f736806e060 msgr2=0x7f73680c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:59.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 shutdown_connections 2023-07-13T13:51:59.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.763+0000 7f73707f8700 1 -- 172.21.15.118:0/2310113719 wait complete. 2023-07-13T13:51:59.739 INFO:teuthology.orchestra.run.smithi118.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-13T13:51:59.748 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-13T13:51:59.749 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-07-13T13:51:59.749 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-13T13:51:59.749 DEBUG:teuthology.orchestra.run.smithi118:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-07-13T13:51:59.751 INFO:tasks.ceph.mds.a:Started 2023-07-13T13:51:59.752 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-07-13T13:51:59.752 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-13T13:51:59.752 DEBUG:teuthology.orchestra.run.smithi118:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-07-13T13:51:59.754 INFO:tasks.ceph.mds.c:Started 2023-07-13T13:51:59.754 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-07-13T13:51:59.755 INFO:tasks.ceph.mds.e:Restarting daemon 2023-07-13T13:51:59.755 DEBUG:teuthology.orchestra.run.smithi118:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-07-13T13:51:59.757 INFO:tasks.ceph.mds.e:Started 2023-07-13T13:51:59.757 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-07-13T13:51:59.757 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-13T13:51:59.757 DEBUG:teuthology.orchestra.run.smithi123:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-07-13T13:51:59.759 INFO:tasks.ceph.mds.b:Started 2023-07-13T13:51:59.760 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-07-13T13:51:59.760 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-13T13:51:59.760 DEBUG:teuthology.orchestra.run.smithi123:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-07-13T13:51:59.762 INFO:tasks.ceph.mds.d:Started 2023-07-13T13:51:59.762 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-07-13T13:51:59.762 INFO:tasks.ceph.mds.f:Restarting daemon 2023-07-13T13:51:59.763 DEBUG:teuthology.orchestra.run.smithi123:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-07-13T13:51:59.764 INFO:tasks.ceph.mds.f:Started 2023-07-13T13:51:59.765 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-13T13:51:59.765 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:51:59.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.939+0000 7f55d87ef700 1 Processor -- start 2023-07-13T13:51:59.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.939+0000 7f55d87ef700 1 -- start start 2023-07-13T13:51:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.940+0000 7f55d87ef700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55d0071a50 0x7f55d00c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.940+0000 7f55d87ef700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55d00c6690 0x7f55d015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.940+0000 7f55d87ef700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d00716a0 con 0x7f55d014f840 2023-07-13T13:51:59.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.941+0000 7f55d87ef700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d00c6ad0 con 0x7f55d00c6690 2023-07-13T13:51:59.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.941+0000 7f55d87ef700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00c7f30 con 0x7f55d0071a50 2023-07-13T13:51:59.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.941+0000 7f55d6d8c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55d00c6690 0x7f55d015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:59.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.942+0000 7f55d658b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f55d014f840 0x7f55d00cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:49266/0 (socket says 172.21.15.118:49266) 2023-07-13T13:51:59.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.942+0000 7f55d658b700 1 -- 172.21.15.118:0/2600126615 learned_addr learned my addr 172.21.15.118:0/2600126615 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:51:59.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.948+0000 7f55d6d8c700 1 -- 172.21.15.118:0/2600126615 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55d0071a50 msgr2=0x7f55d00c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:51:59.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.948+0000 7f55d6d8c700 1 --2- 172.21.15.118:0/2600126615 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55d0071a50 0x7f55d00c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.948+0000 7f55d6d8c700 1 -- 172.21.15.118:0/2600126615 >> v1:172.21.15.123:6789/0 conn(0x7f55d014f840 legacy=0x7f55d00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:59.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.948+0000 7f55d6d8c700 1 -- 172.21.15.118:0/2600126615 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d0156130 con 0x7f55d00c6690 2023-07-13T13:51:59.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.955+0000 7f55d6d8c700 1 --2- 172.21.15.118:0/2600126615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d00c6690 0x7f55d015fdf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009d90 tx=0x7f55c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57fbc6c4457f6326 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.964+0000 7f55d5589700 1 -- 172.21.15.118:0/2600126615 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c800e070 con 0x7f55d00c6690 2023-07-13T13:51:59.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d5589700 1 -- 172.21.15.118:0/2600126615 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c800bbd0 con 0x7f55d00c6690 2023-07-13T13:51:59.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d5589700 1 -- 172.21.15.118:0/2600126615 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8012430 con 0x7f55d00c6690 2023-07-13T13:51:59.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d87ef700 1 -- 172.21.15.118:0/2600126615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d00c6690 msgr2=0x7f55d015fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:59.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d87ef700 1 --2- 172.21.15.118:0/2600126615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d00c6690 0x7f55d015fdf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009d90 tx=0x7f55c800b330 comp rx=0 tx=0).stop 2023-07-13T13:51:59.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d87ef700 1 -- 172.21.15.118:0/2600126615 shutdown_connections 2023-07-13T13:51:59.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d87ef700 1 --2- 172.21.15.118:0/2600126615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d00c6690 0x7f55d015fdf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d87ef700 1 --2- 172.21.15.118:0/2600126615 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55d0071a50 0x7f55d00c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d87ef700 1 -- 172.21.15.118:0/2600126615 >> 172.21.15.118:0/2600126615 conn(0x7f55d006cf10 msgr2=0x7f55d006d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:51:59.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d87ef700 1 -- 172.21.15.118:0/2600126615 shutdown_connections 2023-07-13T13:51:59.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.965+0000 7f55d87ef700 1 -- 172.21.15.118:0/2600126615 wait complete. 2023-07-13T13:51:59.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.967+0000 7f55d87ef700 1 Processor -- start 2023-07-13T13:51:59.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.967+0000 7f55d87ef700 1 -- start start 2023-07-13T13:51:59.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.968+0000 7f55d87ef700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55d0071a50 0x7f55d0158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:59.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.968+0000 7f55d87ef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55d00c6690 0x7f55d0152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:59.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.968+0000 7f55d87ef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d014f840 0x7f55d01511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:51:59.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.968+0000 7f55d87ef700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d01583c0 con 0x7f55d00c6690 2023-07-13T13:51:59.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.968+0000 7f55d87ef700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0150140 con 0x7f55d014f840 2023-07-13T13:51:59.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.968+0000 7f55d87ef700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00c51d0 con 0x7f55d0071a50 2023-07-13T13:51:59.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.969+0000 7f55d5d8a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55d00c6690 0x7f55d0152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:59.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.969+0000 7f55d6d8c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d014f840 0x7f55d01511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:51:59.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.970+0000 7f55d5d8a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55d00c6690 0x7f55d0152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50566/0 (socket says 172.21.15.118:50566) 2023-07-13T13:51:59.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.970+0000 7f55d5d8a700 1 -- 172.21.15.118:0/828324957 learned_addr learned my addr 172.21.15.118:0/828324957 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:51:59.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.976+0000 7f55d6d8c700 1 -- 172.21.15.118:0/828324957 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55d0071a50 msgr2=0x7f55d0158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:59.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.976+0000 7f55d6d8c700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55d0071a50 0x7f55d0158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.976+0000 7f55d6d8c700 1 -- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55d00c6690 msgr2=0x7f55d0152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:51:59.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.976+0000 7f55d6d8c700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55d00c6690 0x7f55d0152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:51:59.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.976+0000 7f55d6d8c700 1 -- 172.21.15.118:0/828324957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8009a70 con 0x7f55d014f840 2023-07-13T13:51:59.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.979+0000 7f55d6d8c700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d014f840 0x7f55d01511d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f55d00c7e60 tx=0x7f55c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:51:59.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.983+0000 7f55c6ffd700 1 -- 172.21.15.118:0/828324957 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8012e50 con 0x7f55d014f840 2023-07-13T13:51:59.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.983+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d0152640 con 0x7f55d014f840 2023-07-13T13:51:59.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.983+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d0143f40 con 0x7f55d014f840 2023-07-13T13:51:59.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.984+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d00743c0 con 0x7f55d014f840 2023-07-13T13:51:59.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.985+0000 7f55c6ffd700 1 -- 172.21.15.118:0/828324957 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c8020070 con 0x7f55d014f840 2023-07-13T13:51:59.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:51:59.985+0000 7f55c6ffd700 1 -- 172.21.15.118:0/828324957 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8004240 con 0x7f55d014f840 2023-07-13T13:52:00.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.179+0000 7f55c6ffd700 1 -- 172.21.15.118:0/828324957 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 6) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f55c80043a0 con 0x7f55d014f840 2023-07-13T13:52:00.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.180+0000 7f55c6ffd700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f55b406ac50 0x7f55b406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:00.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.180+0000 7f55d658b700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f55b406ac50 0x7f55b406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:00.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.181+0000 7f55d658b700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f55b406ac50 0x7f55b406d100 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0015d0 tx=0x7f55cc007ad0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:00.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.213+0000 7f55c6ffd700 1 -- 172.21.15.118:0/828324957 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f55c8022070 con 0x7f55d014f840 2023-07-13T13:52:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.407+0000 7f55c6ffd700 1 -- 172.21.15.118:0/828324957 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f55c8056d10 con 0x7f55d014f840 2023-07-13T13:52:00.598 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.624+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55d0071830 con 0x7f55d014f840 2023-07-13T13:52:00.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.737+0000 7f55c6ffd700 1 -- 172.21.15.118:0/828324957 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f55c80570e0 con 0x7f55d014f840 2023-07-13T13:52:00.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.937+0000 7f55c6ffd700 1 -- 172.21.15.118:0/828324957 <== mon.1 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14684 (secure 0 0 0) 0x7f55c8089370 con 0x7f55d014f840 2023-07-13T13:52:00.911 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:00.912 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":18,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:51:59.355517+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:00.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f55b406ac50 msgr2=0x7f55b406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:00.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f55b406ac50 0x7f55b406d100 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0015d0 tx=0x7f55cc007ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:00.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d014f840 msgr2=0x7f55d01511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:00.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d014f840 0x7f55d01511d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f55d00c7e60 tx=0x7f55c8004ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:00.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 shutdown_connections 2023-07-13T13:52:00.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f55b406ac50 0x7f55b406d100 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:00.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55d014f840 0x7f55d01511d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:00.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55d0071a50 0x7f55d0158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:00.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 --2- 172.21.15.118:0/828324957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55d00c6690 0x7f55d0152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:00.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 >> 172.21.15.118:0/828324957 conn(0x7f55d006cf10 msgr2=0x7f55d006d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:00.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 shutdown_connections 2023-07-13T13:52:00.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:00.939+0000 7f55d87ef700 1 -- 172.21.15.118:0/828324957 wait complete. 2023-07-13T13:52:00.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-13T13:51:55.327381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-13T13:51:57.354158+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-13T13:52:00.928 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-13T13:52:01.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.090+0000 7fa44111e700 1 Processor -- start 2023-07-13T13:52:01.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.090+0000 7fa44111e700 1 -- start start 2023-07-13T13:52:01.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.091+0000 7fa44111e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa43c0c5530 0x7fa43c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.091+0000 7fa44111e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c0c7490 con 0x7fa43c070d10 2023-07-13T13:52:01.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.091+0000 7fa44111e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c155af0 con 0x7fa43c14ed40 2023-07-13T13:52:01.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.091+0000 7fa44111e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c071e10 con 0x7fa43c0c5530 2023-07-13T13:52:01.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.101+0000 7fa43b59e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa43c070d10 0x7fa43c0710e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40890/0 (socket says 172.21.15.118:40890) 2023-07-13T13:52:01.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.101+0000 7fa43b59e700 1 -- 172.21.15.118:0/1499884933 learned_addr learned my addr 172.21.15.118:0/1499884933 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:01.078 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.104+0000 7fa43a59c700 1 --2- 172.21.15.118:0/1499884933 >> v2:172.21.15.123:3300/0 conn(0x7fa43c0c5530 0x7fa43c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:01.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.110+0000 7fa43a59c700 1 -- 172.21.15.118:0/1499884933 >> v1:172.21.15.123:6789/0 conn(0x7fa43c14ed40 legacy=0x7fa43c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.110+0000 7fa43a59c700 1 -- 172.21.15.118:0/1499884933 >> v1:172.21.15.118:6789/0 conn(0x7fa43c070d10 legacy=0x7fa43c0710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.084 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.110+0000 7fa43a59c700 1 -- 172.21.15.118:0/1499884933 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0c6150 con 0x7fa43c0c5530 2023-07-13T13:52:01.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.115+0000 7fa43a59c700 1 --2- 172.21.15.118:0/1499884933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa43c0c5530 0x7fa43c1555b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa430009840 tx=0x7fa430009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d094f3fc83ec22ee server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:01.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.119+0000 7fa439d9b700 1 -- 172.21.15.118:0/1499884933 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430011830 con 0x7fa43c0c5530 2023-07-13T13:52:01.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.123+0000 7fa439d9b700 1 -- 172.21.15.118:0/1499884933 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430011990 con 0x7fa43c0c5530 2023-07-13T13:52:01.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.124+0000 7fa44111e700 1 -- 172.21.15.118:0/1499884933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa43c0c5530 msgr2=0x7fa43c1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.124+0000 7fa44111e700 1 --2- 172.21.15.118:0/1499884933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa43c0c5530 0x7fa43c1555b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa430009840 tx=0x7fa430009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:01.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.124+0000 7fa44111e700 1 -- 172.21.15.118:0/1499884933 shutdown_connections 2023-07-13T13:52:01.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.124+0000 7fa44111e700 1 --2- 172.21.15.118:0/1499884933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa43c0c5530 0x7fa43c1555b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.124+0000 7fa44111e700 1 -- 172.21.15.118:0/1499884933 >> 172.21.15.118:0/1499884933 conn(0x7fa43c0cb800 msgr2=0x7fa43c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:01.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.124+0000 7fa44111e700 1 -- 172.21.15.118:0/1499884933 shutdown_connections 2023-07-13T13:52:01.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.124+0000 7fa44111e700 1 -- 172.21.15.118:0/1499884933 wait complete. 2023-07-13T13:52:01.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.126+0000 7fa44111e700 1 Processor -- start 2023-07-13T13:52:01.100 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.126+0000 7fa44111e700 1 -- start start 2023-07-13T13:52:01.100 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.127+0000 7fa44111e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa43c070d10 0x7fa43c148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.127+0000 7fa44111e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa43c0c5530 0x7fa43c1494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.127+0000 7fa44111e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa43c14ed40 0x7fa43c14f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.127+0000 7fa44111e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0c3160 con 0x7fa43c14ed40 2023-07-13T13:52:01.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.127+0000 7fa44111e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c150ea0 con 0x7fa43c0c5530 2023-07-13T13:52:01.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.127+0000 7fa44111e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0c3420 con 0x7fa43c070d10 2023-07-13T13:52:01.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.129+0000 7fa43ad9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa43c070d10 0x7fa43c148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:01.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.129+0000 7fa43ad9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa43c070d10 0x7fa43c148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:43334/0 (socket says 172.21.15.118:43334) 2023-07-13T13:52:01.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.129+0000 7fa43ad9d700 1 -- 172.21.15.118:0/1167651685 learned_addr learned my addr 172.21.15.118:0/1167651685 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:01.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.132+0000 7fa43b59e700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa43c14ed40 0x7fa43c14f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:01.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.134+0000 7fa43ad9d700 1 -- 172.21.15.118:0/1167651685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa43c0c5530 msgr2=0x7fa43c1494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.134+0000 7fa43ad9d700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa43c0c5530 0x7fa43c1494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.134+0000 7fa43ad9d700 1 -- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa43c14ed40 msgr2=0x7fa43c14f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.134+0000 7fa43ad9d700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa43c14ed40 0x7fa43c14f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.134+0000 7fa43ad9d700 1 -- 172.21.15.118:0/1167651685 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300094a0 con 0x7fa43c070d10 2023-07-13T13:52:01.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.137+0000 7fa43ad9d700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa43c070d10 0x7fa43c148f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00c4e0 tx=0x7fa42c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:01.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.142+0000 7fa4237fe700 1 -- 172.21.15.118:0/1167651685 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0052d0 con 0x7fa43c070d10 2023-07-13T13:52:01.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.142+0000 7fa4237fe700 1 -- 172.21.15.118:0/1167651685 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c005430 con 0x7fa43c070d10 2023-07-13T13:52:01.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.142+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c0c3700 con 0x7fa43c070d10 2023-07-13T13:52:01.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.142+0000 7fa4237fe700 1 -- 172.21.15.118:0/1167651685 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0038c0 con 0x7fa43c070d10 2023-07-13T13:52:01.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.142+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c0c3cc0 con 0x7fa43c070d10 2023-07-13T13:52:01.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.143+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c04e280 con 0x7fa43c070d10 2023-07-13T13:52:01.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.166+0000 7fa4237fe700 1 -- 172.21.15.118:0/1167651685 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa42c003a20 con 0x7fa43c070d10 2023-07-13T13:52:01.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.167+0000 7fa4237fe700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa42806f120 0x7fa4280715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.167+0000 7fa43a59c700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa42806f120 0x7fa4280715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:01.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.167+0000 7fa43a59c700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa42806f120 0x7fa4280715d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa43c1400e0 tx=0x7fa430010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:01.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.170+0000 7fa4237fe700 1 -- 172.21.15.118:0/1167651685 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa42c05b6d0 con 0x7fa43c070d10 2023-07-13T13:52:01.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.430+0000 7fa4237fe700 1 -- 172.21.15.118:0/1167651685 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa42c053a50 con 0x7fa43c070d10 2023-07-13T13:52:01.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.626+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa43c155af0 con 0x7fa43c070d10 2023-07-13T13:52:01.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.658+0000 7fa4237fe700 1 -- 172.21.15.118:0/1167651685 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa43c155af0 con 0x7fa43c070d10 2023-07-13T13:52:01.633 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-07-13T13:52:01.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa42806f120 msgr2=0x7fa4280715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa42806f120 0x7fa4280715d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa43c1400e0 tx=0x7fa430010000 comp rx=0 tx=0).stop 2023-07-13T13:52:01.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa43c070d10 msgr2=0x7fa43c148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa43c070d10 0x7fa43c148f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00c4e0 tx=0x7fa42c00c7f0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 shutdown_connections 2023-07-13T13:52:01.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa42806f120 0x7fa4280715d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa43c14ed40 0x7fa43c14f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa43c070d10 0x7fa43c148f80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 --2- 172.21.15.118:0/1167651685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa43c0c5530 0x7fa43c1494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.661+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 >> 172.21.15.118:0/1167651685 conn(0x7fa43c0cb800 msgr2=0x7fa43c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:01.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.662+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 shutdown_connections 2023-07-13T13:52:01.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.662+0000 7fa44111e700 1 -- 172.21.15.118:0/1167651685 wait complete. 2023-07-13T13:52:01.649 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-13T13:52:01.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.809+0000 7f9c52f38700 1 Processor -- start 2023-07-13T13:52:01.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.809+0000 7f9c52f38700 1 -- start start 2023-07-13T13:52:01.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.810+0000 7f9c52f38700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c4c158640 0x7f9c4c0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.810+0000 7f9c52f38700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c158b80 con 0x7f9c4c070dd0 2023-07-13T13:52:01.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.810+0000 7f9c52f38700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c158e60 con 0x7f9c4c152970 2023-07-13T13:52:01.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.810+0000 7f9c52f38700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c159140 con 0x7f9c4c158640 2023-07-13T13:52:01.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.817+0000 7f9c514d5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c4c158640 0x7f9c4c0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:01.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.819+0000 7f9c514d5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c4c158640 0x7f9c4c0c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:49416/0 (socket says 172.21.15.118:49416) 2023-07-13T13:52:01.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.819+0000 7f9c514d5700 1 -- 172.21.15.118:0/3765549835 learned_addr learned my addr 172.21.15.118:0/3765549835 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:01.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.839+0000 7f9c514d5700 1 -- 172.21.15.118:0/3765549835 >> v1:172.21.15.123:6789/0 conn(0x7f9c4c152970 legacy=0x7f9c4c071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.839+0000 7f9c514d5700 1 -- 172.21.15.118:0/3765549835 >> v1:172.21.15.118:6789/0 conn(0x7f9c4c070dd0 legacy=0x7f9c4c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.839+0000 7f9c514d5700 1 -- 172.21.15.118:0/3765549835 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c159420 con 0x7f9c4c158640 2023-07-13T13:52:01.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.895+0000 7f9c514d5700 1 --2- 172.21.15.118:0/3765549835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c0c8470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009e50 tx=0x7f9c4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e218bd6e043dee5 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:01.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.901+0000 7f9c4b7fe700 1 -- 172.21.15.118:0/3765549835 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400e070 con 0x7f9c4c158640 2023-07-13T13:52:01.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.901+0000 7f9c4b7fe700 1 -- 172.21.15.118:0/3765549835 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4400b9c0 con 0x7f9c4c158640 2023-07-13T13:52:01.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.901+0000 7f9c4b7fe700 1 -- 172.21.15.118:0/3765549835 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400bd70 con 0x7f9c4c158640 2023-07-13T13:52:01.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.902+0000 7f9c52f38700 1 -- 172.21.15.118:0/3765549835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 msgr2=0x7f9c4c0c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.902+0000 7f9c52f38700 1 --2- 172.21.15.118:0/3765549835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c0c8470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009e50 tx=0x7f9c4400b330 comp rx=0 tx=0).stop 2023-07-13T13:52:01.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.902+0000 7f9c52f38700 1 -- 172.21.15.118:0/3765549835 shutdown_connections 2023-07-13T13:52:01.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.902+0000 7f9c52f38700 1 --2- 172.21.15.118:0/3765549835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c0c8470 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.902+0000 7f9c52f38700 1 -- 172.21.15.118:0/3765549835 >> 172.21.15.118:0/3765549835 conn(0x7f9c4c06cf60 msgr2=0x7f9c4c06b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:01.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.902+0000 7f9c52f38700 1 -- 172.21.15.118:0/3765549835 shutdown_connections 2023-07-13T13:52:01.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.902+0000 7f9c52f38700 1 -- 172.21.15.118:0/3765549835 wait complete. 2023-07-13T13:52:01.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.903+0000 7f9c52f38700 1 Processor -- start 2023-07-13T13:52:01.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.903+0000 7f9c52f38700 1 -- start start 2023-07-13T13:52:01.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.904+0000 7f9c52f38700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c4c070dd0 0x7f9c4c0c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.904+0000 7f9c52f38700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c4c152970 0x7f9c4c0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.904+0000 7f9c52f38700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c1dea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:01.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.904+0000 7f9c52f38700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c1ef2e0 con 0x7f9c4c070dd0 2023-07-13T13:52:01.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.904+0000 7f9c52f38700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c1ee3f0 con 0x7f9c4c158640 2023-07-13T13:52:01.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.904+0000 7f9c52f38700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c1ee6d0 con 0x7f9c4c152970 2023-07-13T13:52:01.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.905+0000 7f9c514d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c1dea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:01.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.905+0000 7f9c514d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c1dea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:49424/0 (socket says 172.21.15.118:49424) 2023-07-13T13:52:01.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.905+0000 7f9c514d5700 1 -- 172.21.15.118:0/583657356 learned_addr learned my addr 172.21.15.118:0/583657356 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:01.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.910+0000 7f9c514d5700 1 -- 172.21.15.118:0/583657356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c4c152970 msgr2=0x7f9c4c0c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.910+0000 7f9c514d5700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c4c152970 0x7f9c4c0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.910+0000 7f9c514d5700 1 -- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c4c070dd0 msgr2=0x7f9c4c0c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:01.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.910+0000 7f9c514d5700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c4c070dd0 0x7f9c4c0c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:01.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.910+0000 7f9c514d5700 1 -- 172.21.15.118:0/583657356 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44009b30 con 0x7f9c4c158640 2023-07-13T13:52:01.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.913+0000 7f9c514d5700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c1dea50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c06d890 tx=0x7f9c44004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:01.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.918+0000 7f9c497fa700 1 -- 172.21.15.118:0/583657356 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44004960 con 0x7f9c4c158640 2023-07-13T13:52:01.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.919+0000 7f9c497fa700 1 -- 172.21.15.118:0/583657356 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c440092e0 con 0x7f9c4c158640 2023-07-13T13:52:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.919+0000 7f9c497fa700 1 -- 172.21.15.118:0/583657356 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4401b650 con 0x7f9c4c158640 2023-07-13T13:52:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.919+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c1ee9b0 con 0x7f9c4c158640 2023-07-13T13:52:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.919+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c1eef70 con 0x7f9c4c158640 2023-07-13T13:52:01.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:01.920+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c04e280 con 0x7f9c4c158640 2023-07-13T13:52:02.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.059+0000 7f9c497fa700 1 -- 172.21.15.118:0/583657356 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c4401b7b0 con 0x7f9c4c158640 2023-07-13T13:52:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.059+0000 7f9c497fa700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9c3006ace0 0x7f9c3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.059+0000 7f9c50cd4700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9c3006ace0 0x7f9c3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:02.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.060+0000 7f9c50cd4700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9c3006ace0 0x7f9c3006d190 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c40000fb0 tx=0x7f9c40007a30 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:02.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.089+0000 7f9c497fa700 1 -- 172.21.15.118:0/583657356 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9c4405e290 con 0x7f9c4c158640 2023-07-13T13:52:02.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.298+0000 7f9c497fa700 1 -- 172.21.15.118:0/583657356 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9c44056610 con 0x7f9c4c158640 2023-07-13T13:52:02.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.506+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c4c0cc050 con 0x7f9c4c158640 2023-07-13T13:52:02.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.550+0000 7f9c497fa700 1 -- 172.21.15.118:0/583657356 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c44059c30 con 0x7f9c4c158640 2023-07-13T13:52:02.525 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-07-13T13:52:02.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.552+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9c3006ace0 msgr2=0x7f9c3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:02.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.552+0000 7f9c52f38700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9c3006ace0 0x7f9c3006d190 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c40000fb0 tx=0x7f9c40007a30 comp rx=0 tx=0).stop 2023-07-13T13:52:02.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.552+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 msgr2=0x7f9c4c1dea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:02.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.552+0000 7f9c52f38700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c1dea50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c06d890 tx=0x7f9c44004ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:02.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.553+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 shutdown_connections 2023-07-13T13:52:02.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.553+0000 7f9c52f38700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9c3006ace0 0x7f9c3006d190 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:02.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.553+0000 7f9c52f38700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c4c158640 0x7f9c4c1dea50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:02.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.553+0000 7f9c52f38700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c4c070dd0 0x7f9c4c0c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:02.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.553+0000 7f9c52f38700 1 --2- 172.21.15.118:0/583657356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c4c152970 0x7f9c4c0c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:02.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.553+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 >> 172.21.15.118:0/583657356 conn(0x7f9c4c06cf60 msgr2=0x7f9c4c0c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:02.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.553+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 shutdown_connections 2023-07-13T13:52:02.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.553+0000 7f9c52f38700 1 -- 172.21.15.118:0/583657356 wait complete. 2023-07-13T13:52:02.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T13:52:02.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.697+0000 7f738379b700 1 Processor -- start 2023-07-13T13:52:02.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.697+0000 7f738379b700 1 -- start start 2023-07-13T13:52:02.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.698+0000 7f738379b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f737c0c1ab0 0x7f737c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:02.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.698+0000 7f738379b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c071a40 con 0x7f737c0c55b0 2023-07-13T13:52:02.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.698+0000 7f738379b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c071d00 con 0x7f737c150690 2023-07-13T13:52:02.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.698+0000 7f738379b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c0708f0 con 0x7f737c0c1ab0 2023-07-13T13:52:02.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.699+0000 7f7380d36700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f737c0c55b0 0x7f737c15ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40900/0 (socket says 172.21.15.118:40900) 2023-07-13T13:52:02.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.699+0000 7f7380d36700 1 -- 172.21.15.118:0/3458454869 learned_addr learned my addr 172.21.15.118:0/3458454869 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:02.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.699+0000 7f7381d38700 1 --2- 172.21.15.118:0/3458454869 >> v2:172.21.15.123:3300/0 conn(0x7f737c0c1ab0 0x7f737c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:02.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.703+0000 7f7373fff700 1 -- 172.21.15.118:0/3458454869 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547334393 0 0) 0x7f737c071a40 con 0x7f737c0c55b0 2023-07-13T13:52:02.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.703+0000 7f7373fff700 1 -- 172.21.15.118:0/3458454869 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73680035b0 con 0x7f737c0c55b0 2023-07-13T13:52:02.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.705+0000 7f7381d38700 1 -- 172.21.15.118:0/3458454869 >> v1:172.21.15.123:6789/0 conn(0x7f737c150690 legacy=0x7f737c0c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:02.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.705+0000 7f7381d38700 1 -- 172.21.15.118:0/3458454869 >> v1:172.21.15.118:6789/0 conn(0x7f737c0c55b0 legacy=0x7f737c15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:02.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.705+0000 7f7381d38700 1 -- 172.21.15.118:0/3458454869 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c071fc0 con 0x7f737c0c1ab0 2023-07-13T13:52:02.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.708+0000 7f7381d38700 1 --2- 172.21.15.118:0/3458454869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c0c1ab0 0x7f737c1599a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7374009d90 tx=0x7f737400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f44f1d409ada42e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:02.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.717+0000 7f7373fff700 1 -- 172.21.15.118:0/3458454869 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737400e070 con 0x7f737c0c1ab0 2023-07-13T13:52:02.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.717+0000 7f7373fff700 1 -- 172.21.15.118:0/3458454869 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737400bb20 con 0x7f737c0c1ab0 2023-07-13T13:52:02.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.717+0000 7f7373fff700 1 -- 172.21.15.118:0/3458454869 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374012430 con 0x7f737c0c1ab0 2023-07-13T13:52:02.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.717+0000 7f738379b700 1 -- 172.21.15.118:0/3458454869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c0c1ab0 msgr2=0x7f737c1599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:02.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.717+0000 7f738379b700 1 --2- 172.21.15.118:0/3458454869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c0c1ab0 0x7f737c1599a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7374009d90 tx=0x7f737400b330 comp rx=0 tx=0).stop 2023-07-13T13:52:02.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.718+0000 7f738379b700 1 -- 172.21.15.118:0/3458454869 shutdown_connections 2023-07-13T13:52:02.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.718+0000 7f738379b700 1 --2- 172.21.15.118:0/3458454869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c0c1ab0 0x7f737c1599a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:02.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.718+0000 7f738379b700 1 -- 172.21.15.118:0/3458454869 >> 172.21.15.118:0/3458454869 conn(0x7f737c0cb880 msgr2=0x7f737c0c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:02.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.718+0000 7f738379b700 1 -- 172.21.15.118:0/3458454869 shutdown_connections 2023-07-13T13:52:02.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.718+0000 7f738379b700 1 -- 172.21.15.118:0/3458454869 wait complete. 2023-07-13T13:52:02.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.719+0000 7f738379b700 1 Processor -- start 2023-07-13T13:52:02.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.719+0000 7f738379b700 1 -- start start 2023-07-13T13:52:02.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.720+0000 7f738379b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f737c0c1ab0 0x7f737c0c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:02.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.720+0000 7f738379b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f737c0c55b0 0x7f737c14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:02.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.720+0000 7f738379b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c150690 0x7f737c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:02.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.720+0000 7f738379b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c156b20 con 0x7f737c0c55b0 2023-07-13T13:52:02.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.720+0000 7f738379b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c14b4a0 con 0x7f737c150690 2023-07-13T13:52:02.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.720+0000 7f738379b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c14d220 con 0x7f737c0c1ab0 2023-07-13T13:52:02.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.720+0000 7f7380d36700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f737c0c55b0 0x7f737c14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:02.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.720+0000 7f7381537700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f737c0c1ab0 0x7f737c0c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:02.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.721+0000 7f7380d36700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f737c0c55b0 0x7f737c14c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40132/0 (socket says 172.21.15.118:40132) 2023-07-13T13:52:02.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.721+0000 7f7380d36700 1 -- 172.21.15.118:0/3361467209 learned_addr learned my addr 172.21.15.118:0/3361467209 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:02.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.721+0000 7f7381d38700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c150690 0x7f737c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:02.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.725+0000 7f7380d36700 1 -- 172.21.15.118:0/3361467209 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f737c0c1ab0 msgr2=0x7f737c0c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:02.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.725+0000 7f7380d36700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f737c0c1ab0 0x7f737c0c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:02.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.725+0000 7f7380d36700 1 -- 172.21.15.118:0/3361467209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c150690 msgr2=0x7f737c151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:02.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.725+0000 7f7380d36700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c150690 0x7f737c151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:02.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.725+0000 7f7380d36700 1 -- 172.21.15.118:0/3361467209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374009a70 con 0x7f737c0c55b0 2023-07-13T13:52:02.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.728+0000 7f7380d36700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f737c0c55b0 0x7f737c14c880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f736c005910 tx=0x7f736c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:02.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.734+0000 7f7371ffb700 1 -- 172.21.15.118:0/3361467209 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c005d70 con 0x7f737c0c55b0 2023-07-13T13:52:02.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.734+0000 7f7371ffb700 1 -- 172.21.15.118:0/3361467209 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c0070d0 con 0x7f737c0c55b0 2023-07-13T13:52:02.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.734+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c14d500 con 0x7f737c0c55b0 2023-07-13T13:52:02.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.734+0000 7f7371ffb700 1 -- 172.21.15.118:0/3361467209 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c007460 con 0x7f737c0c55b0 2023-07-13T13:52:02.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.734+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c14b9d0 con 0x7f737c0c55b0 2023-07-13T13:52:02.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.735+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c06b970 con 0x7f737c0c55b0 2023-07-13T13:52:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.805+0000 7f7371ffb700 1 -- 172.21.15.118:0/3361467209 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f736c0075c0 con 0x7f737c0c55b0 2023-07-13T13:52:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.805+0000 7f7371ffb700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f736006ace0 0x7f736006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:02.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.806+0000 7f7371ffb700 1 -- 172.21.15.118:0/3361467209 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f736c088a70 con 0x7f737c0c55b0 2023-07-13T13:52:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.806+0000 7f7381537700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f736006ace0 0x7f736006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:02.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:02.806+0000 7f7381537700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f736006ace0 0x7f736006d190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7378007fd0 tx=0x7f7378009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:03.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.048+0000 7f7371ffb700 1 -- 172.21.15.118:0/3361467209 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f736c053dc0 con 0x7f737c0c55b0 2023-07-13T13:52:03.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.335+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f737c151a50 con 0x7f737c0c55b0 2023-07-13T13:52:03.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.355+0000 7f7371ffb700 1 -- 172.21.15.118:0/3361467209 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f736c017020 con 0x7f737c0c55b0 2023-07-13T13:52:03.329 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:03.329 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-07-13T13:52:03.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f736006ace0 msgr2=0x7f736006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:03.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f736006ace0 0x7f736006d190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7378007fd0 tx=0x7f7378009040 comp rx=0 tx=0).stop 2023-07-13T13:52:03.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f737c0c55b0 msgr2=0x7f737c14c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:03.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f737c0c55b0 0x7f737c14c880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f736c005910 tx=0x7f736c00c9e0 comp rx=0 tx=0).stop 2023-07-13T13:52:03.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 shutdown_connections 2023-07-13T13:52:03.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f736006ace0 0x7f736006d190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:03.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f737c150690 0x7f737c151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:03.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f737c0c1ab0 0x7f737c0c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:03.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 --2- 172.21.15.118:0/3361467209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f737c0c55b0 0x7f737c14c880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:03.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 >> 172.21.15.118:0/3361467209 conn(0x7f737c0cb880 msgr2=0x7f737c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:03.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 shutdown_connections 2023-07-13T13:52:03.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:03.358+0000 7f738379b700 1 -- 172.21.15.118:0/3361467209 wait complete. 2023-07-13T13:52:03.334 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 1 2023-07-13T13:52:05.351 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T13:52:05.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.530+0000 7f249e3a0700 1 Processor -- start 2023-07-13T13:52:05.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.530+0000 7f249e3a0700 1 -- start start 2023-07-13T13:52:05.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.531+0000 7f249e3a0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f24980c71c0 0x7f24980c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:05.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.531+0000 7f249e3a0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24980c5d10 con 0x7f2498071bb0 2023-07-13T13:52:05.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.531+0000 7f249e3a0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2498070b10 con 0x7f2498158090 2023-07-13T13:52:05.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.531+0000 7f249e3a0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2498071790 con 0x7f24980c71c0 2023-07-13T13:52:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.532+0000 7f24977fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f24980c71c0 0x7f24980c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.533+0000 7f249c93d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2498071bb0 0x7f2498158460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40910/0 (socket says 172.21.15.118:40910) 2023-07-13T13:52:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.533+0000 7f249c93d700 1 -- 172.21.15.118:0/2040856237 learned_addr learned my addr 172.21.15.118:0/2040856237 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:05.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.536+0000 7f24977fe700 1 -- 172.21.15.118:0/2040856237 >> v1:172.21.15.123:6789/0 conn(0x7f2498158090 legacy=0x7f2498069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:05.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.536+0000 7f24977fe700 1 -- 172.21.15.118:0/2040856237 >> v1:172.21.15.118:6789/0 conn(0x7f2498071bb0 legacy=0x7f2498158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:05.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.536+0000 7f24977fe700 1 -- 172.21.15.118:0/2040856237 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2498070df0 con 0x7f24980c71c0 2023-07-13T13:52:05.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.539+0000 7f24977fe700 1 --2- 172.21.15.118:0/2040856237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24980c71c0 0x7f24980c5660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f248c009840 tx=0x7f248c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9a45bb604a7e16 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.546+0000 7f2496ffd700 1 -- 172.21.15.118:0/2040856237 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c004230 con 0x7f24980c71c0 2023-07-13T13:52:05.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.546+0000 7f2496ffd700 1 -- 172.21.15.118:0/2040856237 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c004390 con 0x7f24980c71c0 2023-07-13T13:52:05.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.546+0000 7f2496ffd700 1 -- 172.21.15.118:0/2040856237 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0036a0 con 0x7f24980c71c0 2023-07-13T13:52:05.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.547+0000 7f249e3a0700 1 -- 172.21.15.118:0/2040856237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24980c71c0 msgr2=0x7f24980c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:05.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.547+0000 7f249e3a0700 1 --2- 172.21.15.118:0/2040856237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24980c71c0 0x7f24980c5660 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f248c009840 tx=0x7f248c009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:05.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.547+0000 7f249e3a0700 1 -- 172.21.15.118:0/2040856237 shutdown_connections 2023-07-13T13:52:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.547+0000 7f249e3a0700 1 --2- 172.21.15.118:0/2040856237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f24980c71c0 0x7f24980c5660 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.547+0000 7f249e3a0700 1 -- 172.21.15.118:0/2040856237 >> 172.21.15.118:0/2040856237 conn(0x7f24980cb880 msgr2=0x7f24980c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.548+0000 7f249e3a0700 1 -- 172.21.15.118:0/2040856237 shutdown_connections 2023-07-13T13:52:05.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.548+0000 7f249e3a0700 1 -- 172.21.15.118:0/2040856237 wait complete. 2023-07-13T13:52:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.549+0000 7f249e3a0700 1 Processor -- start 2023-07-13T13:52:05.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.550+0000 7f249e3a0700 1 -- start start 2023-07-13T13:52:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.551+0000 7f249e3a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2498071bb0 0x7f2498157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:05.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.551+0000 7f249e3a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24980c71c0 0x7f2498157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.551+0000 7f249e3a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2498158090 0x7f2498156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.551+0000 7f249e3a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2498152520 con 0x7f2498071bb0 2023-07-13T13:52:05.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.551+0000 7f249e3a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24981577d0 con 0x7f24980c71c0 2023-07-13T13:52:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.551+0000 7f249e3a0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2498151c00 con 0x7f2498158090 2023-07-13T13:52:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.552+0000 7f24977fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24980c71c0 0x7f2498157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.552+0000 7f2497fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2498071bb0 0x7f2498157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:05.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.552+0000 7f249c93d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2498158090 0x7f2498156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:05.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.552+0000 7f2497fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2498071bb0 0x7f2498157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40156/0 (socket says 172.21.15.118:40156) 2023-07-13T13:52:05.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.552+0000 7f2497fff700 1 -- 172.21.15.118:0/4200638812 learned_addr learned my addr 172.21.15.118:0/4200638812 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:05.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.557+0000 7f249c93d700 1 -- 172.21.15.118:0/4200638812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24980c71c0 msgr2=0x7f2498157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:05.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.557+0000 7f249c93d700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24980c71c0 0x7f2498157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:05.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.557+0000 7f249c93d700 1 -- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2498071bb0 msgr2=0x7f2498157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:05.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.557+0000 7f249c93d700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2498071bb0 0x7f2498157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:05.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.557+0000 7f249c93d700 1 -- 172.21.15.118:0/4200638812 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c0094a0 con 0x7f2498158090 2023-07-13T13:52:05.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.560+0000 7f249c93d700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2498158090 0x7f2498156890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f249806c290 tx=0x7f249000cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.564+0000 7f2494ff9700 1 -- 172.21.15.118:0/4200638812 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000a9a0 con 0x7f2498158090 2023-07-13T13:52:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.564+0000 7f2494ff9700 1 -- 172.21.15.118:0/4200638812 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000ab00 con 0x7f2498158090 2023-07-13T13:52:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.564+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249814fc60 con 0x7f2498158090 2023-07-13T13:52:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.564+0000 7f2494ff9700 1 -- 172.21.15.118:0/4200638812 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000ae90 con 0x7f2498158090 2023-07-13T13:52:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.564+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249814cc00 con 0x7f2498158090 2023-07-13T13:52:05.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.565+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249814fdf0 con 0x7f2498158090 2023-07-13T13:52:05.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.835+0000 7f2494ff9700 1 -- 172.21.15.118:0/4200638812 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f249001b3b0 con 0x7f2498158090 2023-07-13T13:52:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.835+0000 7f2494ff9700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f248406ace0 0x7f248406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.835+0000 7f2497fff700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f248406ace0 0x7f248406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.836+0000 7f2497fff700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f248406ace0 0x7f248406d190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2488006fd0 tx=0x7f248800b3a0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:05.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.843+0000 7f2494ff9700 1 -- 172.21.15.118:0/4200638812 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f249005c0c0 con 0x7f2498158090 2023-07-13T13:52:05.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:05.860+0000 7f2494ff9700 1 -- 172.21.15.118:0/4200638812 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2490054440 con 0x7f2498158090 2023-07-13T13:52:06.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.104+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24980743c0 con 0x7f2498158090 2023-07-13T13:52:06.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.143+0000 7f2494ff9700 1 -- 172.21.15.118:0/4200638812 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f2490017070 con 0x7f2498158090 2023-07-13T13:52:06.117 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:06.117 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-07-13T13:52:06.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f248406ace0 msgr2=0x7f248406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:06.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f248406ace0 0x7f248406d190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2488006fd0 tx=0x7f248800b3a0 comp rx=0 tx=0).stop 2023-07-13T13:52:06.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2498158090 msgr2=0x7f2498156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:06.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2498158090 0x7f2498156890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f249806c290 tx=0x7f249000cd50 comp rx=0 tx=0).stop 2023-07-13T13:52:06.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 shutdown_connections 2023-07-13T13:52:06.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f248406ace0 0x7f248406d190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:06.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2498158090 0x7f2498156890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:06.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2498071bb0 0x7f2498157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:06.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 --2- 172.21.15.118:0/4200638812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24980c71c0 0x7f2498157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:06.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 >> 172.21.15.118:0/4200638812 conn(0x7f24980cb880 msgr2=0x7f249814d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:06.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.145+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 shutdown_connections 2023-07-13T13:52:06.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:06.146+0000 7f249e3a0700 1 -- 172.21.15.118:0/4200638812 wait complete. 2023-07-13T13:52:06.121 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 1 2023-07-13T13:52:08.134 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T13:52:08.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.315+0000 7fe1834d3700 1 Processor -- start 2023-07-13T13:52:08.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.316+0000 7fe1834d3700 1 -- start start 2023-07-13T13:52:08.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.316+0000 7fe1834d3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c0c6d50 0x7fe17c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:08.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.316+0000 7fe1834d3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0c85f0 con 0x7fe17c0c60b0 2023-07-13T13:52:08.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.317+0000 7fe1834d3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c15c6b0 con 0x7fe17c152720 2023-07-13T13:52:08.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.317+0000 7fe1834d3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c158820 con 0x7fe17c0c6d50 2023-07-13T13:52:08.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.317+0000 7fe180a6e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe17c0c60b0 0x7fe17c0c55b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:40920/0 (socket says 172.21.15.118:40920) 2023-07-13T13:52:08.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.317+0000 7fe180a6e700 1 -- 172.21.15.118:0/489766525 learned_addr learned my addr 172.21.15.118:0/489766525 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:08.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.320+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62733240 0 0) 0x7fe17c15c6b0 con 0x7fe17c152720 2023-07-13T13:52:08.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.320+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1680035b0 con 0x7fe17c152720 2023-07-13T13:52:08.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.320+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333361022 0 0) 0x7fe17c0c85f0 con 0x7fe17c0c60b0 2023-07-13T13:52:08.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.320+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe17c15c6b0 con 0x7fe17c0c60b0 2023-07-13T13:52:08.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1745650537 0 0) 0x7fe1680035b0 con 0x7fe17c152720 2023-07-13T13:52:08.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c0c6d50 msgr2=0x7fe17c158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:08.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c0c6d50 0x7fe17c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 >> v1:172.21.15.118:6789/0 conn(0x7fe17c0c60b0 legacy=0x7fe17c0c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:08.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c15c990 con 0x7fe17c152720 2023-07-13T13:52:08.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402946124 0 0) 0x7fe178001670 con 0x7fe17c152720 2023-07-13T13:52:08.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 >> v1:172.21.15.123:6789/0 conn(0x7fe17c152720 legacy=0x7fe17c0c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:08.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe168003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:08.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe168004850 0x7fe168004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:08.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c0c6d50 0x7fe16800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:08.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c158820 con 0x7fe168004850 2023-07-13T13:52:08.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680055b0 con 0x7fe168003b90 2023-07-13T13:52:08.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.324+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16800bf50 con 0x7fe17c0c6d50 2023-07-13T13:52:08.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.328+0000 7fe18126f700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe168003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:08.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.329+0000 7fe180a6e700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe168004850 0x7fe168004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:08.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.332+0000 7fe18126f700 1 -- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c0c6d50 msgr2=0x7fe16800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:08.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.332+0000 7fe18126f700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c0c6d50 0x7fe16800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.332+0000 7fe18126f700 1 -- 172.21.15.118:0/489766525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe168004850 msgr2=0x7fe168004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:08.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.332+0000 7fe18126f700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe168004850 0x7fe168004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.332+0000 7fe18126f700 1 -- 172.21.15.118:0/489766525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1680035b0 con 0x7fe168003b90 2023-07-13T13:52:08.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.334+0000 7fe18126f700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe168003f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe178007f40 tx=0x7fe168005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d1f4cca8f58839e server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:08.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800cbf0 con 0x7fe168003b90 2023-07-13T13:52:08.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17800cd90 con 0x7fe168003b90 2023-07-13T13:52:08.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe173fff700 1 -- 172.21.15.118:0/489766525 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178012660 con 0x7fe168003b90 2023-07-13T13:52:08.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe1834d3700 1 -- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 msgr2=0x7fe168003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:08.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe1834d3700 1 --2- 172.21.15.118:0/489766525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe168003f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe178007f40 tx=0x7fe168005880 comp rx=0 tx=0).stop 2023-07-13T13:52:08.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe181a70700 1 -- 172.21.15.118:0/489766525 reap_dead start 2023-07-13T13:52:08.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe1834d3700 1 -- 172.21.15.118:0/489766525 shutdown_connections 2023-07-13T13:52:08.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe1834d3700 1 -- 172.21.15.118:0/489766525 >> 172.21.15.118:0/489766525 conn(0x7fe17c0cb880 msgr2=0x7fe17c0c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:08.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe1834d3700 1 -- 172.21.15.118:0/489766525 shutdown_connections 2023-07-13T13:52:08.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.340+0000 7fe1834d3700 1 -- 172.21.15.118:0/489766525 wait complete. 2023-07-13T13:52:08.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.342+0000 7fe1834d3700 1 Processor -- start 2023-07-13T13:52:08.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.342+0000 7fe1834d3700 1 -- start start 2023-07-13T13:52:08.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.343+0000 7fe1834d3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe17c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:08.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.343+0000 7fe1834d3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c14ed00 0x7fe17c14bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:08.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.343+0000 7fe1834d3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe17c14f150 0x7fe17c14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:08.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.343+0000 7fe1834d3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c14b8b0 con 0x7fe17c14f150 2023-07-13T13:52:08.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.343+0000 7fe1834d3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c14b420 con 0x7fe168003b90 2023-07-13T13:52:08.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.343+0000 7fe1834d3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c157260 con 0x7fe17c14ed00 2023-07-13T13:52:08.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.344+0000 7fe181a70700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe17c14f150 0x7fe17c14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:08.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.344+0000 7fe18126f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe17c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:08.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.345+0000 7fe18126f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe17c14aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:49504/0 (socket says 172.21.15.118:49504) 2023-07-13T13:52:08.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.345+0000 7fe18126f700 1 -- 172.21.15.118:0/2887275207 learned_addr learned my addr 172.21.15.118:0/2887275207 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:08.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.347+0000 7fe180a6e700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c14ed00 0x7fe17c14bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:08.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.349+0000 7fe181a70700 1 -- 172.21.15.118:0/2887275207 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c14ed00 msgr2=0x7fe17c14bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:08.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.349+0000 7fe181a70700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c14ed00 0x7fe17c14bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.349+0000 7fe181a70700 1 -- 172.21.15.118:0/2887275207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 msgr2=0x7fe17c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:08.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.349+0000 7fe181a70700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe17c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.349+0000 7fe181a70700 1 -- 172.21.15.118:0/2887275207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c1497d0 con 0x7fe17c14f150 2023-07-13T13:52:08.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.376+0000 7fe181a70700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe17c14f150 0x7fe17c14c210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe17c06f040 tx=0x7fe17400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:08.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.385+0000 7fe171ffb700 1 -- 172.21.15.118:0/2887275207 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740074e0 con 0x7fe17c14f150 2023-07-13T13:52:08.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.385+0000 7fe171ffb700 1 -- 172.21.15.118:0/2887275207 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe174007660 con 0x7fe17c14f150 2023-07-13T13:52:08.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.385+0000 7fe171ffb700 1 -- 172.21.15.118:0/2887275207 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174007a10 con 0x7fe17c14f150 2023-07-13T13:52:08.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.385+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c157470 con 0x7fe17c14f150 2023-07-13T13:52:08.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.385+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c157a30 con 0x7fe17c14f150 2023-07-13T13:52:08.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.387+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c14b9f0 con 0x7fe17c14f150 2023-07-13T13:52:08.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.413+0000 7fe171ffb700 1 -- 172.21.15.118:0/2887275207 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe17401b3b0 con 0x7fe17c14f150 2023-07-13T13:52:08.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.413+0000 7fe171ffb700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe16006ade0 0x7fe16006d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:08.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.413+0000 7fe171ffb700 1 -- 172.21.15.118:0/2887275207 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe174088740 con 0x7fe17c14f150 2023-07-13T13:52:08.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.414+0000 7fe18126f700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe16006ade0 0x7fe16006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:08.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.414+0000 7fe18126f700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe16006ade0 0x7fe16006d290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe178000c00 tx=0x7fe178005040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:08.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:08.714+0000 7fe171ffb700 1 -- 172.21.15.118:0/2887275207 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe174053bb0 con 0x7fe17c14f150 2023-07-13T13:52:08.841 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2023-07-13T13:52:08.973 INFO:tasks.ceph.mds.d.smithi123.stdout:starting mds.d at 2023-07-13T13:52:08.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.002+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe17c1497d0 con 0x7fe17c14f150 2023-07-13T13:52:08.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.014+0000 7fe171ffb700 1 -- 172.21.15.118:0/2887275207 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7fe17c1497d0 con 0x7fe17c14f150 2023-07-13T13:52:08.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:08.988 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-07-13T13:52:08.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.016+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe16006ade0 msgr2=0x7fe16006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:08.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.016+0000 7fe1834d3700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe16006ade0 0x7fe16006d290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe178000c00 tx=0x7fe178005040 comp rx=0 tx=0).stop 2023-07-13T13:52:08.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.016+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe17c14f150 msgr2=0x7fe17c14c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:08.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.016+0000 7fe1834d3700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe17c14f150 0x7fe17c14c210 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe17c06f040 tx=0x7fe17400c9e0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.018+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 shutdown_connections 2023-07-13T13:52:08.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.018+0000 7fe1834d3700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe16006ade0 0x7fe16006d290 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.018+0000 7fe1834d3700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe168003b90 0x7fe17c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.018+0000 7fe1834d3700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe17c14f150 0x7fe17c14c210 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.018+0000 7fe1834d3700 1 --2- 172.21.15.118:0/2887275207 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe17c14ed00 0x7fe17c14bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:08.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.018+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 >> 172.21.15.118:0/2887275207 conn(0x7fe17c0cb880 msgr2=0x7fe17c158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:08.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.018+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 shutdown_connections 2023-07-13T13:52:08.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:09.018+0000 7fe1834d3700 1 -- 172.21.15.118:0/2887275207 wait complete. 2023-07-13T13:52:08.993 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 1 2023-07-13T13:52:09.070 INFO:tasks.ceph.mds.f.smithi123.stdout:starting mds.f at 2023-07-13T13:52:09.098 INFO:tasks.ceph.mds.e.smithi118.stdout:starting mds.e at 2023-07-13T13:52:09.109 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2023-07-13T13:52:09.244 INFO:tasks.ceph.mds.b.smithi123.stdout:starting mds.b at 2023-07-13T13:52:11.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T13:52:11.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.155+0000 7f67e47db700 1 Processor -- start 2023-07-13T13:52:11.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.155+0000 7f67e47db700 1 -- start start 2023-07-13T13:52:11.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.155+0000 7f67e47db700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67dc06f4f0 0x7f67dc15c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.155+0000 7f67e47db700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.155+0000 7f67e47db700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc06e790 con 0x7f67dc152670 2023-07-13T13:52:11.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.155+0000 7f67e47db700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc15bce0 con 0x7f67dc06f4f0 2023-07-13T13:52:11.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.155+0000 7f67e47db700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc159210 con 0x7f67dc070d80 2023-07-13T13:52:11.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.156+0000 7f67e2d78700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.156+0000 7f67e1d76700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67dc06f4f0 0x7f67dc15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.156+0000 7f67e2d78700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc15c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40028/0 (socket says 172.21.15.118:40028) 2023-07-13T13:52:11.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.156+0000 7f67e2d78700 1 -- 172.21.15.118:0/779394533 learned_addr learned my addr 172.21.15.118:0/779394533 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:11.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.159+0000 7f67e2d78700 1 -- 172.21.15.118:0/779394533 >> v2:172.21.15.123:3300/0 conn(0x7f67dc06f4f0 msgr2=0x7f67dc15c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:11.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.159+0000 7f67e2d78700 1 --2- 172.21.15.118:0/779394533 >> v2:172.21.15.123:3300/0 conn(0x7f67dc06f4f0 0x7f67dc15c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.159+0000 7f67e2d78700 1 -- 172.21.15.118:0/779394533 >> v1:172.21.15.123:6789/0 conn(0x7f67dc152670 legacy=0x7f67dc0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.159+0000 7f67e2d78700 1 -- 172.21.15.118:0/779394533 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc152d90 con 0x7f67dc070d80 2023-07-13T13:52:11.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.162+0000 7f67e2d78700 1 --2- 172.21.15.118:0/779394533 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc15c6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009e50 tx=0x7f67d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9feb6c05b61719 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:11.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e1575700 1 -- 172.21.15.118:0/779394533 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d400e070 con 0x7f67dc070d80 2023-07-13T13:52:11.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e1575700 1 -- 172.21.15.118:0/779394533 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d400b910 con 0x7f67dc070d80 2023-07-13T13:52:11.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e1575700 1 -- 172.21.15.118:0/779394533 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d400bcc0 con 0x7f67dc070d80 2023-07-13T13:52:11.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e47db700 1 -- 172.21.15.118:0/779394533 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 msgr2=0x7f67dc15c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e47db700 1 --2- 172.21.15.118:0/779394533 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc15c6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009e50 tx=0x7f67d400b330 comp rx=0 tx=0).stop 2023-07-13T13:52:11.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e47db700 1 -- 172.21.15.118:0/779394533 shutdown_connections 2023-07-13T13:52:11.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e47db700 1 --2- 172.21.15.118:0/779394533 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc15c6b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e47db700 1 --2- 172.21.15.118:0/779394533 >> v2:172.21.15.123:3300/0 conn(0x7f67dc06f4f0 0x7f67dc15c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e47db700 1 -- 172.21.15.118:0/779394533 >> 172.21.15.118:0/779394533 conn(0x7f67dc06cf10 msgr2=0x7f67dc06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:11.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e47db700 1 -- 172.21.15.118:0/779394533 shutdown_connections 2023-07-13T13:52:11.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.166+0000 7f67e47db700 1 -- 172.21.15.118:0/779394533 wait complete. 2023-07-13T13:52:11.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.167+0000 7f67e47db700 1 Processor -- start 2023-07-13T13:52:11.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.167+0000 7f67e47db700 1 -- start start 2023-07-13T13:52:11.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e47db700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67dc06f4f0 0x7f67dc153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e47db700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e47db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67dc152670 0x7f67dc154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e47db700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc1544c0 con 0x7f67dc06f4f0 2023-07-13T13:52:11.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e47db700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc1576c0 con 0x7f67dc152670 2023-07-13T13:52:11.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e47db700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc157980 con 0x7f67dc070d80 2023-07-13T13:52:11.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e1d76700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e2577700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67dc06f4f0 0x7f67dc153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.168+0000 7f67e2d78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67dc152670 0x7f67dc154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.169+0000 7f67e1d76700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40036/0 (socket says 172.21.15.118:40036) 2023-07-13T13:52:11.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.169+0000 7f67e1d76700 1 -- 172.21.15.118:0/1483654641 learned_addr learned my addr 172.21.15.118:0/1483654641 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:11.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.174+0000 7f67e1d76700 1 -- 172.21.15.118:0/1483654641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67dc152670 msgr2=0x7f67dc154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.174+0000 7f67e1d76700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67dc152670 0x7f67dc154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.174+0000 7f67e1d76700 1 -- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67dc06f4f0 msgr2=0x7f67dc153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.174+0000 7f67e1d76700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67dc06f4f0 0x7f67dc153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.174+0000 7f67e1d76700 1 -- 172.21.15.118:0/1483654641 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4009b30 con 0x7f67dc070d80 2023-07-13T13:52:11.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.175+0000 7f67e1d76700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc14e4b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67d800e9b0 tx=0x7f67d800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:11.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.179+0000 7f67d2ffd700 1 -- 172.21.15.118:0/1483654641 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8009710 con 0x7f67dc070d80 2023-07-13T13:52:11.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.179+0000 7f67d2ffd700 1 -- 172.21.15.118:0/1483654641 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d800ee50 con 0x7f67dc070d80 2023-07-13T13:52:11.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.179+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc157c60 con 0x7f67dc070d80 2023-07-13T13:52:11.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.179+0000 7f67d2ffd700 1 -- 172.21.15.118:0/1483654641 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800ca50 con 0x7f67dc070d80 2023-07-13T13:52:11.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.179+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc158220 con 0x7f67dc070d80 2023-07-13T13:52:11.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.180+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc0c8b80 con 0x7f67dc070d80 2023-07-13T13:52:11.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.423+0000 7f67d2ffd700 1 -- 172.21.15.118:0/1483654641 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67d800cbb0 con 0x7f67dc070d80 2023-07-13T13:52:11.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.423+0000 7f67d2ffd700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f67c006ad30 0x7f67c006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.423+0000 7f67e2577700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f67c006ad30 0x7f67c006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.423+0000 7f67e2577700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f67c006ad30 0x7f67c006d1e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f67cc001800 tx=0x7f67cc009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:11.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.426+0000 7f67d2ffd700 1 -- 172.21.15.118:0/1483654641 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f67d805c9b0 con 0x7f67dc070d80 2023-07-13T13:52:11.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.436+0000 7f67d2ffd700 1 -- 172.21.15.118:0/1483654641 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67d80587c0 con 0x7f67dc070d80 2023-07-13T13:52:11.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.676+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67dc154780 con 0x7f67dc070d80 2023-07-13T13:52:11.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.737+0000 7f67d2ffd700 1 -- 172.21.15.118:0/1483654641 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5051 (secure 0 0 0) 0x7f67d8021020 con 0x7f67dc070d80 2023-07-13T13:52:11.711 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:11.711 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1760692596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1760692596},{"type":"v1","addr":"172.21.15.118:6835","nonce":1760692596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3512155037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3512155037},{"type":"v1","addr":"172.21.15.123:6833","nonce":3512155037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/439561314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":439561314},{"type":"v1","addr":"172.21.15.123:6835","nonce":439561314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2359037201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359037201},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359037201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3040631544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3040631544},{"type":"v1","addr":"172.21.15.118:6839","nonce":3040631544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/3588922803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":3588922803},{"type":"v1","addr":"172.21.15.118:6837","nonce":3588922803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-13T13:52:11.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f67c006ad30 msgr2=0x7f67c006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f67c006ad30 0x7f67c006d1e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f67cc001800 tx=0x7f67cc009040 comp rx=0 tx=0).stop 2023-07-13T13:52:11.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 msgr2=0x7f67dc14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc14e4b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67d800e9b0 tx=0x7f67d800ecc0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 shutdown_connections 2023-07-13T13:52:11.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f67c006ad30 0x7f67c006d1e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67dc152670 0x7f67dc154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f67dc06f4f0 0x7f67dc153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 --2- 172.21.15.118:0/1483654641 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f67dc070d80 0x7f67dc14e4b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 >> 172.21.15.118:0/1483654641 conn(0x7f67dc06cf10 msgr2=0x7f67dc0c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:11.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 shutdown_connections 2023-07-13T13:52:11.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.739+0000 7f67e47db700 1 -- 172.21.15.118:0/1483654641 wait complete. 2023-07-13T13:52:11.714 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 3 2023-07-13T13:52:11.725 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:11.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.873+0000 7f43cb305700 1 Processor -- start 2023-07-13T13:52:11.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.873+0000 7f43cb305700 1 -- start start 2023-07-13T13:52:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.874+0000 7f43cb305700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c40c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.874+0000 7f43cb305700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f43c40c6690 0x7f43c415fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.874+0000 7f43cb305700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40716a0 con 0x7f43c414f840 2023-07-13T13:52:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.874+0000 7f43cb305700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40c6ad0 con 0x7f43c40c6690 2023-07-13T13:52:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.874+0000 7f43cb305700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c7f30 con 0x7f43c4071a50 2023-07-13T13:52:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.875+0000 7f43c98a2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f43c40c6690 0x7f43c415fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.875+0000 7f43c88a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c40c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.875+0000 7f43c88a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c40c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40052/0 (socket says 172.21.15.118:40052) 2023-07-13T13:52:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.875+0000 7f43c88a0700 1 -- 172.21.15.118:0/1907155824 learned_addr learned my addr 172.21.15.118:0/1907155824 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:11.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.878+0000 7f43c88a0700 1 -- 172.21.15.118:0/1907155824 >> v2:172.21.15.118:3300/0 conn(0x7f43c40c6690 msgr2=0x7f43c415fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.878+0000 7f43c88a0700 1 --2- 172.21.15.118:0/1907155824 >> v2:172.21.15.118:3300/0 conn(0x7f43c40c6690 0x7f43c415fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.878+0000 7f43c88a0700 1 -- 172.21.15.118:0/1907155824 >> v1:172.21.15.118:6789/0 conn(0x7f43c414f840 legacy=0x7f43c40cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.878+0000 7f43c88a0700 1 -- 172.21.15.118:0/1907155824 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4156130 con 0x7f43c4071a50 2023-07-13T13:52:11.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.880+0000 7f43c88a0700 1 --2- 172.21.15.118:0/1907155824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c40c89d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43b400bb90 tx=0x7f43b400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb82fcb23b303739 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:11.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.884+0000 7f43bbfff700 1 -- 172.21.15.118:0/1907155824 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400dd30 con 0x7f43c4071a50 2023-07-13T13:52:11.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.884+0000 7f43bbfff700 1 -- 172.21.15.118:0/1907155824 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b400de90 con 0x7f43c4071a50 2023-07-13T13:52:11.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.884+0000 7f43bbfff700 1 -- 172.21.15.118:0/1907155824 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4010690 con 0x7f43c4071a50 2023-07-13T13:52:11.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.885+0000 7f43cb305700 1 -- 172.21.15.118:0/1907155824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 msgr2=0x7f43c40c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.885+0000 7f43cb305700 1 --2- 172.21.15.118:0/1907155824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c40c89d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43b400bb90 tx=0x7f43b400bea0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.885+0000 7f43cb305700 1 -- 172.21.15.118:0/1907155824 shutdown_connections 2023-07-13T13:52:11.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.885+0000 7f43cb305700 1 --2- 172.21.15.118:0/1907155824 >> v2:172.21.15.118:3300/0 conn(0x7f43c40c6690 0x7f43c415fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.885+0000 7f43cb305700 1 --2- 172.21.15.118:0/1907155824 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c40c89d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.885+0000 7f43cb305700 1 -- 172.21.15.118:0/1907155824 >> 172.21.15.118:0/1907155824 conn(0x7f43c406cf10 msgr2=0x7f43c406d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:11.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.885+0000 7f43cb305700 1 -- 172.21.15.118:0/1907155824 shutdown_connections 2023-07-13T13:52:11.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.885+0000 7f43cb305700 1 -- 172.21.15.118:0/1907155824 wait complete. 2023-07-13T13:52:11.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.886+0000 7f43cb305700 1 Processor -- start 2023-07-13T13:52:11.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.886+0000 7f43cb305700 1 -- start start 2023-07-13T13:52:11.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.887+0000 7f43cb305700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c41edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.887+0000 7f43cb305700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c40c6690 0x7f43c414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.887+0000 7f43cb305700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c414f840 0x7f43c4139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:11.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.887+0000 7f43cb305700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41ed6a0 con 0x7f43c414f840 2023-07-13T13:52:11.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.887+0000 7f43cb305700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c6440 con 0x7f43c40c6690 2023-07-13T13:52:11.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.887+0000 7f43cb305700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c4150150 con 0x7f43c4071a50 2023-07-13T13:52:11.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.887+0000 7f43c98a2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c414f840 0x7f43c4139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.888+0000 7f43c98a2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c414f840 0x7f43c4139b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45970/0 (socket says 172.21.15.118:45970) 2023-07-13T13:52:11.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.888+0000 7f43c98a2700 1 -- 172.21.15.118:0/3442068660 learned_addr learned my addr 172.21.15.118:0/3442068660 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:11.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.888+0000 7f43c90a1700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c41edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.888+0000 7f43c88a0700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c40c6690 0x7f43c414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:11.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.891+0000 7f43c98a2700 1 -- 172.21.15.118:0/3442068660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 msgr2=0x7f43c41edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.891+0000 7f43c98a2700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c41edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.891+0000 7f43c98a2700 1 -- 172.21.15.118:0/3442068660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c40c6690 msgr2=0x7f43c414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:11.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.891+0000 7f43c98a2700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c40c6690 0x7f43c414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:11.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.891+0000 7f43c98a2700 1 -- 172.21.15.118:0/3442068660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b400b7f0 con 0x7f43c414f840 2023-07-13T13:52:11.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.894+0000 7f43c98a2700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c414f840 0x7f43c4139b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00efc0 tx=0x7f43bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:11.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.898+0000 7f43b9ffb700 1 -- 172.21.15.118:0/3442068660 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc009ea0 con 0x7f43c414f840 2023-07-13T13:52:11.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.898+0000 7f43b9ffb700 1 -- 172.21.15.118:0/3442068660 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc00f040 con 0x7f43c414f840 2023-07-13T13:52:11.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.898+0000 7f43b9ffb700 1 -- 172.21.15.118:0/3442068660 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00ced0 con 0x7f43c414f840 2023-07-13T13:52:11.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.898+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c4150410 con 0x7f43c414f840 2023-07-13T13:52:11.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.898+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c41ed330 con 0x7f43c414f840 2023-07-13T13:52:11.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:11.899+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c41ed810 con 0x7f43c414f840 2023-07-13T13:52:12.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.122+0000 7f43b9ffb700 1 -- 172.21.15.118:0/3442068660 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43bc014480 con 0x7f43c414f840 2023-07-13T13:52:12.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.123+0000 7f43b9ffb700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f43a806ad30 0x7f43a806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:12.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.123+0000 7f43c90a1700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f43a806ad30 0x7f43a806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:12.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.123+0000 7f43c90a1700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f43a806ad30 0x7f43a806d1e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43c0007fd0 tx=0x7f43c0009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:12.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.162+0000 7f43b9ffb700 1 -- 172.21.15.118:0/3442068660 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f43bc05d1a0 con 0x7f43c414f840 2023-07-13T13:52:12.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.162+0000 7f43b9ffb700 1 -- 172.21.15.118:0/3442068660 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43bc055520 con 0x7f43c414f840 2023-07-13T13:52:12.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.348+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43c40743c0 con 0x7f43c414f840 2023-07-13T13:52:12.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.501+0000 7f43b9ffb700 1 -- 172.21.15.118:0/3442068660 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14672 (secure 0 0 0) 0x7f43bc018020 con 0x7f43c414f840 2023-07-13T13:52:12.474 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:12.474 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":20,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:02.045997+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:12.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f43a806ad30 msgr2=0x7f43a806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:12.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f43a806ad30 0x7f43a806d1e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43c0007fd0 tx=0x7f43c0009040 comp rx=0 tx=0).stop 2023-07-13T13:52:12.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c414f840 msgr2=0x7f43c4139b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:12.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c414f840 0x7f43c4139b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00efc0 tx=0x7f43bc00c3a0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 shutdown_connections 2023-07-13T13:52:12.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f43a806ad30 0x7f43a806d1e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43c414f840 0x7f43c4139b70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43c4071a50 0x7f43c41edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 --2- 172.21.15.118:0/3442068660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c40c6690 0x7f43c414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 >> 172.21.15.118:0/3442068660 conn(0x7f43c406cf10 msgr2=0x7f43c40c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:12.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 shutdown_connections 2023-07-13T13:52:12.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.503+0000 7f43cb305700 1 -- 172.21.15.118:0/3442068660 wait complete. 2023-07-13T13:52:12.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-13T13:51:55.327381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-13T13:51:57.354158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-13T13:52:12.489 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-13T13:52:12.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.640+0000 7f2ffa746700 1 Processor -- start 2023-07-13T13:52:12.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.640+0000 7f2ffa746700 1 -- start start 2023-07-13T13:52:12.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.640+0000 7f2ffa746700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ff40c5530 0x7f2ff41555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:12.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.640+0000 7f2ffa746700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ff4070d10 0x7f2ff40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:12.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.640+0000 7f2ffa746700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff40c7490 con 0x7f2ff414ed40 2023-07-13T13:52:12.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.640+0000 7f2ffa746700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff4071e10 con 0x7f2ff40c5530 2023-07-13T13:52:12.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.640+0000 7f2ffa746700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff4155af0 con 0x7f2ff4070d10 2023-07-13T13:52:12.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.641+0000 7f2ff37fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ff40c5530 0x7f2ff41555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:12.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.641+0000 7f2ff8ce3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ff4070d10 0x7f2ff40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:12.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.642+0000 7f2ff37fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2ff40c5530 0x7f2ff41555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45976/0 (socket says 172.21.15.118:45976) 2023-07-13T13:52:12.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.642+0000 7f2ff37fe700 1 -- 172.21.15.118:0/484797700 learned_addr learned my addr 172.21.15.118:0/484797700 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:12.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.644+0000 7f2ff37fe700 1 -- 172.21.15.118:0/484797700 >> v2:172.21.15.123:3300/0 conn(0x7f2ff4070d10 msgr2=0x7f2ff40710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:12.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.644+0000 7f2ff37fe700 1 --2- 172.21.15.118:0/484797700 >> v2:172.21.15.123:3300/0 conn(0x7f2ff4070d10 0x7f2ff40710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.644+0000 7f2ff37fe700 1 -- 172.21.15.118:0/484797700 >> v1:172.21.15.123:6789/0 conn(0x7f2ff414ed40 legacy=0x7f2ff4069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:12.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.644+0000 7f2ff37fe700 1 -- 172.21.15.118:0/484797700 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff40c6150 con 0x7f2ff40c5530 2023-07-13T13:52:12.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.648+0000 7f2ff37fe700 1 --2- 172.21.15.118:0/484797700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff40c5530 0x7f2ff41555b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40c50f0 tx=0x7f2fe800ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812ded68d7c569c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:12.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.655+0000 7f2ff2ffd700 1 -- 172.21.15.118:0/484797700 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800aea0 con 0x7f2ff40c5530 2023-07-13T13:52:12.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.655+0000 7f2ff2ffd700 1 -- 172.21.15.118:0/484797700 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe800cb70 con 0x7f2ff40c5530 2023-07-13T13:52:12.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.655+0000 7f2ff2ffd700 1 -- 172.21.15.118:0/484797700 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800f470 con 0x7f2ff40c5530 2023-07-13T13:52:12.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.656+0000 7f2ffa746700 1 -- 172.21.15.118:0/484797700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff40c5530 msgr2=0x7f2ff41555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:12.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.656+0000 7f2ffa746700 1 --2- 172.21.15.118:0/484797700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff40c5530 0x7f2ff41555b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40c50f0 tx=0x7f2fe800ad70 comp rx=0 tx=0).stop 2023-07-13T13:52:12.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.656+0000 7f2ffa746700 1 -- 172.21.15.118:0/484797700 shutdown_connections 2023-07-13T13:52:12.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.656+0000 7f2ffa746700 1 --2- 172.21.15.118:0/484797700 >> v2:172.21.15.123:3300/0 conn(0x7f2ff4070d10 0x7f2ff40710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.656+0000 7f2ffa746700 1 --2- 172.21.15.118:0/484797700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff40c5530 0x7f2ff41555b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.656+0000 7f2ffa746700 1 -- 172.21.15.118:0/484797700 >> 172.21.15.118:0/484797700 conn(0x7f2ff40cb800 msgr2=0x7f2ff40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:12.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.656+0000 7f2ffa746700 1 -- 172.21.15.118:0/484797700 shutdown_connections 2023-07-13T13:52:12.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.656+0000 7f2ffa746700 1 -- 172.21.15.118:0/484797700 wait complete. 2023-07-13T13:52:12.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.657+0000 7f2ffa746700 1 Processor -- start 2023-07-13T13:52:12.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.657+0000 7f2ffa746700 1 -- start start 2023-07-13T13:52:12.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.658+0000 7f2ffa746700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4070d10 0x7f2ff41df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:12.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.658+0000 7f2ffa746700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ff40c5530 0x7f2ff41f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:12.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.658+0000 7f2ffa746700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ff414ed40 0x7f2ff41f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:12.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.658+0000 7f2ffa746700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff40c47d0 con 0x7f2ff4070d10 2023-07-13T13:52:12.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.658+0000 7f2ffa746700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4153d80 con 0x7f2ff40c5530 2023-07-13T13:52:12.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.658+0000 7f2ffa746700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff41ee350 con 0x7f2ff414ed40 2023-07-13T13:52:12.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.659+0000 7f2ff8ce3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ff414ed40 0x7f2ff41f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:12.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.659+0000 7f2ff37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ff40c5530 0x7f2ff41f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:12.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.659+0000 7f2ff37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ff40c5530 0x7f2ff41f1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:36166/0 (socket says 172.21.15.118:36166) 2023-07-13T13:52:12.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.659+0000 7f2ff8ce3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ff414ed40 0x7f2ff41f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40074/0 (socket says 172.21.15.118:40074) 2023-07-13T13:52:12.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.659+0000 7f2ff37fe700 1 -- 172.21.15.118:0/1041619489 learned_addr learned my addr 172.21.15.118:0/1041619489 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:12.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.662+0000 7f2ff3fff700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4070d10 0x7f2ff41df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:12.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.663+0000 7f2ff37fe700 1 -- 172.21.15.118:0/1041619489 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ff414ed40 msgr2=0x7f2ff41f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:12.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.663+0000 7f2ff37fe700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ff414ed40 0x7f2ff41f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.663+0000 7f2ff37fe700 1 -- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4070d10 msgr2=0x7f2ff41df1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:12.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.663+0000 7f2ff37fe700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4070d10 0x7f2ff41df1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:12.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.663+0000 7f2ff37fe700 1 -- 172.21.15.118:0/1041619489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe800a6f0 con 0x7f2ff40c5530 2023-07-13T13:52:12.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.666+0000 7f2ff37fe700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ff40c5530 0x7f2ff41f1ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800adb0 tx=0x7f2fe8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:12.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.724+0000 7f2ff0ff9700 1 -- 172.21.15.118:0/1041619489 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80038a0 con 0x7f2ff40c5530 2023-07-13T13:52:12.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.724+0000 7f2ff0ff9700 1 -- 172.21.15.118:0/1041619489 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8003a00 con 0x7f2ff40c5530 2023-07-13T13:52:12.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.724+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff40c31c0 con 0x7f2ff40c5530 2023-07-13T13:52:12.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.724+0000 7f2ff0ff9700 1 -- 172.21.15.118:0/1041619489 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8003d90 con 0x7f2ff40c5530 2023-07-13T13:52:12.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.724+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff40c2c00 con 0x7f2ff40c5530 2023-07-13T13:52:12.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.725+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff404e280 con 0x7f2ff40c5530 2023-07-13T13:52:12.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.994+0000 7f2ff0ff9700 1 -- 172.21.15.118:0/1041619489 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fe800f620 con 0x7f2ff40c5530 2023-07-13T13:52:12.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.994+0000 7f2ff0ff9700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2fe006ad60 0x7f2fe006d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:12.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.994+0000 7f2ff0ff9700 1 -- 172.21.15.118:0/1041619489 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2fe8013070 con 0x7f2ff40c5530 2023-07-13T13:52:12.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.994+0000 7f2ff3fff700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2fe006ad60 0x7f2fe006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:12.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:12.995+0000 7f2ff3fff700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2fe006ad60 0x7f2fe006d210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4000f60 tx=0x7f2fe4009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:12.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.004+0000 7f2ff0ff9700 1 -- 172.21.15.118:0/1041619489 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fe8056a60 con 0x7f2ff40c5530 2023-07-13T13:52:13.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.198+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ff40724b0 con 0x7f2ff40c5530 2023-07-13T13:52:13.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.208+0000 7f2ff0ff9700 1 -- 172.21.15.118:0/1041619489 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fe805a080 con 0x7f2ff40c5530 2023-07-13T13:52:13.180 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-07-13T13:52:13.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2fe006ad60 msgr2=0x7f2fe006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2fe006ad60 0x7f2fe006d210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4000f60 tx=0x7f2fe4009040 comp rx=0 tx=0).stop 2023-07-13T13:52:13.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ff40c5530 msgr2=0x7f2ff41f1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ff40c5530 0x7f2ff41f1ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800adb0 tx=0x7f2fe8004750 comp rx=0 tx=0).stop 2023-07-13T13:52:13.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 shutdown_connections 2023-07-13T13:52:13.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2fe006ad60 0x7f2fe006d210 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ff414ed40 0x7f2ff41f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ff4070d10 0x7f2ff41df1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 --2- 172.21.15.118:0/1041619489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ff40c5530 0x7f2ff41f1ef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 >> 172.21.15.118:0/1041619489 conn(0x7f2ff40cb800 msgr2=0x7f2ff414d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:13.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 shutdown_connections 2023-07-13T13:52:13.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.210+0000 7f2ffa746700 1 -- 172.21.15.118:0/1041619489 wait complete. 2023-07-13T13:52:13.195 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-13T13:52:13.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.349+0000 7fdb5d02f700 1 Processor -- start 2023-07-13T13:52:13.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.349+0000 7fdb5d02f700 1 -- start start 2023-07-13T13:52:13.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.349+0000 7fdb5d02f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdb5815a270 0x7fdb580c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.349+0000 7fdb5d02f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580c7f40 con 0x7fdb580c4b30 2023-07-13T13:52:13.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.349+0000 7fdb5d02f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb58157290 con 0x7fdb580cbdd0 2023-07-13T13:52:13.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.349+0000 7fdb5d02f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb58156470 con 0x7fdb5815a270 2023-07-13T13:52:13.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.350+0000 7fdb5759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdb5815a270 0x7fdb580c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.350+0000 7fdb5659c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdb580cbdd0 0x7fdb58159b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:35236/0 (socket says 172.21.15.118:35236) 2023-07-13T13:52:13.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.350+0000 7fdb5659c700 1 -- 172.21.15.118:0/429047980 learned_addr learned my addr 172.21.15.118:0/429047980 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:13.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.353+0000 7fdb55d9b700 1 -- 172.21.15.118:0/429047980 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278969626 0 0) 0x7fdb58157290 con 0x7fdb580cbdd0 2023-07-13T13:52:13.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.353+0000 7fdb55d9b700 1 -- 172.21.15.118:0/429047980 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb400035b0 con 0x7fdb580cbdd0 2023-07-13T13:52:13.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.354+0000 7fdb5759e700 1 -- 172.21.15.118:0/429047980 >> v1:172.21.15.123:6789/0 conn(0x7fdb580cbdd0 legacy=0x7fdb58159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.354+0000 7fdb5759e700 1 -- 172.21.15.118:0/429047980 >> v1:172.21.15.118:6789/0 conn(0x7fdb580c4b30 legacy=0x7fdb580c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:13.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.354+0000 7fdb5759e700 1 -- 172.21.15.118:0/429047980 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb58156680 con 0x7fdb5815a270 2023-07-13T13:52:13.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.356+0000 7fdb5759e700 1 --2- 172.21.15.118:0/429047980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb580c4f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009d90 tx=0x7fdb5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722dcde5719bb234 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:13.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.361+0000 7fdb55d9b700 1 -- 172.21.15.118:0/429047980 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000e070 con 0x7fdb5815a270 2023-07-13T13:52:13.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.361+0000 7fdb55d9b700 1 -- 172.21.15.118:0/429047980 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000bae0 con 0x7fdb5815a270 2023-07-13T13:52:13.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.361+0000 7fdb55d9b700 1 -- 172.21.15.118:0/429047980 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000be90 con 0x7fdb5815a270 2023-07-13T13:52:13.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.362+0000 7fdb5d02f700 1 -- 172.21.15.118:0/429047980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 msgr2=0x7fdb580c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.362+0000 7fdb5d02f700 1 --2- 172.21.15.118:0/429047980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb580c4f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009d90 tx=0x7fdb5000b330 comp rx=0 tx=0).stop 2023-07-13T13:52:13.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.362+0000 7fdb5d02f700 1 -- 172.21.15.118:0/429047980 shutdown_connections 2023-07-13T13:52:13.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.362+0000 7fdb5d02f700 1 --2- 172.21.15.118:0/429047980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb580c4f00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.362+0000 7fdb5d02f700 1 -- 172.21.15.118:0/429047980 >> 172.21.15.118:0/429047980 conn(0x7fdb5806cf60 msgr2=0x7fdb5806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:13.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.362+0000 7fdb5d02f700 1 -- 172.21.15.118:0/429047980 shutdown_connections 2023-07-13T13:52:13.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.362+0000 7fdb5d02f700 1 -- 172.21.15.118:0/429047980 wait complete. 2023-07-13T13:52:13.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.364+0000 7fdb5d02f700 1 Processor -- start 2023-07-13T13:52:13.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.364+0000 7fdb5d02f700 1 -- start start 2023-07-13T13:52:13.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.365+0000 7fdb5d02f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb580c4b30 0x7fdb580ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.365+0000 7fdb5d02f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb580cbdd0 0x7fdb581e3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.365+0000 7fdb5d02f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb58145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.365+0000 7fdb5d02f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58144f70 con 0x7fdb5815a270 2023-07-13T13:52:13.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.365+0000 7fdb5d02f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580cb200 con 0x7fdb580cbdd0 2023-07-13T13:52:13.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.365+0000 7fdb5d02f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58144940 con 0x7fdb580c4b30 2023-07-13T13:52:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.365+0000 7fdb5759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb58145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.366+0000 7fdb5659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb580cbdd0 0x7fdb581e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.366+0000 7fdb5759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb58145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45992/0 (socket says 172.21.15.118:45992) 2023-07-13T13:52:13.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.366+0000 7fdb5759e700 1 -- 172.21.15.118:0/1259614398 learned_addr learned my addr 172.21.15.118:0/1259614398 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:13.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.366+0000 7fdb56d9d700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb580c4b30 0x7fdb580ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.370+0000 7fdb5759e700 1 -- 172.21.15.118:0/1259614398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb580c4b30 msgr2=0x7fdb580ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.370+0000 7fdb5759e700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb580c4b30 0x7fdb580ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.370+0000 7fdb5759e700 1 -- 172.21.15.118:0/1259614398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb580cbdd0 msgr2=0x7fdb581e3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.370+0000 7fdb5759e700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb580cbdd0 0x7fdb581e3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.370+0000 7fdb5759e700 1 -- 172.21.15.118:0/1259614398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009a70 con 0x7fdb5815a270 2023-07-13T13:52:13.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.372+0000 7fdb5759e700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb58145390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb5806d920 tx=0x7fdb50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:13.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.375+0000 7fdb3f7fe700 1 -- 172.21.15.118:0/1259614398 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50004540 con 0x7fdb5815a270 2023-07-13T13:52:13.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.375+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58144c00 con 0x7fdb5815a270 2023-07-13T13:52:13.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.375+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb580ca680 con 0x7fdb5815a270 2023-07-13T13:52:13.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.376+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb581450b0 con 0x7fdb5815a270 2023-07-13T13:52:13.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.377+0000 7fdb3f7fe700 1 -- 172.21.15.118:0/1259614398 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500046a0 con 0x7fdb5815a270 2023-07-13T13:52:13.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.377+0000 7fdb3f7fe700 1 -- 172.21.15.118:0/1259614398 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5002e470 con 0x7fdb5815a270 2023-07-13T13:52:13.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.638+0000 7fdb3f7fe700 1 -- 172.21.15.118:0/1259614398 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb50012430 con 0x7fdb5815a270 2023-07-13T13:52:13.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.638+0000 7fdb3f7fe700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.638+0000 7fdb3f7fe700 1 -- 172.21.15.118:0/1259614398 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdb5008af90 con 0x7fdb5815a270 2023-07-13T13:52:13.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.638+0000 7fdb56d9d700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.638+0000 7fdb56d9d700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdb4406ace0 0x7fdb4406d190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdb48007fd0 tx=0x7fdb48009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:13.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.655+0000 7fdb3f7fe700 1 -- 172.21.15.118:0/1259614398 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb50056310 con 0x7fdb5815a270 2023-07-13T13:52:13.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.848+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb580c7f40 con 0x7fdb5815a270 2023-07-13T13:52:13.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.875+0000 7fdb3f7fe700 1 -- 172.21.15.118:0/1259614398 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb580c7f40 con 0x7fdb5815a270 2023-07-13T13:52:13.848 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-07-13T13:52:13.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdb4406ace0 msgr2=0x7fdb4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdb4406ace0 0x7fdb4406d190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdb48007fd0 tx=0x7fdb48009040 comp rx=0 tx=0).stop 2023-07-13T13:52:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 msgr2=0x7fdb58145390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb58145390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb5806d920 tx=0x7fdb50004ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 shutdown_connections 2023-07-13T13:52:13.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb5815a270 0x7fdb58145390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdb580c4b30 0x7fdb580ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 --2- 172.21.15.118:0/1259614398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb580cbdd0 0x7fdb581e3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 >> 172.21.15.118:0/1259614398 conn(0x7fdb5806cf60 msgr2=0x7fdb58148f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 shutdown_connections 2023-07-13T13:52:13.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:13.877+0000 7fdb5d02f700 1 -- 172.21.15.118:0/1259614398 wait complete. 2023-07-13T13:52:13.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-13T13:52:13.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.011+0000 7f4f82d7b700 1 Processor -- start 2023-07-13T13:52:13.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.011+0000 7f4f82d7b700 1 -- start start 2023-07-13T13:52:13.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.012+0000 7f4f82d7b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f7c0c60b0 0x7f4f7c0c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.012+0000 7f4f82d7b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c0c6d50 0x7f4f7c0c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.012+0000 7f4f82d7b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c0c85f0 con 0x7f4f7c152720 2023-07-13T13:52:13.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.012+0000 7f4f82d7b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c158820 con 0x7f4f7c0c60b0 2023-07-13T13:52:13.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.012+0000 7f4f82d7b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c15c6b0 con 0x7f4f7c0c6d50 2023-07-13T13:52:13.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.013+0000 7f4f81318700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c0c6d50 0x7f4f7c0c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.013+0000 7f4f7bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f7c0c60b0 0x7f4f7c0c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.013+0000 7f4f81318700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c0c6d50 0x7f4f7c0c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40090/0 (socket says 172.21.15.118:40090) 2023-07-13T13:52:13.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.013+0000 7f4f81318700 1 -- 172.21.15.118:0/3816582807 learned_addr learned my addr 172.21.15.118:0/3816582807 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:13.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.016+0000 7f4f81318700 1 -- 172.21.15.118:0/3816582807 >> v2:172.21.15.123:3300/0 conn(0x7f4f7c0c60b0 msgr2=0x7f4f7c0c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:13.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.016+0000 7f4f81318700 1 --2- 172.21.15.118:0/3816582807 >> v2:172.21.15.123:3300/0 conn(0x7f4f7c0c60b0 0x7f4f7c0c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.016+0000 7f4f81318700 1 -- 172.21.15.118:0/3816582807 >> v1:172.21.15.123:6789/0 conn(0x7f4f7c152720 legacy=0x7f4f7c0c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.016+0000 7f4f81318700 1 -- 172.21.15.118:0/3816582807 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c15c990 con 0x7f4f7c0c6d50 2023-07-13T13:52:13.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.018+0000 7f4f81318700 1 --2- 172.21.15.118:0/3816582807 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c0c6d50 0x7f4f7c0c5af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009e50 tx=0x7f4f7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25840ed76bc53a93 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:13.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f7b7fe700 1 -- 172.21.15.118:0/3816582807 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400e070 con 0x7f4f7c0c6d50 2023-07-13T13:52:13.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f7b7fe700 1 -- 172.21.15.118:0/3816582807 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7400b910 con 0x7f4f7c0c6d50 2023-07-13T13:52:13.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f7b7fe700 1 -- 172.21.15.118:0/3816582807 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400bcc0 con 0x7f4f7c0c6d50 2023-07-13T13:52:13.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f82d7b700 1 -- 172.21.15.118:0/3816582807 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c0c6d50 msgr2=0x7f4f7c0c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:13.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/3816582807 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c0c6d50 0x7f4f7c0c5af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009e50 tx=0x7f4f7400b330 comp rx=0 tx=0).stop 2023-07-13T13:52:13.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f82d7b700 1 -- 172.21.15.118:0/3816582807 shutdown_connections 2023-07-13T13:52:13.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/3816582807 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c0c6d50 0x7f4f7c0c5af0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/3816582807 >> v2:172.21.15.123:3300/0 conn(0x7f4f7c0c60b0 0x7f4f7c0c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:13.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f82d7b700 1 -- 172.21.15.118:0/3816582807 >> 172.21.15.118:0/3816582807 conn(0x7f4f7c0cb880 msgr2=0x7f4f7c0c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:13.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f82d7b700 1 -- 172.21.15.118:0/3816582807 shutdown_connections 2023-07-13T13:52:13.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.022+0000 7f4f82d7b700 1 -- 172.21.15.118:0/3816582807 wait complete. 2023-07-13T13:52:13.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.023+0000 7f4f82d7b700 1 Processor -- start 2023-07-13T13:52:13.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.023+0000 7f4f82d7b700 1 -- start start 2023-07-13T13:52:13.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.024+0000 7f4f82d7b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f7c0c60b0 0x7f4f7c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.024+0000 7f4f82d7b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7c0c6d50 0x7f4f7c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.024+0000 7f4f82d7b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c152720 0x7f4f7c1eef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:13.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.024+0000 7f4f82d7b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c1537b0 con 0x7f4f7c0c60b0 2023-07-13T13:52:13.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.024+0000 7f4f82d7b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c15b4c0 con 0x7f4f7c0c6d50 2023-07-13T13:52:13.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.024+0000 7f4f82d7b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c152f10 con 0x7f4f7c152720 2023-07-13T13:52:13.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.025+0000 7f4f81318700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c152720 0x7f4f7c1eef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.025+0000 7f4f80b17700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f7c0c60b0 0x7f4f7c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.025+0000 7f4f7bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7c0c6d50 0x7f4f7c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:13.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.025+0000 7f4f81318700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c152720 0x7f4f7c1eef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40092/0 (socket says 172.21.15.118:40092) 2023-07-13T13:52:13.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.025+0000 7f4f80b17700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f7c0c60b0 0x7f4f7c1544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:45998/0 (socket says 172.21.15.118:45998) 2023-07-13T13:52:14.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.025+0000 7f4f81318700 1 -- 172.21.15.118:0/597047841 learned_addr learned my addr 172.21.15.118:0/597047841 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:14.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.029+0000 7f4f7bfff700 1 -- 172.21.15.118:0/597047841 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c152720 msgr2=0x7f4f7c1eef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:14.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.029+0000 7f4f7bfff700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c152720 0x7f4f7c1eef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.029+0000 7f4f7bfff700 1 -- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f7c0c60b0 msgr2=0x7f4f7c1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:14.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.029+0000 7f4f7bfff700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f7c0c60b0 0x7f4f7c1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.029+0000 7f4f7bfff700 1 -- 172.21.15.118:0/597047841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009b30 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.029+0000 7f4f81318700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c152720 0x7f4f7c1eef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:14.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.031+0000 7f4f7bfff700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7c0c6d50 0x7f4f7c15b950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800e900 tx=0x7f4f6800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:14.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.036+0000 7f4f797fa700 1 -- 172.21.15.118:0/597047841 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68013680 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.036+0000 7f4f797fa700 1 -- 172.21.15.118:0/597047841 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f680137e0 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.036+0000 7f4f797fa700 1 -- 172.21.15.118:0/597047841 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68013b50 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.036+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c1531f0 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.036+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c15b150 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.037+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7c15b310 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.195+0000 7f4f797fa700 1 -- 172.21.15.118:0/597047841 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f68013cb0 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.196+0000 7f4f797fa700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f4f6006ad60 0x7f4f6006d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:14.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.196+0000 7f4f80b17700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f4f6006ad60 0x7f4f6006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:14.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.196+0000 7f4f80b17700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f4f6006ad60 0x7f4f6006d210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f70007fd0 tx=0x7f4f70009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:14.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.200+0000 7f4f797fa700 1 -- 172.21.15.118:0/597047841 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4f6805c7f0 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.309+0000 7f4f797fa700 1 -- 172.21.15.118:0/597047841 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f68054b70 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.508+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4f7c0743c0 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.490 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.517+0000 7f4f797fa700 1 -- 172.21.15.118:0/597047841 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4f68017020 con 0x7f4f7c0c6d50 2023-07-13T13:52:14.490 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:14.490 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2023-07-13T13:52:14.491 INFO:teuthology.orchestra.run.smithi118.stdout: { 2023-07-13T13:52:14.491 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2023-07-13T13:52:14.491 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2023-07-13T13:52:14.491 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:52:14.491 INFO:teuthology.orchestra.run.smithi118.stdout: { 2023-07-13T13:52:14.491 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 2, 2023-07-13T13:52:14.491 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": "rbd" 2023-07-13T13:52:14.491 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-07-13T13:52:14.492 INFO:teuthology.orchestra.run.smithi118.stdout:] 2023-07-13T13:52:14.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f4f6006ad60 msgr2=0x7f4f6006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:14.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f4f6006ad60 0x7f4f6006d210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f70007fd0 tx=0x7f4f70009040 comp rx=0 tx=0).stop 2023-07-13T13:52:14.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7c0c6d50 msgr2=0x7f4f7c15b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:14.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7c0c6d50 0x7f4f7c15b950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800e900 tx=0x7f4f6800ec10 comp rx=0 tx=0).stop 2023-07-13T13:52:14.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 shutdown_connections 2023-07-13T13:52:14.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f4f6006ad60 0x7f4f6006d210 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f7c152720 0x7f4f7c1eef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f7c0c60b0 0x7f4f7c1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 --2- 172.21.15.118:0/597047841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f7c0c6d50 0x7f4f7c15b950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 >> 172.21.15.118:0/597047841 conn(0x7f4f7c0cb880 msgr2=0x7f4f7c151840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 shutdown_connections 2023-07-13T13:52:14.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.520+0000 7f4f82d7b700 1 -- 172.21.15.118:0/597047841 wait complete. 2023-07-13T13:52:14.504 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-13T13:52:14.505 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-13T13:52:14.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.656+0000 7fd4eae43700 1 Processor -- start 2023-07-13T13:52:14.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.656+0000 7fd4eae43700 1 -- start start 2023-07-13T13:52:14.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.658+0000 7fd4eae43700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd4e4159500 0x7fd4e40c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:14.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.658+0000 7fd4eae43700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e40af1f0 con 0x7fd4e41529b0 2023-07-13T13:52:14.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.658+0000 7fd4eae43700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e40c76d0 con 0x7fd4e4152d80 2023-07-13T13:52:14.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.658+0000 7fd4eae43700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e4158810 con 0x7fd4e4159500 2023-07-13T13:52:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.658+0000 7fd4e93e0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd4e4159500 0x7fd4e40c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.658+0000 7fd4e3fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd4e4152d80 0x7fd4e40c6fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:35254/0 (socket says 172.21.15.118:35254) 2023-07-13T13:52:14.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.658+0000 7fd4e3fff700 1 -- 172.21.15.118:0/3487181348 learned_addr learned my addr 172.21.15.118:0/3487181348 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:14.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.661+0000 7fd4e37fe700 1 -- 172.21.15.118:0/3487181348 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349545196 0 0) 0x7fd4e40c76d0 con 0x7fd4e4152d80 2023-07-13T13:52:14.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.661+0000 7fd4e37fe700 1 -- 172.21.15.118:0/3487181348 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d00035b0 con 0x7fd4e4152d80 2023-07-13T13:52:14.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.662+0000 7fd4e93e0700 1 -- 172.21.15.118:0/3487181348 >> v1:172.21.15.123:6789/0 conn(0x7fd4e4152d80 legacy=0x7fd4e40c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:14.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.662+0000 7fd4e93e0700 1 -- 172.21.15.118:0/3487181348 >> v1:172.21.15.118:6789/0 conn(0x7fd4e41529b0 legacy=0x7fd4e415bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:14.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.662+0000 7fd4e93e0700 1 -- 172.21.15.118:0/3487181348 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e40c1b20 con 0x7fd4e4159500 2023-07-13T13:52:14.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.665+0000 7fd4e93e0700 1 --2- 172.21.15.118:0/3487181348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e40c1500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009840 tx=0x7fd4d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8b65da9f6b44bc server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:14.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.670+0000 7fd4e37fe700 1 -- 172.21.15.118:0/3487181348 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4004230 con 0x7fd4e4159500 2023-07-13T13:52:14.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4e37fe700 1 -- 172.21.15.118:0/3487181348 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d4004390 con 0x7fd4e4159500 2023-07-13T13:52:14.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4e37fe700 1 -- 172.21.15.118:0/3487181348 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40036c0 con 0x7fd4e4159500 2023-07-13T13:52:14.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4eae43700 1 -- 172.21.15.118:0/3487181348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 msgr2=0x7fd4e40c1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:14.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4eae43700 1 --2- 172.21.15.118:0/3487181348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e40c1500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009840 tx=0x7fd4d4009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:14.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4eae43700 1 -- 172.21.15.118:0/3487181348 shutdown_connections 2023-07-13T13:52:14.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4eae43700 1 --2- 172.21.15.118:0/3487181348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e40c1500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4eae43700 1 -- 172.21.15.118:0/3487181348 >> 172.21.15.118:0/3487181348 conn(0x7fd4e406e060 msgr2=0x7fd4e406eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4eae43700 1 -- 172.21.15.118:0/3487181348 shutdown_connections 2023-07-13T13:52:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.671+0000 7fd4eae43700 1 -- 172.21.15.118:0/3487181348 wait complete. 2023-07-13T13:52:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.673+0000 7fd4eae43700 1 Processor -- start 2023-07-13T13:52:14.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.673+0000 7fd4eae43700 1 -- start start 2023-07-13T13:52:14.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.673+0000 7fd4eae43700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e41529b0 0x7fd4e406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:14.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.673+0000 7fd4eae43700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4e4152d80 0x7fd4e41f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:14.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.673+0000 7fd4eae43700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e41f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:14.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.673+0000 7fd4eae43700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e41eeb90 con 0x7fd4e4159500 2023-07-13T13:52:14.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.673+0000 7fd4eae43700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e41edfa0 con 0x7fd4e41529b0 2023-07-13T13:52:14.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.673+0000 7fd4eae43700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40ada40 con 0x7fd4e4152d80 2023-07-13T13:52:14.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.674+0000 7fd4e8bdf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e41529b0 0x7fd4e406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:14.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.674+0000 7fd4e93e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e41f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:14.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.674+0000 7fd4e3fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4e4152d80 0x7fd4e41f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:14.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.674+0000 7fd4e93e0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e41f1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46010/0 (socket says 172.21.15.118:46010) 2023-07-13T13:52:14.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.674+0000 7fd4e93e0700 1 -- 172.21.15.118:0/3691122896 learned_addr learned my addr 172.21.15.118:0/3691122896 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:14.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.678+0000 7fd4e93e0700 1 -- 172.21.15.118:0/3691122896 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4e4152d80 msgr2=0x7fd4e41f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:14.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.678+0000 7fd4e93e0700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4e4152d80 0x7fd4e41f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.678+0000 7fd4e93e0700 1 -- 172.21.15.118:0/3691122896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e41529b0 msgr2=0x7fd4e406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:14.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.678+0000 7fd4e93e0700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e41529b0 0x7fd4e406c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:14.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.678+0000 7fd4e93e0700 1 -- 172.21.15.118:0/3691122896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40094a0 con 0x7fd4e4159500 2023-07-13T13:52:14.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.681+0000 7fd4e93e0700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e41f1a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009790 tx=0x7fd4d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:14.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.684+0000 7fd4e17fa700 1 -- 172.21.15.118:0/3691122896 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4003de0 con 0x7fd4e4159500 2023-07-13T13:52:14.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.684+0000 7fd4e17fa700 1 -- 172.21.15.118:0/3691122896 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d4011630 con 0x7fd4e4159500 2023-07-13T13:52:14.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.684+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e41ee260 con 0x7fd4e4159500 2023-07-13T13:52:14.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.684+0000 7fd4e17fa700 1 -- 172.21.15.118:0/3691122896 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40119a0 con 0x7fd4e4159500 2023-07-13T13:52:14.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.684+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e41ee820 con 0x7fd4e4159500 2023-07-13T13:52:14.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.685+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e41ee9b0 con 0x7fd4e4159500 2023-07-13T13:52:14.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.710+0000 7fd4e17fa700 1 -- 172.21.15.118:0/3691122896 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4d4018050 con 0x7fd4e4159500 2023-07-13T13:52:14.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.710+0000 7fd4e17fa700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd4c406ad60 0x7fd4c406d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:14.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.711+0000 7fd4e17fa700 1 -- 172.21.15.118:0/3691122896 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd4d4089f70 con 0x7fd4e4159500 2023-07-13T13:52:14.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.711+0000 7fd4e8bdf700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd4c406ad60 0x7fd4c406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:14.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.711+0000 7fd4e8bdf700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd4c406ad60 0x7fd4c406d210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00f300 tx=0x7fd4dc0042c0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:14.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:14.952+0000 7fd4e17fa700 1 -- 172.21.15.118:0/3691122896 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd4d40553e0 con 0x7fd4e4159500 2023-07-13T13:52:15.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.137+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd4e41eef20 con 0x7fd4e4159500 2023-07-13T13:52:15.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.536+0000 7fd4e17fa700 1 -- 172.21.15.118:0/3691122896 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd4d402b0b0 con 0x7fd4e4159500 2023-07-13T13:52:15.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.538+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd4c406ad60 msgr2=0x7fd4c406d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:15.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.538+0000 7fd4eae43700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd4c406ad60 0x7fd4c406d210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00f300 tx=0x7fd4dc0042c0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 msgr2=0x7fd4e41f1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:15.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e41f1a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009790 tx=0x7fd4d4004750 comp rx=0 tx=0).stop 2023-07-13T13:52:15.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 shutdown_connections 2023-07-13T13:52:15.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd4c406ad60 0x7fd4c406d210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e41529b0 0x7fd4e406c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd4e4159500 0x7fd4e41f1a50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 --2- 172.21.15.118:0/3691122896 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4e4152d80 0x7fd4e41f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 >> 172.21.15.118:0/3691122896 conn(0x7fd4e406e060 msgr2=0x7fd4e414bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:15.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 shutdown_connections 2023-07-13T13:52:15.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.539+0000 7fd4eae43700 1 -- 172.21.15.118:0/3691122896 wait complete. 2023-07-13T13:52:15.514 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2023-07-13T13:52:15.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-13T13:52:15.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.686+0000 7f3c27a71700 1 Processor -- start 2023-07-13T13:52:15.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.686+0000 7f3c27a71700 1 -- start start 2023-07-13T13:52:15.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.687+0000 7f3c27a71700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3c200c8c50 0x7f3c200c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:15.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.687+0000 7f3c27a71700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c2015c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:15.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.687+0000 7f3c27a71700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2006bd50 con 0x7f3c20152700 2023-07-13T13:52:15.660 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.687+0000 7f3c27a71700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c200c85a0 con 0x7f3c200c8c50 2023-07-13T13:52:15.660 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.687+0000 7f3c27a71700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200722d0 con 0x7f3c200c8160 2023-07-13T13:52:15.660 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.687+0000 7f3c2500c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3c200c8c50 0x7f3c200c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:15.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.688+0000 7f3c2580d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3c20152700 0x7f3c20071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:35262/0 (socket says 172.21.15.118:35262) 2023-07-13T13:52:15.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.688+0000 7f3c2580d700 1 -- 172.21.15.118:0/34034067 learned_addr learned my addr 172.21.15.118:0/34034067 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:15.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.688+0000 7f3c2600e700 1 --2- 172.21.15.118:0/34034067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c2015c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:15.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.690+0000 7f3c2480b700 1 -- 172.21.15.118:0/34034067 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815910143 0 0) 0x7f3c2006bd50 con 0x7f3c20152700 2023-07-13T13:52:15.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.690+0000 7f3c2480b700 1 -- 172.21.15.118:0/34034067 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c0c0035b0 con 0x7f3c20152700 2023-07-13T13:52:15.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.691+0000 7f3c2600e700 1 -- 172.21.15.118:0/34034067 >> v2:172.21.15.118:3300/0 conn(0x7f3c200c8c50 msgr2=0x7f3c200c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:15.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.691+0000 7f3c2600e700 1 --2- 172.21.15.118:0/34034067 >> v2:172.21.15.118:3300/0 conn(0x7f3c200c8c50 0x7f3c200c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.691+0000 7f3c2600e700 1 -- 172.21.15.118:0/34034067 >> v1:172.21.15.123:6789/0 conn(0x7f3c20152700 legacy=0x7f3c20071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:15.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.691+0000 7f3c2600e700 1 -- 172.21.15.118:0/34034067 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2015bbd0 con 0x7f3c200c8160 2023-07-13T13:52:15.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.693+0000 7f3c2600e700 1 --2- 172.21.15.118:0/34034067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c2015c060 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009d90 tx=0x7f3c1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b04a5ef107e996 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:15.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.697+0000 7f3c2480b700 1 -- 172.21.15.118:0/34034067 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800e070 con 0x7f3c200c8160 2023-07-13T13:52:15.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.697+0000 7f3c2480b700 1 -- 172.21.15.118:0/34034067 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800bb20 con 0x7f3c200c8160 2023-07-13T13:52:15.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.697+0000 7f3c2480b700 1 -- 172.21.15.118:0/34034067 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18012430 con 0x7f3c200c8160 2023-07-13T13:52:15.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.698+0000 7f3c27a71700 1 -- 172.21.15.118:0/34034067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 msgr2=0x7f3c2015c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:15.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.698+0000 7f3c27a71700 1 --2- 172.21.15.118:0/34034067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c2015c060 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009d90 tx=0x7f3c1800b330 comp rx=0 tx=0).stop 2023-07-13T13:52:15.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.698+0000 7f3c27a71700 1 -- 172.21.15.118:0/34034067 shutdown_connections 2023-07-13T13:52:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.698+0000 7f3c27a71700 1 --2- 172.21.15.118:0/34034067 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c2015c060 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.698+0000 7f3c27a71700 1 --2- 172.21.15.118:0/34034067 >> v2:172.21.15.118:3300/0 conn(0x7f3c200c8c50 0x7f3c200c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.698+0000 7f3c27a71700 1 -- 172.21.15.118:0/34034067 >> 172.21.15.118:0/34034067 conn(0x7f3c2006b040 msgr2=0x7f3c2006b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:15.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.698+0000 7f3c27a71700 1 -- 172.21.15.118:0/34034067 shutdown_connections 2023-07-13T13:52:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.698+0000 7f3c27a71700 1 -- 172.21.15.118:0/34034067 wait complete. 2023-07-13T13:52:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.699+0000 7f3c27a71700 1 Processor -- start 2023-07-13T13:52:15.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.699+0000 7f3c27a71700 1 -- start start 2023-07-13T13:52:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.700+0000 7f3c27a71700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c201f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.700+0000 7f3c27a71700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200c8c50 0x7f3c20156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:15.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.700+0000 7f3c27a71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20152700 0x7f3c201ee890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:15.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.700+0000 7f3c27a71700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200c9c90 con 0x7f3c20152700 2023-07-13T13:52:15.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.700+0000 7f3c27a71700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200c9930 con 0x7f3c200c8c50 2023-07-13T13:52:15.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.700+0000 7f3c27a71700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c20151760 con 0x7f3c200c8160 2023-07-13T13:52:15.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.700+0000 7f3c2600e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20152700 0x7f3c201ee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:15.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.701+0000 7f3c2500c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200c8c50 0x7f3c20156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:15.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.701+0000 7f3c2600e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20152700 0x7f3c201ee890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46042/0 (socket says 172.21.15.118:46042) 2023-07-13T13:52:15.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.701+0000 7f3c2600e700 1 -- 172.21.15.118:0/726436087 learned_addr learned my addr 172.21.15.118:0/726436087 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:15.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.701+0000 7f3c2580d700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c201f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:15.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.705+0000 7f3c2600e700 1 -- 172.21.15.118:0/726436087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 msgr2=0x7f3c201f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:15.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.705+0000 7f3c2600e700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c201f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.705+0000 7f3c2600e700 1 -- 172.21.15.118:0/726436087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200c8c50 msgr2=0x7f3c20156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:15.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.705+0000 7f3c2600e700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200c8c50 0x7f3c20156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:15.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.705+0000 7f3c2600e700 1 -- 172.21.15.118:0/726436087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18009a70 con 0x7f3c20152700 2023-07-13T13:52:15.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.707+0000 7f3c2600e700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20152700 0x7f3c201ee890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c18014040 tx=0x7f3c18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:15.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.709+0000 7f3c167fc700 1 -- 172.21.15.118:0/726436087 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18004780 con 0x7f3c20152700 2023-07-13T13:52:15.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.709+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c20151f50 con 0x7f3c20152700 2023-07-13T13:52:15.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.709+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c201ee3b0 con 0x7f3c20152700 2023-07-13T13:52:15.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.710+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c201ee590 con 0x7f3c20152700 2023-07-13T13:52:15.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.711+0000 7f3c167fc700 1 -- 172.21.15.118:0/726436087 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18020070 con 0x7f3c20152700 2023-07-13T13:52:15.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.711+0000 7f3c167fc700 1 -- 172.21.15.118:0/726436087 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180276a0 con 0x7f3c20152700 2023-07-13T13:52:15.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.964+0000 7f3c167fc700 1 -- 172.21.15.118:0/726436087 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c18031470 con 0x7f3c20152700 2023-07-13T13:52:15.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.964+0000 7f3c167fc700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3c0406ad10 0x7f3c0406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:15.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.964+0000 7f3c167fc700 1 -- 172.21.15.118:0/726436087 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f3c18022070 con 0x7f3c20152700 2023-07-13T13:52:15.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.964+0000 7f3c2580d700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3c0406ad10 0x7f3c0406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:15.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.965+0000 7f3c2580d700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3c0406ad10 0x7f3c0406d1c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c10007fd0 tx=0x7f3c10009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:15.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:15.975+0000 7f3c167fc700 1 -- 172.21.15.118:0/726436087 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c18056a20 con 0x7f3c20152700 2023-07-13T13:52:16.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.161+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f3c20070230 con 0x7f3c20152700 2023-07-13T13:52:16.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.604+0000 7f3c167fc700 1 -- 172.21.15.118:0/726436087 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f3c1805a040 con 0x7f3c20152700 2023-07-13T13:52:16.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3c0406ad10 msgr2=0x7f3c0406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:16.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3c0406ad10 0x7f3c0406d1c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c10007fd0 tx=0x7f3c10009040 comp rx=0 tx=0).stop 2023-07-13T13:52:16.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20152700 msgr2=0x7f3c201ee890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:16.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20152700 0x7f3c201ee890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c18014040 tx=0x7f3c18004ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:16.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 shutdown_connections 2023-07-13T13:52:16.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3c0406ad10 0x7f3c0406d1c0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c10007fd0 tx=0x7f3c10009040 comp rx=0 tx=0).stop 2023-07-13T13:52:16.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3c20152700 0x7f3c201ee890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:16.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3c200c8160 0x7f3c201f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:16.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 --2- 172.21.15.118:0/726436087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200c8c50 0x7f3c20156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:16.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 >> 172.21.15.118:0/726436087 conn(0x7f3c2006b040 msgr2=0x7f3c2006b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:16.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 shutdown_connections 2023-07-13T13:52:16.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.607+0000 7f3c27a71700 1 -- 172.21.15.118:0/726436087 wait complete. 2023-07-13T13:52:16.582 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2023-07-13T13:52:16.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-13T13:52:16.731 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.759+0000 7f6ee7794700 1 Processor -- start 2023-07-13T13:52:16.732 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.759+0000 7f6ee7794700 1 -- start start 2023-07-13T13:52:16.732 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.760+0000 7f6ee7794700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b36d0 0x7f6ee015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:16.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.760+0000 7f6ee7794700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee0159680 con 0x7f6ee00b3aa0 2023-07-13T13:52:16.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.760+0000 7f6ee7794700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee0158740 con 0x7f6ee0159200 2023-07-13T13:52:16.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.760+0000 7f6ee7794700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00c3af0 con 0x7f6ee00b36d0 2023-07-13T13:52:16.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.761+0000 7f6ee5530700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b36d0 0x7f6ee015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:16.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.761+0000 7f6ee5530700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b36d0 0x7f6ee015bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40122/0 (socket says 172.21.15.118:40122) 2023-07-13T13:52:16.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.761+0000 7f6ee5530700 1 -- 172.21.15.118:0/3424425816 learned_addr learned my addr 172.21.15.118:0/3424425816 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:16.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.764+0000 7f6ee5530700 1 -- 172.21.15.118:0/3424425816 >> v1:172.21.15.123:6789/0 conn(0x7f6ee0159200 legacy=0x7f6ee006ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:16.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.764+0000 7f6ee5530700 1 -- 172.21.15.118:0/3424425816 >> v1:172.21.15.118:6789/0 conn(0x7f6ee00b3aa0 legacy=0x7f6ee00ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:16.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.764+0000 7f6ee5530700 1 -- 172.21.15.118:0/3424425816 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00c3dd0 con 0x7f6ee00b36d0 2023-07-13T13:52:16.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.766+0000 7f6ee5530700 1 --2- 172.21.15.118:0/3424425816 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b36d0 0x7f6ee015bcb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009920 tx=0x7f6ed8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d750f334ad6bb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:16.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.773+0000 7f6edffff700 1 -- 172.21.15.118:0/3424425816 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004230 con 0x7f6ee00b36d0 2023-07-13T13:52:16.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.773+0000 7f6edffff700 1 -- 172.21.15.118:0/3424425816 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed8004390 con 0x7f6ee00b36d0 2023-07-13T13:52:16.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.773+0000 7f6edffff700 1 -- 172.21.15.118:0/3424425816 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8009e70 con 0x7f6ee00b36d0 2023-07-13T13:52:16.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.773+0000 7f6ee7794700 1 -- 172.21.15.118:0/3424425816 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b36d0 msgr2=0x7f6ee015bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:16.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.773+0000 7f6ee7794700 1 --2- 172.21.15.118:0/3424425816 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b36d0 0x7f6ee015bcb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009920 tx=0x7f6ed8009c30 comp rx=0 tx=0).stop 2023-07-13T13:52:16.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.773+0000 7f6ee7794700 1 -- 172.21.15.118:0/3424425816 shutdown_connections 2023-07-13T13:52:16.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.773+0000 7f6ee7794700 1 --2- 172.21.15.118:0/3424425816 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b36d0 0x7f6ee015bcb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:16.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.773+0000 7f6ee7794700 1 -- 172.21.15.118:0/3424425816 >> 172.21.15.118:0/3424425816 conn(0x7f6ee0071840 msgr2=0x7f6ee006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:16.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.774+0000 7f6ee7794700 1 -- 172.21.15.118:0/3424425816 shutdown_connections 2023-07-13T13:52:16.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.774+0000 7f6ee7794700 1 -- 172.21.15.118:0/3424425816 wait complete. 2023-07-13T13:52:16.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.775+0000 7f6ee7794700 1 Processor -- start 2023-07-13T13:52:16.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.775+0000 7f6ee7794700 1 -- start start 2023-07-13T13:52:16.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.775+0000 7f6ee7794700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00b36d0 0x7f6ee01e1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:16.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.775+0000 7f6ee7794700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b3aa0 0x7f6ee0156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:16.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.775+0000 7f6ee7794700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ee0159200 0x7f6ee01f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:16.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.775+0000 7f6ee7794700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee01e2c40 con 0x7f6ee00b36d0 2023-07-13T13:52:16.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.775+0000 7f6ee7794700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0155430 con 0x7f6ee0159200 2023-07-13T13:52:16.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.775+0000 7f6ee7794700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee01e2680 con 0x7f6ee00b3aa0 2023-07-13T13:52:16.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.779+0000 7f6ee4d2f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b3aa0 0x7f6ee0156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:16.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.779+0000 7f6ee4d2f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b3aa0 0x7f6ee0156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40126/0 (socket says 172.21.15.118:40126) 2023-07-13T13:52:16.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.779+0000 7f6ee4d2f700 1 -- 172.21.15.118:0/3741844917 learned_addr learned my addr 172.21.15.118:0/3741844917 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:16.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.779+0000 7f6ee5d31700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ee0159200 0x7f6ee01f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:16.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.783+0000 7f6ee4d2f700 1 -- 172.21.15.118:0/3741844917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ee0159200 msgr2=0x7f6ee01f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:16.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.783+0000 7f6ee4d2f700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ee0159200 0x7f6ee01f13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:16.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.783+0000 7f6ee4d2f700 1 -- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00b36d0 msgr2=0x7f6ee01e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:16.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.783+0000 7f6ee4d2f700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00b36d0 0x7f6ee01e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:16.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.784+0000 7f6ee4d2f700 1 -- 172.21.15.118:0/3741844917 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8009550 con 0x7f6ee00b3aa0 2023-07-13T13:52:16.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.787+0000 7f6ee4d2f700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b3aa0 0x7f6ee0156f30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c500 tx=0x7f6ed400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:16.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.864+0000 7f6eddffb700 1 -- 172.21.15.118:0/3741844917 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4011790 con 0x7f6ee00b3aa0 2023-07-13T13:52:16.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.865+0000 7f6eddffb700 1 -- 172.21.15.118:0/3741844917 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40118f0 con 0x7f6ee00b3aa0 2023-07-13T13:52:16.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.865+0000 7f6eddffb700 1 -- 172.21.15.118:0/3741844917 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4011ca0 con 0x7f6ee00b3aa0 2023-07-13T13:52:16.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.865+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee01e2960 con 0x7f6ee00b3aa0 2023-07-13T13:52:16.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.865+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee01559b0 con 0x7f6ee00b3aa0 2023-07-13T13:52:16.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:16.866+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee0155270 con 0x7f6ee00b3aa0 2023-07-13T13:52:17.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:17.119+0000 7f6eddffb700 1 -- 172.21.15.118:0/3741844917 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ed401c460 con 0x7f6ee00b3aa0 2023-07-13T13:52:17.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:17.119+0000 7f6eddffb700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6ecc06ad60 0x7f6ecc06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:17.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:17.120+0000 7f6ee5530700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6ecc06ad60 0x7f6ecc06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:17.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:17.120+0000 7f6ee5530700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6ecc06ad60 0x7f6ecc06d210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8000c00 tx=0x7f6ed8010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:17.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:17.123+0000 7f6eddffb700 1 -- 172.21.15.118:0/3741844917 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f6ed405c9f0 con 0x7f6ee00b3aa0 2023-07-13T13:52:17.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:17.133+0000 7f6eddffb700 1 -- 172.21.15.118:0/3741844917 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6ed4054d70 con 0x7f6ee00b3aa0 2023-07-13T13:52:17.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:17.363+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6ee006ab20 con 0x7f6ee00b3aa0 2023-07-13T13:52:18.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.154+0000 7f6eddffb700 1 -- 172.21.15.118:0/3741844917 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6ed4058390 con 0x7f6ee00b3aa0 2023-07-13T13:52:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6ecc06ad60 msgr2=0x7f6ecc06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6ecc06ad60 0x7f6ecc06d210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8000c00 tx=0x7f6ed8010000 comp rx=0 tx=0).stop 2023-07-13T13:52:18.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b3aa0 msgr2=0x7f6ee0156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b3aa0 0x7f6ee0156f30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c500 tx=0x7f6ed400c810 comp rx=0 tx=0).stop 2023-07-13T13:52:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 shutdown_connections 2023-07-13T13:52:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6ecc06ad60 0x7f6ecc06d210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ee0159200 0x7f6ee01f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ee00b36d0 0x7f6ee01e1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 --2- 172.21.15.118:0/3741844917 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6ee00b3aa0 0x7f6ee0156f30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 >> 172.21.15.118:0/3741844917 conn(0x7f6ee0071840 msgr2=0x7f6ee00c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:18.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 shutdown_connections 2023-07-13T13:52:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.156+0000 7f6ee7794700 1 -- 172.21.15.118:0/3741844917 wait complete. 2023-07-13T13:52:18.131 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 3 and data pool 4 2023-07-13T13:52:18.141 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-13T13:52:18.141 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-13T13:52:18.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.313+0000 7f695a827700 1 Processor -- start 2023-07-13T13:52:18.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.313+0000 7f695a827700 1 -- start start 2023-07-13T13:52:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.314+0000 7f695a827700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f69541529b0 0x7f69540c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.314+0000 7f695a827700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954159500 0x7f69540c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.314+0000 7f695a827700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69540af1f0 con 0x7f6954152d80 2023-07-13T13:52:18.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.314+0000 7f695a827700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6954158810 con 0x7f69541529b0 2023-07-13T13:52:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.314+0000 7f695a827700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69540c1b20 con 0x7f6954159500 2023-07-13T13:52:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.315+0000 7f6958dc4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954159500 0x7f69540c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.315+0000 7f6958dc4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954159500 0x7f69540c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40134/0 (socket says 172.21.15.118:40134) 2023-07-13T13:52:18.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.315+0000 7f6958dc4700 1 -- 172.21.15.118:0/1134864201 learned_addr learned my addr 172.21.15.118:0/1134864201 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:18.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.319+0000 7f6958dc4700 1 -- 172.21.15.118:0/1134864201 >> v2:172.21.15.118:3300/0 conn(0x7f69541529b0 msgr2=0x7f69540c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:18.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.319+0000 7f6958dc4700 1 --2- 172.21.15.118:0/1134864201 >> v2:172.21.15.118:3300/0 conn(0x7f69541529b0 0x7f69540c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.319+0000 7f6958dc4700 1 -- 172.21.15.118:0/1134864201 >> v1:172.21.15.118:6789/0 conn(0x7f6954152d80 legacy=0x7f695415bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:18.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.319+0000 7f6958dc4700 1 -- 172.21.15.118:0/1134864201 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69540c1e00 con 0x7f6954159500 2023-07-13T13:52:18.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.321+0000 7f6958dc4700 1 --2- 172.21.15.118:0/1134864201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954159500 0x7f69540c6fc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f694c009e50 tx=0x7f694c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e07f987a300d4e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:18.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.325+0000 7f6952ffd700 1 -- 172.21.15.118:0/1134864201 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00e070 con 0x7f6954159500 2023-07-13T13:52:18.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.325+0000 7f6952ffd700 1 -- 172.21.15.118:0/1134864201 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c003a20 con 0x7f6954159500 2023-07-13T13:52:18.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.325+0000 7f6952ffd700 1 -- 172.21.15.118:0/1134864201 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c003dd0 con 0x7f6954159500 2023-07-13T13:52:18.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.326+0000 7f695a827700 1 -- 172.21.15.118:0/1134864201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954159500 msgr2=0x7f69540c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:18.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.326+0000 7f695a827700 1 --2- 172.21.15.118:0/1134864201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954159500 0x7f69540c6fc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f694c009e50 tx=0x7f694c00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:18.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.326+0000 7f695a827700 1 -- 172.21.15.118:0/1134864201 shutdown_connections 2023-07-13T13:52:18.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.326+0000 7f695a827700 1 --2- 172.21.15.118:0/1134864201 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954159500 0x7f69540c6fc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.326+0000 7f695a827700 1 --2- 172.21.15.118:0/1134864201 >> v2:172.21.15.118:3300/0 conn(0x7f69541529b0 0x7f69540c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.326+0000 7f695a827700 1 -- 172.21.15.118:0/1134864201 >> 172.21.15.118:0/1134864201 conn(0x7f695406e060 msgr2=0x7f695406eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:18.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.326+0000 7f695a827700 1 -- 172.21.15.118:0/1134864201 shutdown_connections 2023-07-13T13:52:18.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.326+0000 7f695a827700 1 -- 172.21.15.118:0/1134864201 wait complete. 2023-07-13T13:52:18.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.328+0000 7f695a827700 1 Processor -- start 2023-07-13T13:52:18.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.328+0000 7f695a827700 1 -- start start 2023-07-13T13:52:18.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.328+0000 7f695a827700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69541529b0 0x7f69541f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:18.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.328+0000 7f695a827700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954152d80 0x7f69540c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:18.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.328+0000 7f695a827700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6954159500 0x7f69540c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:18.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.328+0000 7f695a827700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69540aca80 con 0x7f6954159500 2023-07-13T13:52:18.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.328+0000 7f695a827700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69540c4950 con 0x7f69541529b0 2023-07-13T13:52:18.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.328+0000 7f695a827700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69541f21e0 con 0x7f6954152d80 2023-07-13T13:52:18.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.329+0000 7f69537fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954152d80 0x7f69540c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:18.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.329+0000 7f69537fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954152d80 0x7f69540c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40140/0 (socket says 172.21.15.118:40140) 2023-07-13T13:52:18.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.329+0000 7f69537fe700 1 -- 172.21.15.118:0/1954498143 learned_addr learned my addr 172.21.15.118:0/1954498143 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:18.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.330+0000 7f6953fff700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69541529b0 0x7f69541f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:18.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.334+0000 7f69537fe700 1 -- 172.21.15.118:0/1954498143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69541529b0 msgr2=0x7f69541f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:18.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.334+0000 7f69537fe700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69541529b0 0x7f69541f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.334+0000 7f69537fe700 1 -- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6954159500 msgr2=0x7f69540c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:18.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.334+0000 7f69537fe700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6954159500 0x7f69540c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:18.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.334+0000 7f69537fe700 1 -- 172.21.15.118:0/1954498143 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c009b30 con 0x7f6954152d80 2023-07-13T13:52:18.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.337+0000 7f69537fe700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954152d80 0x7f69540c6f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f694800c4a0 tx=0x7f694800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:18.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.341+0000 7f6950ff9700 1 -- 172.21.15.118:0/1954498143 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69480054e0 con 0x7f6954152d80 2023-07-13T13:52:18.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.341+0000 7f6950ff9700 1 -- 172.21.15.118:0/1954498143 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948003680 con 0x7f6954152d80 2023-07-13T13:52:18.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.341+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69540ae130 con 0x7f6954152d80 2023-07-13T13:52:18.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.341+0000 7f6950ff9700 1 -- 172.21.15.118:0/1954498143 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948003a10 con 0x7f6954152d80 2023-07-13T13:52:18.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.341+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69540c5090 con 0x7f6954152d80 2023-07-13T13:52:18.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.342+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695404e280 con 0x7f6954152d80 2023-07-13T13:52:18.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.367+0000 7f6950ff9700 1 -- 172.21.15.118:0/1954498143 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6948003b70 con 0x7f6954152d80 2023-07-13T13:52:18.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.367+0000 7f6950ff9700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f694006ad30 0x7f694006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:18.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.367+0000 7f6953fff700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f694006ad30 0x7f694006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:18.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.368+0000 7f6953fff700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f694006ad30 0x7f694006d1e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6944009a10 tx=0x7f6944009190 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:18.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.372+0000 7f6950ff9700 1 -- 172.21.15.118:0/1954498143 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6948003e20 con 0x7f6954152d80 2023-07-13T13:52:18.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.624+0000 7f6950ff9700 1 -- 172.21.15.118:0/1954498143 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6948054290 con 0x7f6954152d80 2023-07-13T13:52:18.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:18.832+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f695406de40 con 0x7f6954152d80 2023-07-13T13:52:20.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.045+0000 7f6950ff9700 1 -- 172.21.15.118:0/1954498143 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7f6948021070 con 0x7f6954152d80 2023-07-13T13:52:20.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f694006ad30 msgr2=0x7f694006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:20.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f694006ad30 0x7f694006d1e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6944009a10 tx=0x7f6944009190 comp rx=0 tx=0).stop 2023-07-13T13:52:20.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954152d80 msgr2=0x7f69540c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:20.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954152d80 0x7f69540c6f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f694800c4a0 tx=0x7f694800c7b0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 shutdown_connections 2023-07-13T13:52:20.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f694006ad30 0x7f694006d1e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69541529b0 0x7f69541f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6954159500 0x7f69540c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 --2- 172.21.15.118:0/1954498143 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6954152d80 0x7f69540c6f00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 >> 172.21.15.118:0/1954498143 conn(0x7f695406e060 msgr2=0x7f695414d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:20.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 shutdown_connections 2023-07-13T13:52:20.021 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.047+0000 7f695a827700 1 -- 172.21.15.118:0/1954498143 wait complete. 2023-07-13T13:52:20.032 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-13T13:52:20.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.199+0000 7f5ac5937700 1 Processor -- start 2023-07-13T13:52:20.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.199+0000 7f5ac5937700 1 -- start start 2023-07-13T13:52:20.173 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.200+0000 7f5ac5937700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac0152950 0x7f5ac00c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:20.173 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.200+0000 7f5ac5937700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ac0158470 0x7f5ac00c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:20.173 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.201+0000 7f5ac5937700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac00c8950 con 0x7f5ac015c470 2023-07-13T13:52:20.173 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.201+0000 7f5ac5937700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac00c9690 con 0x7f5ac0158470 2023-07-13T13:52:20.173 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.201+0000 7f5ac5937700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac015c960 con 0x7f5ac0152950 2023-07-13T13:52:20.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.201+0000 7f5abeffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac0152950 0x7f5ac00c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:20.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.202+0000 7f5abeffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac0152950 0x7f5ac00c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40154/0 (socket says 172.21.15.118:40154) 2023-07-13T13:52:20.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.202+0000 7f5abeffd700 1 -- 172.21.15.118:0/2751005165 learned_addr learned my addr 172.21.15.118:0/2751005165 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:20.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.205+0000 7f5abeffd700 1 -- 172.21.15.118:0/2751005165 >> v2:172.21.15.118:3300/0 conn(0x7f5ac0158470 msgr2=0x7f5ac00c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:20.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.205+0000 7f5abeffd700 1 --2- 172.21.15.118:0/2751005165 >> v2:172.21.15.118:3300/0 conn(0x7f5ac0158470 0x7f5ac00c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.205+0000 7f5abeffd700 1 -- 172.21.15.118:0/2751005165 >> v1:172.21.15.118:6789/0 conn(0x7f5ac015c470 legacy=0x7f5ac00c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:20.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.205+0000 7f5abeffd700 1 -- 172.21.15.118:0/2751005165 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00ca0b0 con 0x7f5ac0152950 2023-07-13T13:52:20.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.207+0000 7f5abeffd700 1 --2- 172.21.15.118:0/2751005165 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac0152950 0x7f5ac00c9b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00098f0 tx=0x7f5ab0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49807e877fe53ba9 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:20.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.213+0000 7f5abdffb700 1 -- 172.21.15.118:0/2751005165 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0004230 con 0x7f5ac0152950 2023-07-13T13:52:20.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.213+0000 7f5abdffb700 1 -- 172.21.15.118:0/2751005165 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab0004390 con 0x7f5ac0152950 2023-07-13T13:52:20.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.213+0000 7f5abdffb700 1 -- 172.21.15.118:0/2751005165 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00036a0 con 0x7f5ac0152950 2023-07-13T13:52:20.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.214+0000 7f5ac5937700 1 -- 172.21.15.118:0/2751005165 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac0152950 msgr2=0x7f5ac00c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:20.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.214+0000 7f5ac5937700 1 --2- 172.21.15.118:0/2751005165 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac0152950 0x7f5ac00c9b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00098f0 tx=0x7f5ab0009c00 comp rx=0 tx=0).stop 2023-07-13T13:52:20.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.214+0000 7f5ac5937700 1 -- 172.21.15.118:0/2751005165 shutdown_connections 2023-07-13T13:52:20.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.214+0000 7f5ac5937700 1 --2- 172.21.15.118:0/2751005165 >> v2:172.21.15.118:3300/0 conn(0x7f5ac0158470 0x7f5ac00c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.214+0000 7f5ac5937700 1 --2- 172.21.15.118:0/2751005165 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac0152950 0x7f5ac00c9b70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.214+0000 7f5ac5937700 1 -- 172.21.15.118:0/2751005165 >> 172.21.15.118:0/2751005165 conn(0x7f5ac0065af0 msgr2=0x7f5ac0065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:20.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.214+0000 7f5ac5937700 1 -- 172.21.15.118:0/2751005165 shutdown_connections 2023-07-13T13:52:20.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.214+0000 7f5ac5937700 1 -- 172.21.15.118:0/2751005165 wait complete. 2023-07-13T13:52:20.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.215+0000 7f5ac5937700 1 Processor -- start 2023-07-13T13:52:20.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.215+0000 7f5ac5937700 1 -- start start 2023-07-13T13:52:20.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.216+0000 7f5ac5937700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac0152950 0x7f5ac00cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:20.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.216+0000 7f5ac5937700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac0158470 0x7f5ac0148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:20.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.216+0000 7f5ac5937700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac015c470 0x7f5ac0148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:20.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.216+0000 7f5ac5937700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac00cc930 con 0x7f5ac0152950 2023-07-13T13:52:20.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.216+0000 7f5ac5937700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0154340 con 0x7f5ac0158470 2023-07-13T13:52:20.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.216+0000 7f5ac5937700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac00cd930 con 0x7f5ac015c470 2023-07-13T13:52:20.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.229+0000 7f5abeffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac0152950 0x7f5ac00cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:20.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.230+0000 7f5abeffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac0152950 0x7f5ac00cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:46108/0 (socket says 172.21.15.118:46108) 2023-07-13T13:52:20.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.230+0000 7f5abeffd700 1 -- 172.21.15.118:0/3706440207 learned_addr learned my addr 172.21.15.118:0/3706440207 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:20.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.236+0000 7f5abeffd700 1 -- 172.21.15.118:0/3706440207 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac015c470 msgr2=0x7f5ac0148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:20.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.236+0000 7f5abeffd700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac015c470 0x7f5ac0148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.236+0000 7f5abeffd700 1 -- 172.21.15.118:0/3706440207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac0158470 msgr2=0x7f5ac0148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:20.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.236+0000 7f5abeffd700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac0158470 0x7f5ac0148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:20.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.236+0000 7f5abeffd700 1 -- 172.21.15.118:0/3706440207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009550 con 0x7f5ac0152950 2023-07-13T13:52:20.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.242+0000 7f5abeffd700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac0152950 0x7f5ac00cd3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ac015caa0 tx=0x7f5ab0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:20.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.245+0000 7f5aa7fff700 1 -- 172.21.15.118:0/3706440207 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000b660 con 0x7f5ac0152950 2023-07-13T13:52:20.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.245+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac0154570 con 0x7f5ac0152950 2023-07-13T13:52:20.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.245+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac0153990 con 0x7f5ac0152950 2023-07-13T13:52:20.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.246+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac01537c0 con 0x7f5ac0152950 2023-07-13T13:52:20.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.500+0000 7f5aa7fff700 1 -- 172.21.15.118:0/3706440207 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab000b7c0 con 0x7f5ac0152950 2023-07-13T13:52:20.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.500+0000 7f5aa7fff700 1 -- 172.21.15.118:0/3706440207 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000bb30 con 0x7f5ac0152950 2023-07-13T13:52:20.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.522+0000 7f5aa7fff700 1 -- 172.21.15.118:0/3706440207 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ab0022070 con 0x7f5ac0152950 2023-07-13T13:52:20.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.523+0000 7f5aa7fff700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5aac06ace0 0x7f5aac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:20.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.523+0000 7f5aa7fff700 1 -- 172.21.15.118:0/3706440207 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f5ab008b720 con 0x7f5ac0152950 2023-07-13T13:52:20.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.523+0000 7f5abe7fc700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5aac06ace0 0x7f5aac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:20.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.523+0000 7f5aa7fff700 1 -- 172.21.15.118:0/3706440207 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5ab008bc20 con 0x7f5ac0152950 2023-07-13T13:52:20.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.523+0000 7f5abe7fc700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5aac06ace0 0x7f5aac06d190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00c50d0 tx=0x7f5ab4006c30 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:20.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:20.717+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5ac01537c0 con 0x7f5ac0152950 2023-07-13T13:52:20.835 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:52:20.838 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:52:20.940 INFO:tasks.ceph.mds.e.smithi118.stderr:2023-07-13T13:52:20.963+0000 15d2c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-13T13:52:22.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.769+0000 7f5aa7fff700 1 -- 172.21.15.118:0/3706440207 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f5ab0056710 con 0x7f5ac0152950 2023-07-13T13:52:22.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5aac06ace0 msgr2=0x7f5aac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:22.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5aac06ace0 0x7f5aac06d190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00c50d0 tx=0x7f5ab4006c30 comp rx=0 tx=0).stop 2023-07-13T13:52:22.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac0152950 msgr2=0x7f5ac00cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:22.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac0152950 0x7f5ac00cd3f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ac015caa0 tx=0x7f5ab0004750 comp rx=0 tx=0).stop 2023-07-13T13:52:22.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 shutdown_connections 2023-07-13T13:52:22.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5aac06ace0 0x7f5aac06d190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5ac015c470 0x7f5ac0148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac0152950 0x7f5ac00cd3f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 --2- 172.21.15.118:0/3706440207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac0158470 0x7f5ac0148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 >> 172.21.15.118:0/3706440207 conn(0x7f5ac0065af0 msgr2=0x7f5ac0156180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:22.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 shutdown_connections 2023-07-13T13:52:22.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.771+0000 7f5ac5937700 1 -- 172.21.15.118:0/3706440207 wait complete. 2023-07-13T13:52:22.746 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data_ec' created 2023-07-13T13:52:22.758 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-13T13:52:22.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.957+0000 7efec62a1700 1 Processor -- start 2023-07-13T13:52:22.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.957+0000 7efec62a1700 1 -- start start 2023-07-13T13:52:22.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.957+0000 7efec62a1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:22.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.957+0000 7efec62a1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efec0159200 0x7efec006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:22.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.958+0000 7efec62a1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec0159680 con 0x7efec00b3aa0 2023-07-13T13:52:22.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.958+0000 7efec62a1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec0158740 con 0x7efec0159200 2023-07-13T13:52:22.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.958+0000 7efec62a1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00c3af0 con 0x7efec00b36d0 2023-07-13T13:52:22.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.958+0000 7efebffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:22.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.958+0000 7efec483e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efec0159200 0x7efec006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:22.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.959+0000 7efebffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47348/0 (socket says 172.21.15.118:47348) 2023-07-13T13:52:22.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.959+0000 7efebffff700 1 -- 172.21.15.118:0/2363573582 learned_addr learned my addr 172.21.15.118:0/2363573582 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:22.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.962+0000 7efebffff700 1 -- 172.21.15.118:0/2363573582 >> v2:172.21.15.123:3300/0 conn(0x7efec0159200 msgr2=0x7efec006ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:22.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.962+0000 7efebffff700 1 --2- 172.21.15.118:0/2363573582 >> v2:172.21.15.123:3300/0 conn(0x7efec0159200 0x7efec006ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.962+0000 7efebffff700 1 -- 172.21.15.118:0/2363573582 >> v1:172.21.15.123:6789/0 conn(0x7efec00b3aa0 legacy=0x7efec00ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:22.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.962+0000 7efebffff700 1 -- 172.21.15.118:0/2363573582 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00c3dd0 con 0x7efec00b36d0 2023-07-13T13:52:22.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.964+0000 7efebffff700 1 --2- 172.21.15.118:0/2363573582 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015bcb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efeb00098f0 tx=0x7efeb0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff73d7cc1eeddec8 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:22.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.968+0000 7efebeffd700 1 -- 172.21.15.118:0/2363573582 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0011830 con 0x7efec00b36d0 2023-07-13T13:52:22.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.968+0000 7efebeffd700 1 -- 172.21.15.118:0/2363573582 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb0011990 con 0x7efec00b36d0 2023-07-13T13:52:22.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.968+0000 7efebeffd700 1 -- 172.21.15.118:0/2363573582 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0011d20 con 0x7efec00b36d0 2023-07-13T13:52:22.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.969+0000 7efec62a1700 1 -- 172.21.15.118:0/2363573582 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 msgr2=0x7efec015bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:22.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.969+0000 7efec62a1700 1 --2- 172.21.15.118:0/2363573582 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015bcb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efeb00098f0 tx=0x7efeb0009c00 comp rx=0 tx=0).stop 2023-07-13T13:52:22.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.969+0000 7efec62a1700 1 -- 172.21.15.118:0/2363573582 shutdown_connections 2023-07-13T13:52:22.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.969+0000 7efec62a1700 1 --2- 172.21.15.118:0/2363573582 >> v2:172.21.15.123:3300/0 conn(0x7efec0159200 0x7efec006ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.969+0000 7efec62a1700 1 --2- 172.21.15.118:0/2363573582 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015bcb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.969+0000 7efec62a1700 1 -- 172.21.15.118:0/2363573582 >> 172.21.15.118:0/2363573582 conn(0x7efec0071840 msgr2=0x7efec006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:22.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.969+0000 7efec62a1700 1 -- 172.21.15.118:0/2363573582 shutdown_connections 2023-07-13T13:52:22.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.969+0000 7efec62a1700 1 -- 172.21.15.118:0/2363573582 wait complete. 2023-07-13T13:52:22.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.970+0000 7efec62a1700 1 Processor -- start 2023-07-13T13:52:22.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.970+0000 7efec62a1700 1 -- start start 2023-07-13T13:52:22.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.971+0000 7efec62a1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:22.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.971+0000 7efec62a1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec00b3aa0 0x7efec00cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:22.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.971+0000 7efec62a1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efec0159200 0x7efec014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:22.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.971+0000 7efec62a1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec00cee70 con 0x7efec0159200 2023-07-13T13:52:22.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.971+0000 7efec62a1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec01f2100 con 0x7efec00b3aa0 2023-07-13T13:52:22.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.971+0000 7efec62a1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec01f1360 con 0x7efec00b36d0 2023-07-13T13:52:22.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.971+0000 7efec483e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efec0159200 0x7efec014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:22.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.972+0000 7efebffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:22.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.972+0000 7efebf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec00b3aa0 0x7efec00cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:22.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.972+0000 7efebffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47358/0 (socket says 172.21.15.118:47358) 2023-07-13T13:52:22.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.972+0000 7efebffff700 1 -- 172.21.15.118:0/1808365072 learned_addr learned my addr 172.21.15.118:0/1808365072 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:22.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.976+0000 7efebffff700 1 -- 172.21.15.118:0/1808365072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec00b3aa0 msgr2=0x7efec00cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:22.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.976+0000 7efebffff700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec00b3aa0 0x7efec00cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.976+0000 7efebffff700 1 -- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efec0159200 msgr2=0x7efec014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:22.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.976+0000 7efebffff700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efec0159200 0x7efec014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:22.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.976+0000 7efebffff700 1 -- 172.21.15.118:0/1808365072 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0009550 con 0x7efec00b36d0 2023-07-13T13:52:22.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.978+0000 7efebffff700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015aea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efec00c3c30 tx=0x7efeb0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:22.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.982+0000 7efebcff9700 1 -- 172.21.15.118:0/1808365072 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0004450 con 0x7efec00b36d0 2023-07-13T13:52:22.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.982+0000 7efebcff9700 1 -- 172.21.15.118:0/1808365072 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb001f070 con 0x7efec00b36d0 2023-07-13T13:52:22.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.982+0000 7efebcff9700 1 -- 172.21.15.118:0/1808365072 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb00038e0 con 0x7efec00b36d0 2023-07-13T13:52:22.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.982+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec0155870 con 0x7efec00b36d0 2023-07-13T13:52:22.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.982+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec01f1900 con 0x7efec00b36d0 2023-07-13T13:52:22.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:22.983+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec004e280 con 0x7efec00b36d0 2023-07-13T13:52:23.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.174+0000 7efebcff9700 1 -- 172.21.15.118:0/1808365072 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efeb0003a40 con 0x7efec00b36d0 2023-07-13T13:52:23.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.174+0000 7efebcff9700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efeac06ace0 0x7efeac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:23.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.174+0000 7efebf7fe700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efeac06ace0 0x7efeac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:23.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.175+0000 7efebf7fe700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efeac06ace0 0x7efeac06d190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efec00c8850 tx=0x7efeb4009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:23.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.178+0000 7efebcff9700 1 -- 172.21.15.118:0/1808365072 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7efeb0021070 con 0x7efec00b36d0 2023-07-13T13:52:23.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.245+0000 7efebcff9700 1 -- 172.21.15.118:0/1808365072 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efeb0055b30 con 0x7efec00b36d0 2023-07-13T13:52:23.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.439+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7efec00b2ad0 con 0x7efec00b36d0 2023-07-13T13:52:23.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.961+0000 7efebcff9700 1 -- 172.21.15.118:0/1808365072 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7efeb0015030 con 0x7efec00b36d0 2023-07-13T13:52:23.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efeac06ace0 msgr2=0x7efeac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:23.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efeac06ace0 0x7efeac06d190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efec00c8850 tx=0x7efeb4009040 comp rx=0 tx=0).stop 2023-07-13T13:52:23.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 msgr2=0x7efec015aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:23.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015aea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efec00c3c30 tx=0x7efeb0004750 comp rx=0 tx=0).stop 2023-07-13T13:52:23.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 shutdown_connections 2023-07-13T13:52:23.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efeac06ace0 0x7efeac06d190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:23.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efec0159200 0x7efec014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:23.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efec00b36d0 0x7efec015aea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:23.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 --2- 172.21.15.118:0/1808365072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efec00b3aa0 0x7efec00cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:23.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 >> 172.21.15.118:0/1808365072 conn(0x7efec0071840 msgr2=0x7efec0157290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:23.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 shutdown_connections 2023-07-13T13:52:23.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:23.964+0000 7efec62a1700 1 -- 172.21.15.118:0/1808365072 wait complete. 2023-07-13T13:52:23.939 INFO:teuthology.orchestra.run.smithi118.stderr:set pool 5 allow_ec_overwrites to true 2023-07-13T13:52:23.949 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-13T13:52:24.086 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.113+0000 7faa0ba3d700 1 Processor -- start 2023-07-13T13:52:24.086 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.114+0000 7faa0ba3d700 1 -- start start 2023-07-13T13:52:24.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.114+0000 7faa0ba3d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faa040c9810 0x7faa0406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:24.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.114+0000 7faa0ba3d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faa040c7400 0x7faa0406a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:24.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.114+0000 7faa0ba3d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa040c8d40 con 0x7faa04069f30 2023-07-13T13:52:24.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.114+0000 7faa0ba3d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0406a840 con 0x7faa040c9810 2023-07-13T13:52:24.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.114+0000 7faa0ba3d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa040aeeb0 con 0x7faa040c7400 2023-07-13T13:52:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.115+0000 7faa08fd8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faa040c9810 0x7faa0406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.115+0000 7faa09fda700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faa040c7400 0x7faa0406a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:24.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.116+0000 7faa09fda700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faa040c7400 0x7faa0406a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:44754/0 (socket says 172.21.15.118:44754) 2023-07-13T13:52:24.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.116+0000 7faa09fda700 1 -- 172.21.15.118:0/3275238695 learned_addr learned my addr 172.21.15.118:0/3275238695 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:24.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.118+0000 7faa09fda700 1 -- 172.21.15.118:0/3275238695 >> v2:172.21.15.118:3300/0 conn(0x7faa040c9810 msgr2=0x7faa0406ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:24.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.118+0000 7faa09fda700 1 --2- 172.21.15.118:0/3275238695 >> v2:172.21.15.118:3300/0 conn(0x7faa040c9810 0x7faa0406ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:24.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.118+0000 7faa09fda700 1 -- 172.21.15.118:0/3275238695 >> v1:172.21.15.118:6789/0 conn(0x7faa04069f30 legacy=0x7faa0415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:24.091 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.118+0000 7faa09fda700 1 -- 172.21.15.118:0/3275238695 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040af190 con 0x7faa040c7400 2023-07-13T13:52:24.093 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.121+0000 7faa09fda700 1 --2- 172.21.15.118:0/3275238695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 0x7faa0406a300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa0406f860 tx=0x7fa9fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adcb41113f0f415f server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.125+0000 7fa9f7fff700 1 -- 172.21.15.118:0/3275238695 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc00e070 con 0x7faa040c7400 2023-07-13T13:52:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.125+0000 7fa9f7fff700 1 -- 172.21.15.118:0/3275238695 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc00b910 con 0x7faa040c7400 2023-07-13T13:52:24.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.125+0000 7fa9f7fff700 1 -- 172.21.15.118:0/3275238695 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc00bcc0 con 0x7faa040c7400 2023-07-13T13:52:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.126+0000 7faa0ba3d700 1 -- 172.21.15.118:0/3275238695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 msgr2=0x7faa0406a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:24.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.126+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/3275238695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 0x7faa0406a300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa0406f860 tx=0x7fa9fc00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.126+0000 7faa0ba3d700 1 -- 172.21.15.118:0/3275238695 shutdown_connections 2023-07-13T13:52:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.126+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/3275238695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 0x7faa0406a300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.126+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/3275238695 >> v2:172.21.15.118:3300/0 conn(0x7faa040c9810 0x7faa0406ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.126+0000 7faa0ba3d700 1 -- 172.21.15.118:0/3275238695 >> 172.21.15.118:0/3275238695 conn(0x7faa0406ebd0 msgr2=0x7faa0406efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.126+0000 7faa0ba3d700 1 -- 172.21.15.118:0/3275238695 shutdown_connections 2023-07-13T13:52:24.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.126+0000 7faa0ba3d700 1 -- 172.21.15.118:0/3275238695 wait complete. 2023-07-13T13:52:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.127+0000 7faa0ba3d700 1 Processor -- start 2023-07-13T13:52:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.127+0000 7faa0ba3d700 1 -- start start 2023-07-13T13:52:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.128+0000 7faa0ba3d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa04069f30 0x7faa040b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:24.100 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.128+0000 7faa0ba3d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 0x7faa040b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:24.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.128+0000 7faa0ba3d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa040c9810 0x7faa04070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:24.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.128+0000 7faa0ba3d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040b15b0 con 0x7faa040c9810 2023-07-13T13:52:24.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.128+0000 7faa0ba3d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa04145460 con 0x7faa040c7400 2023-07-13T13:52:24.101 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.128+0000 7faa0ba3d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa04145160 con 0x7faa04069f30 2023-07-13T13:52:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.128+0000 7faa09fda700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa040c9810 0x7faa04070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.128+0000 7faa08fd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 0x7faa040b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.129+0000 7faa097d9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa04069f30 0x7faa040b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.129+0000 7faa09fda700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa040c9810 0x7faa04070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42984/0 (socket says 172.21.15.118:42984) 2023-07-13T13:52:24.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.129+0000 7faa09fda700 1 -- 172.21.15.118:0/2444803610 learned_addr learned my addr 172.21.15.118:0/2444803610 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:24.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.133+0000 7faa09fda700 1 -- 172.21.15.118:0/2444803610 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa04069f30 msgr2=0x7faa040b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:24.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.133+0000 7faa09fda700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa04069f30 0x7faa040b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:24.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.133+0000 7faa09fda700 1 -- 172.21.15.118:0/2444803610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 msgr2=0x7faa040b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:24.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.133+0000 7faa09fda700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 0x7faa040b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:24.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.133+0000 7faa09fda700 1 -- 172.21.15.118:0/2444803610 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc009b30 con 0x7faa040c9810 2023-07-13T13:52:24.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.135+0000 7faa09fda700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa040c9810 0x7faa04070240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00b680 tx=0x7fa9fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:24.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.139+0000 7fa9f5ffb700 1 -- 172.21.15.118:0/2444803610 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc004870 con 0x7faa040c9810 2023-07-13T13:52:24.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.139+0000 7fa9f5ffb700 1 -- 172.21.15.118:0/2444803610 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc0099b0 con 0x7faa040c9810 2023-07-13T13:52:24.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.139+0000 7fa9f5ffb700 1 -- 172.21.15.118:0/2444803610 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc01c680 con 0x7faa040c9810 2023-07-13T13:52:24.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.139+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa04145990 con 0x7faa040c9810 2023-07-13T13:52:24.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.140+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa041456b0 con 0x7faa040c9810 2023-07-13T13:52:24.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.140+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0406deb0 con 0x7faa040c9810 2023-07-13T13:52:24.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.159+0000 7fa9f5ffb700 1 -- 172.21.15.118:0/2444803610 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9fc01c7e0 con 0x7faa040c9810 2023-07-13T13:52:24.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.160+0000 7fa9f5ffb700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9e806ace0 0x7fa9e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:24.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.160+0000 7faa097d9700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9e806ace0 0x7fa9e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:24.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.160+0000 7faa097d9700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9e806ace0 0x7fa9e806d190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa00007fd0 tx=0x7faa00009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:24.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.291+0000 7fa9f5ffb700 1 -- 172.21.15.118:0/2444803610 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fa9fc05dda0 con 0x7faa040c9810 2023-07-13T13:52:24.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.406+0000 7fa9f5ffb700 1 -- 172.21.15.118:0/2444803610 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9fc056120 con 0x7faa040c9810 2023-07-13T13:52:24.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:24.653+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7faa040ae450 con 0x7faa040c9810 2023-07-13T13:52:25.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.058+0000 7fa9f5ffb700 1 -- 172.21.15.118:0/2444803610 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa9fc059740 con 0x7faa040c9810 2023-07-13T13:52:25.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9e806ace0 msgr2=0x7fa9e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9e806ace0 0x7fa9e806d190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa00007fd0 tx=0x7faa00009040 comp rx=0 tx=0).stop 2023-07-13T13:52:25.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa040c9810 msgr2=0x7faa04070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa040c9810 0x7faa04070240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00b680 tx=0x7fa9fc004ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 shutdown_connections 2023-07-13T13:52:25.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9e806ace0 0x7fa9e806d190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa040c9810 0x7faa04070240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa04069f30 0x7faa040b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 --2- 172.21.15.118:0/2444803610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa040c7400 0x7faa040b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 >> 172.21.15.118:0/2444803610 conn(0x7faa0406ebd0 msgr2=0x7faa0406c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:25.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 shutdown_connections 2023-07-13T13:52:25.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.060+0000 7faa0ba3d700 1 -- 172.21.15.118:0/2444803610 wait complete. 2023-07-13T13:52:25.035 INFO:teuthology.orchestra.run.smithi118.stderr:added data pool 5 to fsmap 2023-07-13T13:52:25.045 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T13:52:25.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.198+0000 7f1e1d7b3700 1 Processor -- start 2023-07-13T13:52:25.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.198+0000 7f1e1d7b3700 1 -- start start 2023-07-13T13:52:25.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.198+0000 7f1e1d7b3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1e1806de20 0x7f1e1806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.198+0000 7f1e1d7b3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.198+0000 7f1e1d7b3700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1815a080 con 0x7f1e18156160 2023-07-13T13:52:25.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.199+0000 7f1e1d7b3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1806e730 con 0x7f1e1806de20 2023-07-13T13:52:25.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.199+0000 7f1e1d7b3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180c2fc0 con 0x7f1e180c7360 2023-07-13T13:52:25.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.199+0000 7f1e16ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1e1806de20 0x7f1e1806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.199+0000 7f1e167fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.200+0000 7f1e167fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47390/0 (socket says 172.21.15.118:47390) 2023-07-13T13:52:25.173 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.200+0000 7f1e167fc700 1 -- 172.21.15.118:0/1808321575 learned_addr learned my addr 172.21.15.118:0/1808321575 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.202+0000 7f1e167fc700 1 -- 172.21.15.118:0/1808321575 >> v2:172.21.15.118:3300/0 conn(0x7f1e1806de20 msgr2=0x7f1e1806e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.202+0000 7f1e167fc700 1 --2- 172.21.15.118:0/1808321575 >> v2:172.21.15.118:3300/0 conn(0x7f1e1806de20 0x7f1e1806e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.202+0000 7f1e167fc700 1 -- 172.21.15.118:0/1808321575 >> v1:172.21.15.118:6789/0 conn(0x7f1e18156160 legacy=0x7f1e180c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:25.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.202+0000 7f1e167fc700 1 -- 172.21.15.118:0/1808321575 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180c3270 con 0x7f1e180c7360 2023-07-13T13:52:25.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.204+0000 7f1e167fc700 1 --2- 172.21.15.118:0/1808321575 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180c2a80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098f0 tx=0x7f1e0c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39921398e441b394 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:25.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e15ffb700 1 -- 172.21.15.118:0/1808321575 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c004230 con 0x7f1e180c7360 2023-07-13T13:52:25.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e15ffb700 1 -- 172.21.15.118:0/1808321575 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c004390 con 0x7f1e180c7360 2023-07-13T13:52:25.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e15ffb700 1 -- 172.21.15.118:0/1808321575 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0036a0 con 0x7f1e180c7360 2023-07-13T13:52:25.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/1808321575 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 msgr2=0x7f1e180c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/1808321575 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180c2a80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098f0 tx=0x7f1e0c009c00 comp rx=0 tx=0).stop 2023-07-13T13:52:25.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/1808321575 shutdown_connections 2023-07-13T13:52:25.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/1808321575 >> v2:172.21.15.118:3300/0 conn(0x7f1e1806de20 0x7f1e1806e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/1808321575 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180c2a80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/1808321575 >> 172.21.15.118:0/1808321575 conn(0x7f1e18069f30 msgr2=0x7f1e1806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:25.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/1808321575 shutdown_connections 2023-07-13T13:52:25.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.209+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/1808321575 wait complete. 2023-07-13T13:52:25.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.211+0000 7f1e1d7b3700 1 Processor -- start 2023-07-13T13:52:25.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.211+0000 7f1e1d7b3700 1 -- start start 2023-07-13T13:52:25.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.211+0000 7f1e1d7b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e1806de20 0x7f1e180ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.211+0000 7f1e1d7b3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.211+0000 7f1e1d7b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e18156160 0x7f1e180cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.211+0000 7f1e1d7b3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180cc500 con 0x7f1e1806de20 2023-07-13T13:52:25.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.211+0000 7f1e1d7b3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18157b20 con 0x7f1e18156160 2023-07-13T13:52:25.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.211+0000 7f1e1d7b3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180c8390 con 0x7f1e180c7360 2023-07-13T13:52:25.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.212+0000 7f1e16ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e1806de20 0x7f1e180ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.212+0000 7f1e167fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.212+0000 7f1e177fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e18156160 0x7f1e180cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.212+0000 7f1e16ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e1806de20 0x7f1e180ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43000/0 (socket says 172.21.15.118:43000) 2023-07-13T13:52:25.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.212+0000 7f1e16ffd700 1 -- 172.21.15.118:0/292491808 learned_addr learned my addr 172.21.15.118:0/292491808 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:25.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.217+0000 7f1e16ffd700 1 -- 172.21.15.118:0/292491808 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 msgr2=0x7f1e180caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.217+0000 7f1e16ffd700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.217+0000 7f1e16ffd700 1 -- 172.21.15.118:0/292491808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e18156160 msgr2=0x7f1e180cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.217+0000 7f1e16ffd700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e18156160 0x7f1e180cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.217+0000 7f1e16ffd700 1 -- 172.21.15.118:0/292491808 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c009550 con 0x7f1e1806de20 2023-07-13T13:52:25.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.219+0000 7f1e16ffd700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e1806de20 0x7f1e180ca6b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800e8a0 tx=0x7f1e0800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.223+0000 7f1dff7fe700 1 -- 172.21.15.118:0/292491808 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08009590 con 0x7f1e1806de20 2023-07-13T13:52:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.223+0000 7f1dff7fe700 1 -- 172.21.15.118:0/292491808 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e08013680 con 0x7f1e1806de20 2023-07-13T13:52:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.223+0000 7f1dff7fe700 1 -- 172.21.15.118:0/292491808 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080139f0 con 0x7f1e1806de20 2023-07-13T13:52:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.223+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e18158340 con 0x7f1e1806de20 2023-07-13T13:52:25.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.223+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e181f22c0 con 0x7f1e1806de20 2023-07-13T13:52:25.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.224+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e180743c0 con 0x7f1e1806de20 2023-07-13T13:52:25.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.394+0000 7f1dff7fe700 1 -- 172.21.15.118:0/292491808 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e08013b50 con 0x7f1e1806de20 2023-07-13T13:52:25.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.395+0000 7f1dff7fe700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1e0406ad30 0x7f1e0406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.395+0000 7f1dff7fe700 1 -- 172.21.15.118:0/292491808 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e08089e70 con 0x7f1e1806de20 2023-07-13T13:52:25.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.395+0000 7f1e167fc700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1e0406ad30 0x7f1e0406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.395+0000 7f1e167fc700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1e0406ad30 0x7f1e0406d1e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009130 tx=0x7f1e0c008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.492+0000 7f1dff7fe700 1 -- 172.21.15.118:0/292491808 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e08058610 con 0x7f1e1806de20 2023-07-13T13:52:25.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.720+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e180c69e0 con 0x7f1e1806de20 2023-07-13T13:52:25.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.757+0000 7f1dff7fe700 1 -- 172.21.15.118:0/292491808 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6194 (secure 0 0 0) 0x7f1e08021090 con 0x7f1e1806de20 2023-07-13T13:52:25.730 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:25.730 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1760692596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1760692596},{"type":"v1","addr":"172.21.15.118:6835","nonce":1760692596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3512155037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3512155037},{"type":"v1","addr":"172.21.15.123:6833","nonce":3512155037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/439561314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":439561314},{"type":"v1","addr":"172.21.15.123:6835","nonce":439561314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2359037201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359037201},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359037201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3040631544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3040631544},{"type":"v1","addr":"172.21.15.118:6839","nonce":3040631544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-13T13:52:17.418144+0000","modified":"2023-07-13T13:52:24.853866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/3588922803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":3588922803},{"type":"v1","addr":"172.21.15.118:6837","nonce":3588922803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-13T13:52:25.732 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1e0406ad30 msgr2=0x7f1e0406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.732 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1e0406ad30 0x7f1e0406d1e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009130 tx=0x7f1e0c008030 comp rx=0 tx=0).stop 2023-07-13T13:52:25.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e1806de20 msgr2=0x7f1e180ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e1806de20 0x7f1e180ca6b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800e8a0 tx=0x7f1e0800ebb0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 shutdown_connections 2023-07-13T13:52:25.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1e0406ad30 0x7f1e0406d1e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1e18156160 0x7f1e180cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e1806de20 0x7f1e180ca6b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.733 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 --2- 172.21.15.118:0/292491808 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1e180c7360 0x7f1e180caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 >> 172.21.15.118:0/292491808 conn(0x7f1e18069f30 msgr2=0x7f1e181e14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:25.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 shutdown_connections 2023-07-13T13:52:25.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.760+0000 7f1e1d7b3700 1 -- 172.21.15.118:0/292491808 wait complete. 2023-07-13T13:52:25.734 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 7 2023-07-13T13:52:25.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:25.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.894+0000 7f3071962700 1 Processor -- start 2023-07-13T13:52:25.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.894+0000 7f3071962700 1 -- start start 2023-07-13T13:52:25.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.895+0000 7f3071962700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c0c89d0 0x7f306c0c6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.895+0000 7f3071962700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c0716a0 con 0x7f306c14f840 2023-07-13T13:52:25.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.895+0000 7f3071962700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c0c7f30 con 0x7f306c071a50 2023-07-13T13:52:25.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.895+0000 7f3071962700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0c8e10 con 0x7f306c0c89d0 2023-07-13T13:52:25.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.896+0000 7f306a7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f306c071a50 0x7f306c15dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:48942/0 (socket says 172.21.15.118:48942) 2023-07-13T13:52:25.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.896+0000 7f306a7fc700 1 -- 172.21.15.118:0/1410012689 learned_addr learned my addr 172.21.15.118:0/1410012689 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:25.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.896+0000 7f306b7fe700 1 --2- 172.21.15.118:0/1410012689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c0c89d0 0x7f306c0c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.899+0000 7f306b7fe700 1 -- 172.21.15.118:0/1410012689 >> v1:172.21.15.123:6789/0 conn(0x7f306c071a50 legacy=0x7f306c15dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.899+0000 7f306b7fe700 1 -- 172.21.15.118:0/1410012689 >> v1:172.21.15.118:6789/0 conn(0x7f306c14f840 legacy=0x7f306c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:25.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.899+0000 7f306b7fe700 1 -- 172.21.15.118:0/1410012689 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c156130 con 0x7f306c0c89d0 2023-07-13T13:52:25.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.901+0000 7f306b7fe700 1 --2- 172.21.15.118:0/1410012689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c0c89d0 0x7f306c0c6690 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3064009dc0 tx=0x7f306400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=529ccde31eb007f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3069ffb700 1 -- 172.21.15.118:0/1410012689 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400bd90 con 0x7f306c0c89d0 2023-07-13T13:52:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3069ffb700 1 -- 172.21.15.118:0/1410012689 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3064003a20 con 0x7f306c0c89d0 2023-07-13T13:52:25.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3069ffb700 1 -- 172.21.15.118:0/1410012689 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064003dd0 con 0x7f306c0c89d0 2023-07-13T13:52:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3071962700 1 -- 172.21.15.118:0/1410012689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c0c89d0 msgr2=0x7f306c0c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3071962700 1 --2- 172.21.15.118:0/1410012689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c0c89d0 0x7f306c0c6690 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3064009dc0 tx=0x7f306400b330 comp rx=0 tx=0).stop 2023-07-13T13:52:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3071962700 1 -- 172.21.15.118:0/1410012689 shutdown_connections 2023-07-13T13:52:25.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3071962700 1 --2- 172.21.15.118:0/1410012689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c0c89d0 0x7f306c0c6690 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3071962700 1 -- 172.21.15.118:0/1410012689 >> 172.21.15.118:0/1410012689 conn(0x7f306c06cf10 msgr2=0x7f306c06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:25.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.905+0000 7f3071962700 1 -- 172.21.15.118:0/1410012689 shutdown_connections 2023-07-13T13:52:25.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.906+0000 7f3071962700 1 -- 172.21.15.118:0/1410012689 wait complete. 2023-07-13T13:52:25.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.907+0000 7f3071962700 1 Processor -- start 2023-07-13T13:52:25.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.907+0000 7f3071962700 1 -- start start 2023-07-13T13:52:25.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.907+0000 7f3071962700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f306c071a50 0x7f306c14b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.907+0000 7f3071962700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f306c0c89d0 0x7f306c1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.908+0000 7f3071962700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c14f840 0x7f306c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:25.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.908+0000 7f3071962700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c150260 con 0x7f306c071a50 2023-07-13T13:52:25.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.908+0000 7f3071962700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c14b5c0 con 0x7f306c0c89d0 2023-07-13T13:52:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.908+0000 7f3071962700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c149ef0 con 0x7f306c14f840 2023-07-13T13:52:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.908+0000 7f306b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c14f840 0x7f306c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.908+0000 7f306a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f306c0c89d0 0x7f306c1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.909+0000 7f306a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f306c0c89d0 0x7f306c1499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:44784/0 (socket says 172.21.15.118:44784) 2023-07-13T13:52:25.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.909+0000 7f306b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c14f840 0x7f306c06b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47412/0 (socket says 172.21.15.118:47412) 2023-07-13T13:52:25.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.909+0000 7f306a7fc700 1 -- 172.21.15.118:0/3944606100 learned_addr learned my addr 172.21.15.118:0/3944606100 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:25.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.914+0000 7f306a7fc700 1 -- 172.21.15.118:0/3944606100 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c14f840 msgr2=0x7f306c06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.914+0000 7f306a7fc700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c14f840 0x7f306c06b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.914+0000 7f306a7fc700 1 -- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f306c071a50 msgr2=0x7f306c14b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:25.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.914+0000 7f306a7fc700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f306c071a50 0x7f306c14b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:25.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.914+0000 7f306a7fc700 1 -- 172.21.15.118:0/3944606100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064009a70 con 0x7f306c0c89d0 2023-07-13T13:52:25.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.917+0000 7f306a7fc700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f306c0c89d0 0x7f306c1499b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f306000c520 tx=0x7f306000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:25.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.921+0000 7f3053fff700 1 -- 172.21.15.118:0/3944606100 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060005d70 con 0x7f306c0c89d0 2023-07-13T13:52:25.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.921+0000 7f3053fff700 1 -- 172.21.15.118:0/3944606100 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30600070d0 con 0x7f306c0c89d0 2023-07-13T13:52:25.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.921+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c14b000 con 0x7f306c0c89d0 2023-07-13T13:52:25.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.921+0000 7f3053fff700 1 -- 172.21.15.118:0/3944606100 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060007440 con 0x7f306c0c89d0 2023-07-13T13:52:25.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.921+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c1ee470 con 0x7f306c0c89d0 2023-07-13T13:52:25.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:25.922+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c1ee2d0 con 0x7f306c0c89d0 2023-07-13T13:52:26.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.060+0000 7f3053fff700 1 -- 172.21.15.118:0/3944606100 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30600075a0 con 0x7f306c0c89d0 2023-07-13T13:52:26.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.061+0000 7f3053fff700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f305806ad10 0x7f305806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:26.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.061+0000 7f306affd700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f305806ad10 0x7f305806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:26.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.061+0000 7f306affd700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f305806ad10 0x7f305806d1c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f305c0096d0 tx=0x7f305c006c30 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:26.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.066+0000 7f3053fff700 1 -- 172.21.15.118:0/3944606100 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f306005b850 con 0x7f306c0c89d0 2023-07-13T13:52:26.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.257+0000 7f3053fff700 1 -- 172.21.15.118:0/3944606100 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3060053c80 con 0x7f306c0c89d0 2023-07-13T13:52:26.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.452+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f306c1ee2d0 con 0x7f306c0c89d0 2023-07-13T13:52:26.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.511+0000 7f3053fff700 1 -- 172.21.15.118:0/3944606100 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f306c1ee2d0 con 0x7f306c0c89d0 2023-07-13T13:52:26.484 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:26.484 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:26.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f305806ad10 msgr2=0x7f305806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:26.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f305806ad10 0x7f305806d1c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f305c0096d0 tx=0x7f305c006c30 comp rx=0 tx=0).stop 2023-07-13T13:52:26.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f306c0c89d0 msgr2=0x7f306c1499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:26.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f306c0c89d0 0x7f306c1499b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f306000c520 tx=0x7f306000c830 comp rx=0 tx=0).stop 2023-07-13T13:52:26.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 shutdown_connections 2023-07-13T13:52:26.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f305806ad10 0x7f305806d1c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f306c14f840 0x7f306c06b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f306c071a50 0x7f306c14b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 --2- 172.21.15.118:0/3944606100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f306c0c89d0 0x7f306c1499b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 >> 172.21.15.118:0/3944606100 conn(0x7f306c06cf10 msgr2=0x7f306c0c9350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:26.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 shutdown_connections 2023-07-13T13:52:26.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.513+0000 7f3071962700 1 -- 172.21.15.118:0/3944606100 wait complete. 2023-07-13T13:52:26.498 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:26.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.647+0000 7f109974a700 1 Processor -- start 2023-07-13T13:52:26.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.647+0000 7f109974a700 1 -- start start 2023-07-13T13:52:26.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.647+0000 7f109974a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f109406dc90 0x7f1094159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:26.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.648+0000 7f109974a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f109406e9f0 0x7f1094158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:26.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.648+0000 7f109974a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10940cc820 con 0x7f10940c74e0 2023-07-13T13:52:26.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.648+0000 7f109974a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10940ccb00 con 0x7f109406dc90 2023-07-13T13:52:26.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.648+0000 7f109974a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10940ccde0 con 0x7f109406e9f0 2023-07-13T13:52:26.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.648+0000 7f1092ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f109406dc90 0x7f1094159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:26.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.648+0000 7f10937fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f109406e9f0 0x7f1094158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:26.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.649+0000 7f10937fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f109406e9f0 0x7f1094158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47422/0 (socket says 172.21.15.118:47422) 2023-07-13T13:52:26.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.649+0000 7f10937fe700 1 -- 172.21.15.118:0/1284387995 learned_addr learned my addr 172.21.15.118:0/1284387995 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:26.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.652+0000 7f10937fe700 1 -- 172.21.15.118:0/1284387995 >> v2:172.21.15.123:3300/0 conn(0x7f109406dc90 msgr2=0x7f1094159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:26.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.652+0000 7f10937fe700 1 --2- 172.21.15.118:0/1284387995 >> v2:172.21.15.123:3300/0 conn(0x7f109406dc90 0x7f1094159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.652+0000 7f10937fe700 1 -- 172.21.15.118:0/1284387995 >> v1:172.21.15.123:6789/0 conn(0x7f10940c74e0 legacy=0x7f109415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:26.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.652+0000 7f10937fe700 1 -- 172.21.15.118:0/1284387995 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094158760 con 0x7f109406e9f0 2023-07-13T13:52:26.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.654+0000 7f10937fe700 1 --2- 172.21.15.118:0/1284387995 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f109406e9f0 0x7f1094158f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f108c009e50 tx=0x7f108c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80e95684aaec5c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.658+0000 7f1091ffb700 1 -- 172.21.15.118:0/1284387995 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00e070 con 0x7f109406e9f0 2023-07-13T13:52:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.658+0000 7f1091ffb700 1 -- 172.21.15.118:0/1284387995 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c00b9c0 con 0x7f109406e9f0 2023-07-13T13:52:26.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.658+0000 7f1091ffb700 1 -- 172.21.15.118:0/1284387995 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00bd70 con 0x7f109406e9f0 2023-07-13T13:52:26.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.659+0000 7f109974a700 1 -- 172.21.15.118:0/1284387995 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f109406e9f0 msgr2=0x7f1094158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:26.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.659+0000 7f109974a700 1 --2- 172.21.15.118:0/1284387995 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f109406e9f0 0x7f1094158f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f108c009e50 tx=0x7f108c00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:26.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.659+0000 7f109974a700 1 -- 172.21.15.118:0/1284387995 shutdown_connections 2023-07-13T13:52:26.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.659+0000 7f109974a700 1 --2- 172.21.15.118:0/1284387995 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f109406e9f0 0x7f1094158f60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.659+0000 7f109974a700 1 --2- 172.21.15.118:0/1284387995 >> v2:172.21.15.123:3300/0 conn(0x7f109406dc90 0x7f1094159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.659+0000 7f109974a700 1 -- 172.21.15.118:0/1284387995 >> 172.21.15.118:0/1284387995 conn(0x7f109406f9a0 msgr2=0x7f109406fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:26.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.659+0000 7f109974a700 1 -- 172.21.15.118:0/1284387995 shutdown_connections 2023-07-13T13:52:26.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.659+0000 7f109974a700 1 -- 172.21.15.118:0/1284387995 wait complete. 2023-07-13T13:52:26.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.660+0000 7f109974a700 1 Processor -- start 2023-07-13T13:52:26.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.660+0000 7f109974a700 1 -- start start 2023-07-13T13:52:26.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.661+0000 7f109974a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109406dc90 0x7f10941eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:26.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.661+0000 7f109974a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109406e9f0 0x7f1094151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:26.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.661+0000 7f109974a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10940c74e0 0x7f10940c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:26.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.661+0000 7f109974a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109415b170 con 0x7f109406e9f0 2023-07-13T13:52:26.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.661+0000 7f109974a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940c1960 con 0x7f109406dc90 2023-07-13T13:52:26.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.661+0000 7f109974a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1094156780 con 0x7f10940c74e0 2023-07-13T13:52:26.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.662+0000 7f1092ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109406dc90 0x7f10941eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:26.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.662+0000 7f10937fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10940c74e0 0x7f10940c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:26.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.662+0000 7f10927fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109406e9f0 0x7f1094151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:26.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.662+0000 7f1092ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109406dc90 0x7f10941eeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:44796/0 (socket says 172.21.15.118:44796) 2023-07-13T13:52:26.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.662+0000 7f1092ffd700 1 -- 172.21.15.118:0/588833759 learned_addr learned my addr 172.21.15.118:0/588833759 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:26.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.667+0000 7f10927fc700 1 -- 172.21.15.118:0/588833759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10940c74e0 msgr2=0x7f10940c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:26.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.667+0000 7f10927fc700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10940c74e0 0x7f10940c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.667+0000 7f10927fc700 1 -- 172.21.15.118:0/588833759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109406dc90 msgr2=0x7f10941eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:26.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.667+0000 7f10927fc700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109406dc90 0x7f10941eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:26.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.667+0000 7f10927fc700 1 -- 172.21.15.118:0/588833759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c009b30 con 0x7f109406e9f0 2023-07-13T13:52:26.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.670+0000 7f10927fc700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109406e9f0 0x7f1094151910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f108800c400 tx=0x7f108800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:26.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.674+0000 7f107b7fe700 1 -- 172.21.15.118:0/588833759 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880052d0 con 0x7f109406e9f0 2023-07-13T13:52:26.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.674+0000 7f107b7fe700 1 -- 172.21.15.118:0/588833759 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088005430 con 0x7f109406e9f0 2023-07-13T13:52:26.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.674+0000 7f107b7fe700 1 -- 172.21.15.118:0/588833759 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880038a0 con 0x7f109406e9f0 2023-07-13T13:52:26.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.674+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10941f24c0 con 0x7f109406e9f0 2023-07-13T13:52:26.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.674+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10941ee2c0 con 0x7f109406e9f0 2023-07-13T13:52:26.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.675+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10940b2300 con 0x7f109406e9f0 2023-07-13T13:52:26.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.694+0000 7f107b7fe700 1 -- 172.21.15.118:0/588833759 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1088003a00 con 0x7f109406e9f0 2023-07-13T13:52:26.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.694+0000 7f107b7fe700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f108006ad30 0x7f108006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:26.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.695+0000 7f1092ffd700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f108006ad30 0x7f108006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:26.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.695+0000 7f1092ffd700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f108006ad30 0x7f108006d1e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1084007af0 tx=0x7f1084008040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:26.813 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.841+0000 7f107b7fe700 1 -- 172.21.15.118:0/588833759 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f108805b8f0 con 0x7f109406e9f0 2023-07-13T13:52:26.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:26.955+0000 7f107b7fe700 1 -- 172.21.15.118:0/588833759 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1088053c70 con 0x7f109406e9f0 2023-07-13T13:52:27.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.151+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10940c70b0 con 0x7f109406e9f0 2023-07-13T13:52:27.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.212+0000 7f107b7fe700 1 -- 172.21.15.118:0/588833759 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f1088017020 con 0x7f109406e9f0 2023-07-13T13:52:27.185 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:27.185 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:27.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f108006ad30 msgr2=0x7f108006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f108006ad30 0x7f108006d1e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1084007af0 tx=0x7f1084008040 comp rx=0 tx=0).stop 2023-07-13T13:52:27.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109406e9f0 msgr2=0x7f1094151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109406e9f0 0x7f1094151910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f108800c400 tx=0x7f108800c710 comp rx=0 tx=0).stop 2023-07-13T13:52:27.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 shutdown_connections 2023-07-13T13:52:27.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f108006ad30 0x7f108006d1e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109406dc90 0x7f10941eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f10940c74e0 0x7f10940c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 --2- 172.21.15.118:0/588833759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f109406e9f0 0x7f1094151910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 >> 172.21.15.118:0/588833759 conn(0x7f109406f9a0 msgr2=0x7f1094150820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:27.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 shutdown_connections 2023-07-13T13:52:27.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.214+0000 7f109974a700 1 -- 172.21.15.118:0/588833759 wait complete. 2023-07-13T13:52:27.214 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T13:52:27.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.369+0000 7f02e4f44700 1 Processor -- start 2023-07-13T13:52:27.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.369+0000 7f02e4f44700 1 -- start start 2023-07-13T13:52:27.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.369+0000 7f02e4f44700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02e014f840 0x7f02e00c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:27.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.370+0000 7f02e4f44700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00716a0 con 0x7f02e00c6690 2023-07-13T13:52:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.370+0000 7f02e4f44700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00c7f30 con 0x7f02e0071a50 2023-07-13T13:52:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.370+0000 7f02e4f44700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e00c6a80 con 0x7f02e014f840 2023-07-13T13:52:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.370+0000 7f02ddd9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f02e0071a50 0x7f02e00cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:48964/0 (socket says 172.21.15.118:48964) 2023-07-13T13:52:27.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.370+0000 7f02ddd9b700 1 -- 172.21.15.118:0/2768180467 learned_addr learned my addr 172.21.15.118:0/2768180467 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:27.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.408+0000 7f02de59c700 1 --2- 172.21.15.118:0/2768180467 >> v2:172.21.15.118:3300/0 conn(0x7f02e014f840 0x7f02e00c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:27.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.413+0000 7f02de59c700 1 -- 172.21.15.118:0/2768180467 >> v1:172.21.15.123:6789/0 conn(0x7f02e0071a50 legacy=0x7f02e00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.413+0000 7f02de59c700 1 -- 172.21.15.118:0/2768180467 >> v1:172.21.15.118:6789/0 conn(0x7f02e00c6690 legacy=0x7f02e015fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.413+0000 7f02de59c700 1 -- 172.21.15.118:0/2768180467 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0156130 con 0x7f02e014f840 2023-07-13T13:52:27.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.424+0000 7f02de59c700 1 --2- 172.21.15.118:0/2768180467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e014f840 0x7f02e00c89d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009840 tx=0x7f02d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98fda588053d6bc server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:27.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.428+0000 7f02dd59a700 1 -- 172.21.15.118:0/2768180467 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d000f8a0 con 0x7f02e014f840 2023-07-13T13:52:27.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.428+0000 7f02dd59a700 1 -- 172.21.15.118:0/2768180467 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d000fa00 con 0x7f02e014f840 2023-07-13T13:52:27.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.428+0000 7f02dd59a700 1 -- 172.21.15.118:0/2768180467 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d000fd90 con 0x7f02e014f840 2023-07-13T13:52:27.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.429+0000 7f02e4f44700 1 -- 172.21.15.118:0/2768180467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e014f840 msgr2=0x7f02e00c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.429+0000 7f02e4f44700 1 --2- 172.21.15.118:0/2768180467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e014f840 0x7f02e00c89d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009840 tx=0x7f02d0009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.429+0000 7f02e4f44700 1 -- 172.21.15.118:0/2768180467 shutdown_connections 2023-07-13T13:52:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.429+0000 7f02e4f44700 1 --2- 172.21.15.118:0/2768180467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e014f840 0x7f02e00c89d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.429+0000 7f02e4f44700 1 -- 172.21.15.118:0/2768180467 >> 172.21.15.118:0/2768180467 conn(0x7f02e006cf10 msgr2=0x7f02e006d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.429+0000 7f02e4f44700 1 -- 172.21.15.118:0/2768180467 shutdown_connections 2023-07-13T13:52:27.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.429+0000 7f02e4f44700 1 -- 172.21.15.118:0/2768180467 wait complete. 2023-07-13T13:52:27.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.431+0000 7f02e4f44700 1 Processor -- start 2023-07-13T13:52:27.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.431+0000 7f02e4f44700 1 -- start start 2023-07-13T13:52:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.431+0000 7f02e4f44700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02e0071a50 0x7f02e0154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.431+0000 7f02e4f44700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e00c6690 0x7f02e0151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.431+0000 7f02e4f44700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e014f840 0x7f02e0152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.431+0000 7f02e4f44700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0159790 con 0x7f02e00c6690 2023-07-13T13:52:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.431+0000 7f02e4f44700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e01574c0 con 0x7f02e014f840 2023-07-13T13:52:27.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.431+0000 7f02e4f44700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0158b80 con 0x7f02e0071a50 2023-07-13T13:52:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.432+0000 7f02ddd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e00c6690 0x7f02e0151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.432+0000 7f02ddd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e00c6690 0x7f02e0151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43016/0 (socket says 172.21.15.118:43016) 2023-07-13T13:52:27.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.432+0000 7f02ddd9b700 1 -- 172.21.15.118:0/2850683001 learned_addr learned my addr 172.21.15.118:0/2850683001 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:27.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.436+0000 7f02ddd9b700 1 -- 172.21.15.118:0/2850683001 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02e0071a50 msgr2=0x7f02e0154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.436+0000 7f02ddd9b700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02e0071a50 0x7f02e0154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.436+0000 7f02ddd9b700 1 -- 172.21.15.118:0/2850683001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e014f840 msgr2=0x7f02e0152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.436+0000 7f02ddd9b700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e014f840 0x7f02e0152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.436+0000 7f02ddd9b700 1 -- 172.21.15.118:0/2850683001 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d00094a0 con 0x7f02e00c6690 2023-07-13T13:52:27.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.439+0000 7f02ddd9b700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e00c6690 0x7f02e0151ec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02d400c520 tx=0x7f02d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.442+0000 7f02ceffd700 1 -- 172.21.15.118:0/2850683001 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4005d70 con 0x7f02e00c6690 2023-07-13T13:52:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.443+0000 7f02ceffd700 1 -- 172.21.15.118:0/2850683001 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d40070d0 con 0x7f02e00c6690 2023-07-13T13:52:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.443+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e0158e60 con 0x7f02e00c6690 2023-07-13T13:52:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.443+0000 7f02ceffd700 1 -- 172.21.15.118:0/2850683001 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4007440 con 0x7f02e00c6690 2023-07-13T13:52:27.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.443+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e0159420 con 0x7f02e00c6690 2023-07-13T13:52:27.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.443+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e01595e0 con 0x7f02e00c6690 2023-07-13T13:52:27.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.480+0000 7f02ceffd700 1 -- 172.21.15.118:0/2850683001 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02d40075a0 con 0x7f02e00c6690 2023-07-13T13:52:27.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.480+0000 7f02ceffd700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f02c006adb0 0x7f02c006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:27.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.480+0000 7f02ceffd700 1 -- 172.21.15.118:0/2850683001 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f02d40890d0 con 0x7f02e00c6690 2023-07-13T13:52:27.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.480+0000 7f02de59c700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f02c006adb0 0x7f02c006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:27.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.481+0000 7f02de59c700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f02c006adb0 0x7f02c006d260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009b90 tx=0x7f02d0012000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:27.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.711+0000 7f02ceffd700 1 -- 172.21.15.118:0/2850683001 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02d4053f20 con 0x7f02e00c6690 2023-07-13T13:52:27.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.939+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02e00743c0 con 0x7f02e00c6690 2023-07-13T13:52:27.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.956+0000 7f02ceffd700 1 -- 172.21.15.118:0/2850683001 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6194 (secure 0 0 0) 0x7f02d4057540 con 0x7f02e00c6690 2023-07-13T13:52:27.929 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:27.929 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1760692596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1760692596},{"type":"v1","addr":"172.21.15.118:6835","nonce":1760692596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3512155037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3512155037},{"type":"v1","addr":"172.21.15.123:6833","nonce":3512155037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/439561314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":439561314},{"type":"v1","addr":"172.21.15.123:6835","nonce":439561314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2359037201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359037201},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359037201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3040631544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3040631544},{"type":"v1","addr":"172.21.15.118:6839","nonce":3040631544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-13T13:52:17.418144+0000","modified":"2023-07-13T13:52:24.853866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/3588922803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":3588922803},{"type":"v1","addr":"172.21.15.118:6837","nonce":3588922803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-13T13:52:27.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f02c006adb0 msgr2=0x7f02c006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f02c006adb0 0x7f02c006d260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009b90 tx=0x7f02d0012000 comp rx=0 tx=0).stop 2023-07-13T13:52:27.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e00c6690 msgr2=0x7f02e0151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:27.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e00c6690 0x7f02e0151ec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f02d400c520 tx=0x7f02d400c8e0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 shutdown_connections 2023-07-13T13:52:27.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f02c006adb0 0x7f02c006d260 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e014f840 0x7f02e0152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02e0071a50 0x7f02e0154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 --2- 172.21.15.118:0/2850683001 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e00c6690 0x7f02e0151ec0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:27.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 >> 172.21.15.118:0/2850683001 conn(0x7f02e006cf10 msgr2=0x7f02e00c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:27.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 shutdown_connections 2023-07-13T13:52:27.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:27.958+0000 7f02e4f44700 1 -- 172.21.15.118:0/2850683001 wait complete. 2023-07-13T13:52:27.932 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 7 2023-07-13T13:52:28.545 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-13T13:52:17.418144+0000', 'modified': '2023-07-13T13:52:24.853866+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4321': {'gid': 4321, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.118:6837/3588922803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 3588922803}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 3588922803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-13T13:52:28.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-13T13:52:28.546 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-07-13T13:52:28.668 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.695+0000 7feaeecaf700 1 Processor -- start 2023-07-13T13:52:28.668 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.695+0000 7feaeecaf700 1 -- start start 2023-07-13T13:52:28.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.696+0000 7feaeecaf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feae8152850 0x7feae806f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.696+0000 7feaeecaf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feae80c5d90 0x7feae81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.696+0000 7feaeecaf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae80c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.696+0000 7feaeecaf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80c6c60 con 0x7feae80c5d90 2023-07-13T13:52:28.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.696+0000 7feaeecaf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80c66a0 con 0x7feae8152850 2023-07-13T13:52:28.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.696+0000 7feaeecaf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c6980 con 0x7feae806eaa0 2023-07-13T13:52:28.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.697+0000 7feaed24c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae80c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.697+0000 7feaeca4b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feae8152850 0x7feae806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.697+0000 7feaed24c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae80c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47456/0 (socket says 172.21.15.118:47456) 2023-07-13T13:52:28.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.697+0000 7feaed24c700 1 -- 172.21.15.118:0/1697373535 learned_addr learned my addr 172.21.15.118:0/1697373535 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:28.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.697+0000 7feae7fff700 1 --2- 172.21.15.118:0/1697373535 >> v2:172.21.15.118:3300/0 conn(0x7feae80c5d90 0x7feae81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.700+0000 7feaed24c700 1 -- 172.21.15.118:0/1697373535 >> v2:172.21.15.123:3300/0 conn(0x7feae8152850 msgr2=0x7feae806f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:28.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.700+0000 7feaed24c700 1 --2- 172.21.15.118:0/1697373535 >> v2:172.21.15.123:3300/0 conn(0x7feae8152850 0x7feae806f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.700+0000 7feaed24c700 1 -- 172.21.15.118:0/1697373535 >> v2:172.21.15.118:3300/0 conn(0x7feae80c5d90 msgr2=0x7feae81590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:28.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.700+0000 7feaed24c700 1 --2- 172.21.15.118:0/1697373535 >> v2:172.21.15.118:3300/0 conn(0x7feae80c5d90 0x7feae81590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.700+0000 7feaed24c700 1 -- 172.21.15.118:0/1697373535 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae806e2a0 con 0x7feae806eaa0 2023-07-13T13:52:28.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.702+0000 7feaed24c700 1 --2- 172.21.15.118:0/1697373535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae80c7d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feae80c8f50 tx=0x7feae000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c0b0abac1b8233 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:28.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.706+0000 7feae77fe700 1 -- 172.21.15.118:0/1697373535 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000e070 con 0x7feae806eaa0 2023-07-13T13:52:28.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.706+0000 7feae77fe700 1 -- 172.21.15.118:0/1697373535 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000b910 con 0x7feae806eaa0 2023-07-13T13:52:28.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.706+0000 7feae77fe700 1 -- 172.21.15.118:0/1697373535 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000bcc0 con 0x7feae806eaa0 2023-07-13T13:52:28.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 -- 172.21.15.118:0/1697373535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 msgr2=0x7feae80c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:28.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 --2- 172.21.15.118:0/1697373535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae80c7d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feae80c8f50 tx=0x7feae000b330 comp rx=0 tx=0).stop 2023-07-13T13:52:28.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 -- 172.21.15.118:0/1697373535 shutdown_connections 2023-07-13T13:52:28.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 --2- 172.21.15.118:0/1697373535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae80c7d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 --2- 172.21.15.118:0/1697373535 >> v2:172.21.15.123:3300/0 conn(0x7feae8152850 0x7feae806f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 --2- 172.21.15.118:0/1697373535 >> v2:172.21.15.118:3300/0 conn(0x7feae80c5d90 0x7feae81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 -- 172.21.15.118:0/1697373535 >> 172.21.15.118:0/1697373535 conn(0x7feae8070d40 msgr2=0x7feae8071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:28.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 -- 172.21.15.118:0/1697373535 shutdown_connections 2023-07-13T13:52:28.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.707+0000 7feaeecaf700 1 -- 172.21.15.118:0/1697373535 wait complete. 2023-07-13T13:52:28.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.708+0000 7feaeecaf700 1 Processor -- start 2023-07-13T13:52:28.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.708+0000 7feaeecaf700 1 -- start start 2023-07-13T13:52:28.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.709+0000 7feaeecaf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae81f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.709+0000 7feaeecaf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae80c5d90 0x7feae80c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.709+0000 7feaeecaf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feae8152850 0x7feae81e2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.709+0000 7feaeecaf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae815c460 con 0x7feae8152850 2023-07-13T13:52:28.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.709+0000 7feaeecaf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8154e40 con 0x7feae80c5d90 2023-07-13T13:52:28.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.709+0000 7feaeecaf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8155120 con 0x7feae806eaa0 2023-07-13T13:52:28.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.710+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae81f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.710+0000 7feae7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae80c5d90 0x7feae80c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.710+0000 7feaed24c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feae8152850 0x7feae81e2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.710+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae81f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47468/0 (socket says 172.21.15.118:47468) 2023-07-13T13:52:28.684 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.710+0000 7feaeca4b700 1 -- 172.21.15.118:0/618017585 learned_addr learned my addr 172.21.15.118:0/618017585 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:28.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.714+0000 7feaeca4b700 1 -- 172.21.15.118:0/618017585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae80c5d90 msgr2=0x7feae80c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:28.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.714+0000 7feaeca4b700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae80c5d90 0x7feae80c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.714+0000 7feaeca4b700 1 -- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feae8152850 msgr2=0x7feae81e2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:28.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.714+0000 7feaeca4b700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feae8152850 0x7feae81e2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.714+0000 7feaeca4b700 1 -- 172.21.15.118:0/618017585 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0009b30 con 0x7feae806eaa0 2023-07-13T13:52:28.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.714+0000 7feae7fff700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae80c5d90 0x7feae80c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:28.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.716+0000 7feaeca4b700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae81f1b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feadc00e870 tx=0x7feadc00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:28.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.720+0000 7feae57fa700 1 -- 172.21.15.118:0/618017585 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc009590 con 0x7feae806eaa0 2023-07-13T13:52:28.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.720+0000 7feae57fa700 1 -- 172.21.15.118:0/618017585 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc013680 con 0x7feae806eaa0 2023-07-13T13:52:28.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.720+0000 7feaeecaf700 1 -- 172.21.15.118:0/618017585 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae81f2040 con 0x7feae806eaa0 2023-07-13T13:52:28.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.720+0000 7feae57fa700 1 -- 172.21.15.118:0/618017585 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0139f0 con 0x7feae806eaa0 2023-07-13T13:52:28.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.720+0000 7feaeecaf700 1 -- 172.21.15.118:0/618017585 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae8154510 con 0x7feae806eaa0 2023-07-13T13:52:28.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.724+0000 7feafae4ab80 1 Processor -- start 2023-07-13T13:52:28.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.724+0000 7feafae4ab80 1 -- start start 2023-07-13T13:52:28.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.724+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3cce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.724+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.724+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3cfd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.724+0000 7feafae4ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa3c48ea0 con 0x55baa3cd48a0 2023-07-13T13:52:28.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.724+0000 7feafae4ab80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa3bbc600 con 0x55baa3cceb70 2023-07-13T13:52:28.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.724+0000 7feafae4ab80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55baa3c2b910 con 0x55baa3cd44d0 2023-07-13T13:52:28.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.725+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.725+0000 7feae7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3cfd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.725+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:44832/0 (socket says 172.21.15.118:44832) 2023-07-13T13:52:28.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.725+0000 7feaeca4b700 1 -- 172.21.15.118:0/1623452075 learned_addr learned my addr 172.21.15.118:0/1623452075 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:28.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.728+0000 7feaeca4b700 1 -- 172.21.15.118:0/1623452075 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 msgr2=0x55baa3cce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:28.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.728+0000 7feaeca4b700 1 --2- 172.21.15.118:0/1623452075 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3cce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.728+0000 7feaeca4b700 1 -- 172.21.15.118:0/1623452075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 msgr2=0x55baa3cfd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:28.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.728+0000 7feaeca4b700 1 --2- 172.21.15.118:0/1623452075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3cfd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.728+0000 7feaeca4b700 1 -- 172.21.15.118:0/1623452075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baa3a18790 con 0x55baa3cceb70 2023-07-13T13:52:28.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.729+0000 7feaeca4b700 1 --2- 172.21.15.118:0/1623452075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcc30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feadc016000 tx=0x7feadc013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e098a2cd0b025a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.734+0000 7fead27fc700 1 -- 172.21.15.118:0/1623452075 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc006450 con 0x55baa3cceb70 2023-07-13T13:52:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.734+0000 7fead27fc700 1 -- 172.21.15.118:0/1623452075 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc0065b0 con 0x55baa3cceb70 2023-07-13T13:52:28.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.734+0000 7fead27fc700 1 -- 172.21.15.118:0/1623452075 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc006920 con 0x55baa3cceb70 2023-07-13T13:52:28.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.734+0000 7feafae4ab80 1 -- 172.21.15.118:0/1623452075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 msgr2=0x55baa3cfcc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:28.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.734+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1623452075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcc30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feadc016000 tx=0x7feadc013000 comp rx=0 tx=0).stop 2023-07-13T13:52:28.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 -- 172.21.15.118:0/1623452075 shutdown_connections 2023-07-13T13:52:28.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1623452075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3cfd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1623452075 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3cce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1623452075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcc30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 -- 172.21.15.118:0/1623452075 >> 172.21.15.118:0/1623452075 conn(0x55baa3cc9320 msgr2=0x55baa3cd1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 -- 172.21.15.118:0/1623452075 shutdown_connections 2023-07-13T13:52:28.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 -- 172.21.15.118:0/1623452075 wait complete. 2023-07-13T13:52:28.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 -- start start 2023-07-13T13:52:28.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.735+0000 7feafae4ab80 1 Processor -- start 2023-07-13T13:52:28.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.736+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 0x55baa3d120c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.736+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3cfcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.736+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d10410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.736+0000 7feafae4ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa3c24be0 con 0x55baa3cd44d0 2023-07-13T13:52:28.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.736+0000 7feafae4ab80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa3be25b0 con 0x55baa3cd48a0 2023-07-13T13:52:28.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.736+0000 7feafae4ab80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55baa3bc8910 con 0x55baa3cceb70 2023-07-13T13:52:28.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.736+0000 7feafae4ab80 10 client.0 _ll_register_callbacks cb 0x55baa3be0b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-13T13:52:28.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.737+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3cfcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.737+0000 7feae7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d10410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.737+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3cfcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43076/0 (socket says 172.21.15.118:43076) 2023-07-13T13:52:28.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.737+0000 7feaeca4b700 1 -- 172.21.15.118:0/1904628382 learned_addr learned my addr 172.21.15.118:0/1904628382 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:28.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.740+0000 7feaeca4b700 1 -- 172.21.15.118:0/1904628382 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 msgr2=0x55baa3d120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:28.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.740+0000 7feaeca4b700 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 0x55baa3d120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.740+0000 7feaeca4b700 1 -- 172.21.15.118:0/1904628382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 msgr2=0x55baa3d10410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:28.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.740+0000 7feaeca4b700 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d10410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:28.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.740+0000 7feaeca4b700 1 -- 172.21.15.118:0/1904628382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae8154510 con 0x55baa3cd44d0 2023-07-13T13:52:28.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.743+0000 7feaeca4b700 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3cfcd40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feadc000c00 tx=0x7feadc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4ba8a7632e3153 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:28.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.743+0000 7feac77fe700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-07-13T13:52:28.716 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.744+0000 7feae57fa700 1 -- 172.21.15.118:0/618017585 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feadc01c450 con 0x7feae806eaa0 2023-07-13T13:52:28.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.745+0000 7feae57fa700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feacc06ac80 0x7feacc06d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.745+0000 7feaed24c700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feacc06ac80 0x7feacc06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.745+0000 7feac77fe700 1 -- 172.21.15.118:0/1904628382 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc036070 con 0x55baa3cd44d0 2023-07-13T13:52:28.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.745+0000 7feaed24c700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feacc06ac80 0x7feacc06d130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feae000b370 tx=0x7feae000e000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:28.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.745+0000 7feafae4ab80 1 -- 172.21.15.118:0/1904628382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55baa3cc6930 con 0x55baa3cd44d0 2023-07-13T13:52:28.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.748+0000 7feac77fe700 1 -- 172.21.15.118:0/1904628382 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feadc05fde0 con 0x55baa3cd44d0 2023-07-13T13:52:28.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.749+0000 7feae57fa700 1 -- 172.21.15.118:0/618017585 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feadc064170 con 0x7feae806eaa0 2023-07-13T13:52:28.722 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.750+0000 7feac77fe700 1 -- 172.21.15.118:0/1904628382 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7feadc05bbf0 con 0x55baa3cd44d0 2023-07-13T13:52:28.722 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.750+0000 7feafae4ab80 10 client.4338 fetch_fsmap learned FSMap version 7 2023-07-13T13:52:28.722 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.750+0000 7feafae4ab80 1 -- 172.21.15.118:0/1904628382 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55baa3b050a0 con 0x55baa3cd44d0 2023-07-13T13:52:28.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.758+0000 7feac77fe700 1 -- 172.21.15.118:0/1904628382 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55baa3cc6930 con 0x55baa3cd44d0 2023-07-13T13:52:28.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.758+0000 7feac77fe700 1 -- 172.21.15.118:0/1904628382 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7feadc058570 con 0x55baa3cd44d0 2023-07-13T13:52:28.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.758+0000 7feafae4ab80 10 client.4338 fetch_fsmap finished waiting for FSMap version 7 2023-07-13T13:52:28.731 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.758+0000 7feafae4ab80 10 client.4338 resolve_mds: resolved name 'e' to daemon mds.e 2023-07-13T13:52:28.731 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.758+0000 7feafae4ab80 20 client.4338 populate_metadata read hostname 'smithi118' 2023-07-13T13:52:28.731 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.758+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x55baa3cfc270 0x55baa3d275f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:28.731 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.758+0000 7feafae4ab80 4 client.4338 mds_command: new command op to 4321 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-13T13:52:28.731 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.758+0000 7feafae4ab80 1 -- 172.21.15.118:0/1904628382 --> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55baa3ca30e0 con 0x55baa3cfc270 2023-07-13T13:52:28.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.766+0000 7feae7fff700 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x55baa3cfc270 0x55baa3d275f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:28.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.906+0000 7feae7fff700 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x55baa3cfc270 0x55baa3d275f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a925142cde0d96b3 server_cookie=94abc465df295b87 in_seq=0 out_seq=0 2023-07-13T13:52:28.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:28.907+0000 7feac77fe700 10 client.4338 ms_handle_connect on v2:172.21.15.118:6836/3588922803 2023-07-13T13:52:29.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feac77fe700 1 -- 172.21.15.118:0/1904628382 <== mds.0 v2:172.21.15.118:6836/3588922803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x7fead4004040 con 0x55baa3cfc270 2023-07-13T13:52:29.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feac77fe700 10 client.4338 handle_command_reply: tid=0 2023-07-13T13:52:29.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 client.4338 shutdown 2023-07-13T13:52:29.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 -- 172.21.15.118:0/1904628382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 msgr2=0x55baa3cfcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3cfcd40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feadc000c00 tx=0x7feadc004750 comp rx=0 tx=0).stop 2023-07-13T13:52:29.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 -- 172.21.15.118:0/1904628382 shutdown_connections 2023-07-13T13:52:29.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x55baa3cfc270 0x55baa3d275f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d10410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 0x55baa3d120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feac77fe700 0 client.4338 ms_handle_reset on v2:172.21.15.118:6836/3588922803 2023-07-13T13:52:29.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 --2- 172.21.15.118:0/1904628382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3cfcd40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 -- 172.21.15.118:0/1904628382 >> 172.21.15.118:0/1904628382 conn(0x55baa3cc9320 msgr2=0x55baa3d13500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:29.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 -- 172.21.15.118:0/1904628382 shutdown_connections 2023-07-13T13:52:29.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 1 -- 172.21.15.118:0/1904628382 wait complete. 2023-07-13T13:52:29.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.036+0000 7feafae4ab80 20 client.4338 trim_cache size 0 max 16384 2023-07-13T13:52:29.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.054+0000 7feafae4ab80 1 Processor -- start 2023-07-13T13:52:29.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.054+0000 7feafae4ab80 1 -- start start 2023-07-13T13:52:29.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3d14e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3d15350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feafae4ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa3a19390 con 0x55baa3cd48a0 2023-07-13T13:52:29.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feafae4ab80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa3cb0bf0 con 0x55baa3cceb70 2023-07-13T13:52:29.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feafae4ab80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55baa3cd4e10 con 0x55baa3cd44d0 2023-07-13T13:52:29.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feaed24c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3d15350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feae7fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3d14e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.055+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.056+0000 7feae7fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3d14e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47492/0 (socket says 172.21.15.118:47492) 2023-07-13T13:52:29.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.056+0000 7feae7fff700 1 -- 172.21.15.118:0/4243639984 learned_addr learned my addr 172.21.15.118:0/4243639984 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:29.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.058+0000 7feae7fff700 1 -- 172.21.15.118:0/4243639984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 msgr2=0x55baa3cfcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:29.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.058+0000 7feae7fff700 1 --2- 172.21.15.118:0/4243639984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.058+0000 7feae7fff700 1 -- 172.21.15.118:0/4243639984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 msgr2=0x55baa3d15350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:29.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.058+0000 7feae7fff700 1 --2- 172.21.15.118:0/4243639984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3d15350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.058+0000 7feae7fff700 1 -- 172.21.15.118:0/4243639984 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baa3beab10 con 0x55baa3cd44d0 2023-07-13T13:52:29.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.058+0000 7feaed24c700 1 --2- 172.21.15.118:0/4243639984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3d15350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:29.032 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.060+0000 7feae7fff700 1 --2- 172.21.15.118:0/4243639984 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3d14e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feae80c2bb0 tx=0x7fead40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b258ab85ed69eadd server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:29.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.064+0000 7fead2ffd700 1 -- 172.21.15.118:0/4243639984 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead401a040 con 0x55baa3cd44d0 2023-07-13T13:52:29.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.064+0000 7fead2ffd700 1 -- 172.21.15.118:0/4243639984 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55baa3ca30e0 con 0x55baa3cd44d0 2023-07-13T13:52:29.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.064+0000 7fead2ffd700 1 -- 172.21.15.118:0/4243639984 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4004030 con 0x55baa3cd44d0 2023-07-13T13:52:29.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 -- 172.21.15.118:0/4243639984 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 msgr2=0x55baa3d14e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 --2- 172.21.15.118:0/4243639984 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3d14e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feae80c2bb0 tx=0x7fead40047c0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 -- 172.21.15.118:0/4243639984 shutdown_connections 2023-07-13T13:52:29.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 --2- 172.21.15.118:0/4243639984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cceb70 0x55baa3cfcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 --2- 172.21.15.118:0/4243639984 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd48a0 0x55baa3d15350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 --2- 172.21.15.118:0/4243639984 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cd44d0 0x55baa3d14e10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 -- 172.21.15.118:0/4243639984 >> 172.21.15.118:0/4243639984 conn(0x55baa3cc9320 msgr2=0x55baa3d12b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:29.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 -- 172.21.15.118:0/4243639984 shutdown_connections 2023-07-13T13:52:29.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.065+0000 7feafae4ab80 1 -- 172.21.15.118:0/4243639984 wait complete. 2023-07-13T13:52:29.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.066+0000 7feafae4ab80 1 -- start start 2023-07-13T13:52:29.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.066+0000 7feafae4ab80 1 Processor -- start 2023-07-13T13:52:29.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.066+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 0x55baa3d0c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.066+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3d121f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feafae4ab80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d12730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feafae4ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa3d0cac0 con 0x55baa3cd44d0 2023-07-13T13:52:29.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feafae4ab80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baa3d11f70 con 0x55baa3cd48a0 2023-07-13T13:52:29.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feafae4ab80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55baa3cd24e0 con 0x55baa3cceb70 2023-07-13T13:52:29.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feafae4ab80 10 client.0 _ll_register_callbacks cb 0x55baa3be0b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-13T13:52:29.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 0x55baa3d0c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feaed24c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d12730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feae7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3d121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feaeca4b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 0x55baa3d0c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:47500/0 (socket says 172.21.15.118:47500) 2023-07-13T13:52:29.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.067+0000 7feaeca4b700 1 -- 172.21.15.118:0/2412117381 learned_addr learned my addr 172.21.15.118:0/2412117381 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:29.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.071+0000 7feaed24c700 1 -- 172.21.15.118:0/2412117381 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 msgr2=0x55baa3d0c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:29.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.071+0000 7feaed24c700 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 0x55baa3d0c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.071+0000 7feaed24c700 1 -- 172.21.15.118:0/2412117381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 msgr2=0x55baa3d121f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:29.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.071+0000 7feaed24c700 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3d121f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.071+0000 7feaed24c700 1 -- 172.21.15.118:0/2412117381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae806e2a0 con 0x55baa3cd48a0 2023-07-13T13:52:29.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.073+0000 7feaed24c700 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d12730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feae80c2740 tx=0x7feae0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0265c6d8c66889f server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:29.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.073+0000 7feac77fe700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2023-07-13T13:52:29.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.078+0000 7feac77fe700 1 -- 172.21.15.118:0/2412117381 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae002b630 con 0x55baa3cd48a0 2023-07-13T13:52:29.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.078+0000 7feac77fe700 1 -- 172.21.15.118:0/2412117381 <== mon.1 v2:172.21.15.123:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feae0023070 con 0x55baa3cd48a0 2023-07-13T13:52:29.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.078+0000 7feafae4ab80 1 -- 172.21.15.118:0/2412117381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feadc0065b0 con 0x55baa3cd48a0 2023-07-13T13:52:29.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.080+0000 7feac77fe700 1 -- 172.21.15.118:0/2412117381 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7feae0009860 con 0x55baa3cd48a0 2023-07-13T13:52:29.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.080+0000 7feafae4ab80 10 client.4423 fetch_fsmap learned FSMap version 7 2023-07-13T13:52:29.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.080+0000 7feafae4ab80 1 -- 172.21.15.118:0/2412117381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7fead401f950 con 0x55baa3cd48a0 2023-07-13T13:52:29.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.098+0000 7feac77fe700 1 -- 172.21.15.118:0/2412117381 <== mon.1 v2:172.21.15.123:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc0065b0 con 0x55baa3cd48a0 2023-07-13T13:52:29.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.098+0000 7feac77fe700 1 -- 172.21.15.118:0/2412117381 <== mon.1 v2:172.21.15.123:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7feae002b790 con 0x55baa3cd48a0 2023-07-13T13:52:29.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.098+0000 7feafae4ab80 10 client.4423 fetch_fsmap finished waiting for FSMap version 7 2023-07-13T13:52:29.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.098+0000 7feafae4ab80 10 client.4423 resolve_mds: resolved name 'e' to daemon mds.e 2023-07-13T13:52:29.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.098+0000 7feafae4ab80 20 client.4423 populate_metadata read hostname 'smithi118' 2023-07-13T13:52:29.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.098+0000 7feafae4ab80 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x55baa3d7dea0 0x55baa3d7e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.099+0000 7feafae4ab80 4 client.4423 mds_command: new command op to 4321 tid=0[{"prefix": "status"}] 2023-07-13T13:52:29.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.099+0000 7feafae4ab80 1 -- 172.21.15.118:0/2412117381 --> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55baa3c1dd20 con 0x55baa3d7dea0 2023-07-13T13:52:29.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.099+0000 7feaeca4b700 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x55baa3d7dea0 0x55baa3d7e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.102+0000 7feaeca4b700 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x55baa3d7dea0 0x55baa3d7e270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85bca286afb4231a server_cookie=cdee3fd1718a0ac8 in_seq=0 out_seq=0 2023-07-13T13:52:29.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.102+0000 7feac77fe700 10 client.4423 ms_handle_connect on v2:172.21.15.118:6836/3588922803 2023-07-13T13:52:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.124+0000 7feac77fe700 1 -- 172.21.15.118:0/2412117381 <== mds.0 v2:172.21.15.118:6836/3588922803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55baa3c1dd20 con 0x55baa3d7dea0 2023-07-13T13:52:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.124+0000 7feac77fe700 10 client.4423 handle_command_reply: tid=0 2023-07-13T13:52:29.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.124+0000 7feafae4ab80 1 client.4423 shutdown 2023-07-13T13:52:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 -- 172.21.15.118:0/2412117381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 msgr2=0x55baa3d12730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d12730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feae80c2740 tx=0x7feae0004b40 comp rx=0 tx=0).stop 2023-07-13T13:52:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 -- 172.21.15.118:0/2412117381 shutdown_connections 2023-07-13T13:52:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x55baa3d7dea0 0x55baa3d7e270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55baa3cd48a0 0x55baa3d12730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feac77fe700 0 client.4423 ms_handle_reset on v2:172.21.15.118:6836/3588922803 2023-07-13T13:52:29.098 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55baa3cceb70 0x55baa3d0c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 --2- 172.21.15.118:0/2412117381 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55baa3cd44d0 0x55baa3d121f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 -- 172.21.15.118:0/2412117381 >> 172.21.15.118:0/2412117381 conn(0x55baa3cc9320 msgr2=0x55baa3d1e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 -- 172.21.15.118:0/2412117381 shutdown_connections 2023-07-13T13:52:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 1 -- 172.21.15.118:0/2412117381 wait complete. 2023-07-13T13:52:29.099 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feafae4ab80 20 client.4423 trim_cache size 0 max 16384 2023-07-13T13:52:29.099 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T13:52:29.100 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "1835fe1d-409c-4aad-9a14-d592cbe8c9c2", 2023-07-13T13:52:29.100 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2023-07-13T13:52:29.100 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4321, 2023-07-13T13:52:29.100 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2023-07-13T13:52:29.100 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2023-07-13T13:52:29.100 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2023-07-13T13:52:29.101 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 10.884920242, 2023-07-13T13:52:29.101 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 7, 2023-07-13T13:52:29.101 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 29, 2023-07-13T13:52:29.101 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 29, 2023-07-13T13:52:29.101 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 19.921188571999998 2023-07-13T13:52:29.101 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T13:52:29.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 -- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feacc06ac80 msgr2=0x7feacc06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feacc06ac80 0x7feacc06d130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feae000b370 tx=0x7feae000e000 comp rx=0 tx=0).stop 2023-07-13T13:52:29.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 -- 172.21.15.118:0/618017585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 msgr2=0x7feae81f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae81f1b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feadc00e870 tx=0x7feadc00eb80 comp rx=0 tx=0).stop 2023-07-13T13:52:29.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 -- 172.21.15.118:0/618017585 shutdown_connections 2023-07-13T13:52:29.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feacc06ac80 0x7feacc06d130 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feae8152850 0x7feae81e2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae806eaa0 0x7feae81f1b00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 --2- 172.21.15.118:0/618017585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae80c5d90 0x7feae80c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 -- 172.21.15.118:0/618017585 >> 172.21.15.118:0/618017585 conn(0x7feae8070d40 msgr2=0x7feae806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:29.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 -- 172.21.15.118:0/618017585 shutdown_connections 2023-07-13T13:52:29.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.125+0000 7feaeecaf700 1 -- 172.21.15.118:0/618017585 wait complete. 2023-07-13T13:52:29.109 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-13T13:52:29.110 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-13T13:52:29.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-13T13:52:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.258+0000 7f71b525b700 1 Processor -- start 2023-07-13T13:52:29.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.258+0000 7f71b525b700 1 -- start start 2023-07-13T13:52:29.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.259+0000 7f71b525b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71b00c6f30 0x7f71b00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.259+0000 7f71b525b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c9c20 0x7f71b00c7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.259+0000 7f71b525b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71b006e040 0x7f71b01583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.259+0000 7f71b525b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00c8f50 con 0x7f71b00c6f30 2023-07-13T13:52:29.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.259+0000 7f71b525b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00c7840 con 0x7f71b006e040 2023-07-13T13:52:29.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.259+0000 7f71b525b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c9790 con 0x7f71b00c9c20 2023-07-13T13:52:29.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.260+0000 7f71aed9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71b00c6f30 0x7f71b00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.260+0000 7f71af59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71b006e040 0x7f71b01583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.260+0000 7f71ae59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c9c20 0x7f71b00c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.260+0000 7f71aed9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f71b00c6f30 0x7f71b00cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43104/0 (socket says 172.21.15.118:43104) 2023-07-13T13:52:29.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.260+0000 7f71aed9d700 1 -- 172.21.15.118:0/1127423702 learned_addr learned my addr 172.21.15.118:0/1127423702 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:29.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.262+0000 7f71ae59c700 1 -- 172.21.15.118:0/1127423702 >> v2:172.21.15.123:3300/0 conn(0x7f71b006e040 msgr2=0x7f71b01583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:29.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.262+0000 7f71ae59c700 1 --2- 172.21.15.118:0/1127423702 >> v2:172.21.15.123:3300/0 conn(0x7f71b006e040 0x7f71b01583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.263+0000 7f71ae59c700 1 -- 172.21.15.118:0/1127423702 >> v2:172.21.15.118:3300/0 conn(0x7f71b00c6f30 msgr2=0x7f71b00cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:29.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.263+0000 7f71ae59c700 1 --2- 172.21.15.118:0/1127423702 >> v2:172.21.15.118:3300/0 conn(0x7f71b00c6f30 0x7f71b00cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.263+0000 7f71ae59c700 1 -- 172.21.15.118:0/1127423702 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b006ec80 con 0x7f71b00c9c20 2023-07-13T13:52:29.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.264+0000 7f71ae59c700 1 --2- 172.21.15.118:0/1127423702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c9c20 0x7f71b00c7300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71b00b1a30 tx=0x7f71a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb1ce80f011e222b server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:29.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71add9b700 1 -- 172.21.15.118:0/1127423702 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4011830 con 0x7f71b00c9c20 2023-07-13T13:52:29.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71add9b700 1 -- 172.21.15.118:0/1127423702 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4011990 con 0x7f71b00c9c20 2023-07-13T13:52:29.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71add9b700 1 -- 172.21.15.118:0/1127423702 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4011d20 con 0x7f71b00c9c20 2023-07-13T13:52:29.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71b525b700 1 -- 172.21.15.118:0/1127423702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c9c20 msgr2=0x7f71b00c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71b525b700 1 --2- 172.21.15.118:0/1127423702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c9c20 0x7f71b00c7300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f71b00b1a30 tx=0x7f71a4009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:29.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71b525b700 1 -- 172.21.15.118:0/1127423702 shutdown_connections 2023-07-13T13:52:29.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71b525b700 1 --2- 172.21.15.118:0/1127423702 >> v2:172.21.15.123:3300/0 conn(0x7f71b006e040 0x7f71b01583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71b525b700 1 --2- 172.21.15.118:0/1127423702 >> v2:172.21.15.118:3300/0 conn(0x7f71b00c6f30 0x7f71b00cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71b525b700 1 --2- 172.21.15.118:0/1127423702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c9c20 0x7f71b00c7300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.269+0000 7f71b525b700 1 -- 172.21.15.118:0/1127423702 >> 172.21.15.118:0/1127423702 conn(0x7f71b0069f30 msgr2=0x7f71b006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:29.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.270+0000 7f71b525b700 1 -- 172.21.15.118:0/1127423702 shutdown_connections 2023-07-13T13:52:29.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.270+0000 7f71b525b700 1 -- 172.21.15.118:0/1127423702 wait complete. 2023-07-13T13:52:29.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.271+0000 7f71b525b700 1 Processor -- start 2023-07-13T13:52:29.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.271+0000 7f71b525b700 1 -- start start 2023-07-13T13:52:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.272+0000 7f71b525b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b006e040 0x7f71b00c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.272+0000 7f71b525b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c6f30 0x7f71b00cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.272+0000 7f71b525b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b00c9c20 0x7f71b01583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.272+0000 7f71b525b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0157280 con 0x7f71b00c9c20 2023-07-13T13:52:29.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.272+0000 7f71b525b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0158910 con 0x7f71b006e040 2023-07-13T13:52:29.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.272+0000 7f71b525b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c6830 con 0x7f71b00c6f30 2023-07-13T13:52:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.272+0000 7f71af59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b00c9c20 0x7f71b01583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.273+0000 7f71ae59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c6f30 0x7f71b00cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.273+0000 7f71aed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b006e040 0x7f71b00c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.273+0000 7f71af59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b00c9c20 0x7f71b01583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43120/0 (socket says 172.21.15.118:43120) 2023-07-13T13:52:29.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.273+0000 7f71af59e700 1 -- 172.21.15.118:0/94433243 learned_addr learned my addr 172.21.15.118:0/94433243 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.277+0000 7f71af59e700 1 -- 172.21.15.118:0/94433243 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c6f30 msgr2=0x7f71b00cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.277+0000 7f71af59e700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c6f30 0x7f71b00cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.277+0000 7f71af59e700 1 -- 172.21.15.118:0/94433243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b006e040 msgr2=0x7f71b00c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.277+0000 7f71af59e700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b006e040 0x7f71b00c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.277+0000 7f71af59e700 1 -- 172.21.15.118:0/94433243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a40094a0 con 0x7f71b00c9c20 2023-07-13T13:52:29.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.279+0000 7f71af59e700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b00c9c20 0x7f71b01583d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71a800efc0 tx=0x7f71a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:29.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.283+0000 7f71977fe700 1 -- 172.21.15.118:0/94433243 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8009ea0 con 0x7f71b00c9c20 2023-07-13T13:52:29.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.283+0000 7f71977fe700 1 -- 172.21.15.118:0/94433243 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800f040 con 0x7f71b00c9c20 2023-07-13T13:52:29.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.283+0000 7f71977fe700 1 -- 172.21.15.118:0/94433243 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800ced0 con 0x7f71b00c9c20 2023-07-13T13:52:29.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.283+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b0158110 con 0x7f71b00c9c20 2023-07-13T13:52:29.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.283+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b00c6020 con 0x7f71b00c9c20 2023-07-13T13:52:29.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.284+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b00cbf20 con 0x7f71b00c9c20 2023-07-13T13:52:29.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.492+0000 7f71977fe700 1 -- 172.21.15.118:0/94433243 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71a8014480 con 0x7f71b00c9c20 2023-07-13T13:52:29.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.492+0000 7f71977fe700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f719c06ad30 0x7f719c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:29.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.492+0000 7f71977fe700 1 -- 172.21.15.118:0/94433243 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f71a808a560 con 0x7f71b00c9c20 2023-07-13T13:52:29.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.492+0000 7f71aed9d700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f719c06ad30 0x7f719c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:29.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.492+0000 7f71aed9d700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f719c06ad30 0x7f719c06d1e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71b0151150 tx=0x7f71a00092c0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:29.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.553+0000 7f71977fe700 1 -- 172.21.15.118:0/94433243 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71a8055390 con 0x7f71b00c9c20 2023-07-13T13:52:29.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.806+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f71b0158110 con 0x7f71b00c9c20 2023-07-13T13:52:29.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.817+0000 7f71977fe700 1 -- 172.21.15.118:0/94433243 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f71b0158110 con 0x7f71b00c9c20 2023-07-13T13:52:29.789 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-13T13:52:29.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.818+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f719c06ad30 msgr2=0x7f719c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.818+0000 7f71b525b700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f719c06ad30 0x7f719c06d1e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71b0151150 tx=0x7f71a00092c0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b00c9c20 msgr2=0x7f71b01583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:29.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b00c9c20 0x7f71b01583d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71a800efc0 tx=0x7f71a800c3a0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 shutdown_connections 2023-07-13T13:52:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f719c06ad30 0x7f719c06d1e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71b006e040 0x7f71b00c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f71b00c9c20 0x7f71b01583d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 --2- 172.21.15.118:0/94433243 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f71b00c6f30 0x7f71b00cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 >> 172.21.15.118:0/94433243 conn(0x7f71b0069f30 msgr2=0x7f71b01519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:29.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 shutdown_connections 2023-07-13T13:52:29.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:29.819+0000 7f71b525b700 1 -- 172.21.15.118:0/94433243 wait complete. 2023-07-13T13:52:29.803 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-13T13:52:29.803 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-13T13:52:29.803 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-07-13T13:52:29.804 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-13T13:52:29.804 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-13T13:52:29.804 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-13T13:52:29.804 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-13T13:52:29.805 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-13T13:52:29.805 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-13T13:52:29.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:29.806 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-07-13T13:52:29.824 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-13T13:52:29.825 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-13T13:52:29.825 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-07-13T13:52:29.825 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-07-13T13:52:29.825 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-07-13T13:52:29.825 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-07-13T13:52:29.825 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-13T13:52:29.825 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-07-13T13:52:29.826 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-07-13T13:52:29.826 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-13T13:52:29.826 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-07-13T13:52:29.826 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-07-13T13:52:29.826 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-13T13:52:29.826 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-07-13T13:52:29.826 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-13T13:52:29.827 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-07-13T13:52:29.827 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-13T13:52:29.827 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 38835sec preferred_lft 38835sec 2023-07-13T13:52:29.827 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-07-13T13:52:29.827 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-07-13T13:52:29.828 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-13T13:52:29.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:29.828 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:52:29.829 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:52:29.829 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2023-07-13T13:52:29.829 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2023-07-13T13:52:29.829 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2023-07-13T13:52:29.830 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-13T13:52:29.830 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:52:30.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:30.013 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-13T13:52:30.044 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-07-13T13:52:30.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:30.045 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-07-13T13:52:30.125 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-07-13T13:52:30.125 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-13T13:52:30.125 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-13T13:52:30.125 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-13T13:52:30.125 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-13T13:52:30.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:30.126 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:52:30.126 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:52:30.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-13T13:52:30.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-13T13:52:30.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-13T13:52:30.128 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:52:30.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:30.380 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-07-13T13:52:30.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:30.399 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-07-13T13:52:30.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:30.456 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:52:30.457 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:52:30.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-13T13:52:30.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-13T13:52:30.457 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:52:30.551 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-13T13:52:30.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:30.552 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:52:30.552 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:52:30.553 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-13T13:52:30.553 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-13T13:52:30.553 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-13T13:52:30.553 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-13T13:52:30.554 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-13T13:52:30.554 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:52:30.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:30.748 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:52:30.749 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:52:30.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-07-13T13:52:30.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2023-07-13T13:52:30.749 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:52:30.847 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-13T13:52:30.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-13T13:52:30.848 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-13T13:52:30.865 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-13T13:52:30.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-13T13:52:30.866 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-13T13:52:30.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:52:30.989 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:52:30.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:52:31.057 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:52:31.057 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:52:31.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:31.059 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:52:31.116 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-13T13:52:31.116 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-13T13:52:31.158 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:52:31.185 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:52:31.186 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:52:31.253 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:52:31.254 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:52:31.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:31.256 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:52:31.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:2023-07-13T13:52:31.287+0000 7f5e110d75c0 -1 init, newargv = 0x5651267797c0 newargc=15 2023-07-13T13:52:31.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[152708]: starting ceph client 2023-07-13T13:52:31.512 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[152708]: starting fuse 2023-07-13T13:52:32.377 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:52:32.406 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:52:32.406 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:52:32.472 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:52:32.473 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:52:32.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:32.474 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:52:32.532 INFO:teuthology.orchestra.run.smithi118.stdout:46 2023-07-13T13:52:32.532 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-07-13T13:52:32.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-13T13:52:32.533 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2023-07-13T13:52:32.533 DEBUG:teuthology.orchestra.run.smithi118:> import re 2023-07-13T13:52:32.533 DEBUG:teuthology.orchestra.run.smithi118:> import os 2023-07-13T13:52:32.534 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2023-07-13T13:52:32.534 DEBUG:teuthology.orchestra.run.smithi118:> 2023-07-13T13:52:32.534 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2023-07-13T13:52:32.535 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-13T13:52:32.535 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2023-07-13T13:52:32.535 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-13T13:52:32.535 DEBUG:teuthology.orchestra.run.smithi118:> 2023-07-13T13:52:32.536 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2023-07-13T13:52:32.536 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2023-07-13T13:52:32.536 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2023-07-13T13:52:32.537 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2023-07-13T13:52:32.537 DEBUG:teuthology.orchestra.run.smithi118:> 2023-07-13T13:52:32.537 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2023-07-13T13:52:32.538 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-13T13:52:32.538 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-13T13:52:32.538 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-13T13:52:32.538 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2023-07-13T13:52:32.539 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2023-07-13T13:52:32.539 DEBUG:teuthology.orchestra.run.smithi118:> return f 2023-07-13T13:52:32.539 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-13T13:52:32.539 DEBUG:teuthology.orchestra.run.smithi118:> 2023-07-13T13:52:32.540 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.admin")) 2023-07-13T13:52:32.540 DEBUG:teuthology.orchestra.run.smithi118:> ' 2023-07-13T13:52:32.655 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.admin.152708.asok 2023-07-13T13:52:32.837 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.152708.asok 2023-07-13T13:52:32.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:32.838 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.152708.asok status 2023-07-13T13:52:32.997 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T13:52:32.997 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2023-07-13T13:52:32.997 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "f0b380e693e28c35a89e7c2062b0976b7def7973", 2023-07-13T13:52:32.997 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.0.0-4842-gf0b380e6 (f0b380e693e28c35a89e7c2062b0976b7def7973) reef (dev)", 2023-07-13T13:52:32.997 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "admin", 2023-07-13T13:52:32.998 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2023-07-13T13:52:32.998 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-13T13:52:32.998 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "152708", 2023-07-13T13:52:32.998 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2023-07-13T13:52:32.998 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:52:32.998 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2023-07-13T13:52:32.998 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2023-07-13T13:52:32.999 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4356, 2023-07-13T13:52:32.999 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2023-07-13T13:52:32.999 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2023-07-13T13:52:32.999 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2023-07-13T13:52:32.999 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4356 2023-07-13T13:52:32.999 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:52:32.999 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-07-13T13:52:33.000 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-07-13T13:52:33.000 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2023-07-13T13:52:33.000 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2092635753 2023-07-13T13:52:33.000 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-07-13T13:52:33.000 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:52:33.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-07-13T13:52:33.001 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-07-13T13:52:33.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2023-07-13T13:52:33.001 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 2092635753 2023-07-13T13:52:33.001 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:52:33.001 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4356 192.168.0.1:0/2092635753", 2023-07-13T13:52:33.001 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.1:0/2092635753", 2023-07-13T13:52:33.002 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2023-07-13T13:52:33.002 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 7, 2023-07-13T13:52:33.002 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 29, 2023-07-13T13:52:33.002 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2023-07-13T13:52:33.002 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2023-07-13T13:52:33.002 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2023-07-13T13:52:33.002 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T13:52:33.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:33.007 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2023-07-13T13:52:33.007 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-13T13:52:33.047 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2023-07-13T13:52:33.047 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-13T13:52:33.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:33.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-13T13:52:33.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:33.197 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-13T13:52:33.676 INFO:teuthology.orchestra.run.smithi118.stdout:# file: . 2023-07-13T13:52:33.676 INFO:teuthology.orchestra.run.smithi118.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-13T13:52:33.676 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:33.677 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:52:33.678 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-13T13:52:33.696 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:33.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.886+0000 7f54864cf700 1 Processor -- start 2023-07-13T13:52:33.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.886+0000 7f54864cf700 1 -- start start 2023-07-13T13:52:33.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.887+0000 7f54864cf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5480071d50 0x7f5480070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:33.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.887+0000 7f54864cf700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548015bd70 con 0x7f5480152a90 2023-07-13T13:52:33.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.887+0000 7f54864cf700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548006f680 con 0x7f54800cb840 2023-07-13T13:52:33.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.887+0000 7f54864cf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5480152e60 con 0x7f5480071d50 2023-07-13T13:52:33.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.887+0000 7f547f7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5480071d50 0x7f5480070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:33.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.887+0000 7f5484a6c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f54800cb840 0x7f5480163060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:48414/0 (socket says 172.21.15.118:48414) 2023-07-13T13:52:33.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.887+0000 7f5484a6c700 1 -- 172.21.15.118:0/1940532134 learned_addr learned my addr 172.21.15.118:0/1940532134 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:33.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.890+0000 7f547effd700 1 -- 172.21.15.118:0/1940532134 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977730223 0 0) 0x7f548006f680 con 0x7f54800cb840 2023-07-13T13:52:33.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.890+0000 7f547effd700 1 -- 172.21.15.118:0/1940532134 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54680035b0 con 0x7f54800cb840 2023-07-13T13:52:33.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.893+0000 7f547f7fe700 1 -- 172.21.15.118:0/1940532134 >> v1:172.21.15.123:6789/0 conn(0x7f54800cb840 legacy=0x7f5480163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:33.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.893+0000 7f547f7fe700 1 -- 172.21.15.118:0/1940532134 >> v1:172.21.15.118:6789/0 conn(0x7f5480152a90 legacy=0x7f548015c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:33.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.893+0000 7f547f7fe700 1 -- 172.21.15.118:0/1940532134 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480159580 con 0x7f5480071d50 2023-07-13T13:52:33.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.898+0000 7f547f7fe700 1 --2- 172.21.15.118:0/1940532134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f5480070d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5470009840 tx=0x7f5470009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9876fba4f5534d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:33.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.902+0000 7f547effd700 1 -- 172.21.15.118:0/1940532134 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470011830 con 0x7f5480071d50 2023-07-13T13:52:33.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.902+0000 7f547effd700 1 -- 172.21.15.118:0/1940532134 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470011990 con 0x7f5480071d50 2023-07-13T13:52:33.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.902+0000 7f547effd700 1 -- 172.21.15.118:0/1940532134 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470011d20 con 0x7f5480071d50 2023-07-13T13:52:33.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.903+0000 7f54864cf700 1 -- 172.21.15.118:0/1940532134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 msgr2=0x7f5480070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:33.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.903+0000 7f54864cf700 1 --2- 172.21.15.118:0/1940532134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f5480070d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5470009840 tx=0x7f5470009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:33.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.903+0000 7f54864cf700 1 -- 172.21.15.118:0/1940532134 shutdown_connections 2023-07-13T13:52:33.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.903+0000 7f54864cf700 1 --2- 172.21.15.118:0/1940532134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f5480070d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:33.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.903+0000 7f54864cf700 1 -- 172.21.15.118:0/1940532134 >> 172.21.15.118:0/1940532134 conn(0x7f548006cf10 msgr2=0x7f548006d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:33.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.903+0000 7f54864cf700 1 -- 172.21.15.118:0/1940532134 shutdown_connections 2023-07-13T13:52:33.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.903+0000 7f54864cf700 1 -- 172.21.15.118:0/1940532134 wait complete. 2023-07-13T13:52:33.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.904+0000 7f54864cf700 1 Processor -- start 2023-07-13T13:52:33.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.904+0000 7f54864cf700 1 -- start start 2023-07-13T13:52:33.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.905+0000 7f54864cf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f54801e5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:33.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.905+0000 7f54864cf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54800cb840 0x7f54801f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:33.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.905+0000 7f54864cf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5480152a90 0x7f54801474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:33.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.905+0000 7f54864cf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54801561b0 con 0x7f5480071d50 2023-07-13T13:52:33.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.905+0000 7f54864cf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548015a7c0 con 0x7f5480152a90 2023-07-13T13:52:33.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.905+0000 7f54864cf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548015abd0 con 0x7f54800cb840 2023-07-13T13:52:33.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.906+0000 7f547ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f54801e5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:33.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.906+0000 7f5484a6c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5480152a90 0x7f54801474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:33.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.906+0000 7f547f7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54800cb840 0x7f54801f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:33.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.906+0000 7f547ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f54801e5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40988/0 (socket says 172.21.15.118:40988) 2023-07-13T13:52:33.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.906+0000 7f547ffff700 1 -- 172.21.15.118:0/110913535 learned_addr learned my addr 172.21.15.118:0/110913535 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:33.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.910+0000 7f547ffff700 1 -- 172.21.15.118:0/110913535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54800cb840 msgr2=0x7f54801f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:33.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.910+0000 7f547ffff700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54800cb840 0x7f54801f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:33.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.910+0000 7f547ffff700 1 -- 172.21.15.118:0/110913535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5480152a90 msgr2=0x7f54801474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:33.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.910+0000 7f547ffff700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5480152a90 0x7f54801474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:33.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.910+0000 7f547ffff700 1 -- 172.21.15.118:0/110913535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700094a0 con 0x7f5480071d50 2023-07-13T13:52:33.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.912+0000 7f547ffff700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f54801e5330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f547400c430 tx=0x7f547400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:33.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.914+0000 7f547cff9700 1 -- 172.21.15.118:0/110913535 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740050d0 con 0x7f5480071d50 2023-07-13T13:52:33.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.914+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548015ae70 con 0x7f5480071d50 2023-07-13T13:52:33.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.914+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548015b430 con 0x7f5480071d50 2023-07-13T13:52:33.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.915+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54800743c0 con 0x7f5480071d50 2023-07-13T13:52:33.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.916+0000 7f547cff9700 1 -- 172.21.15.118:0/110913535 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474005230 con 0x7f5480071d50 2023-07-13T13:52:33.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:33.916+0000 7f547cff9700 1 -- 172.21.15.118:0/110913535 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474006860 con 0x7f5480071d50 2023-07-13T13:52:34.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.171+0000 7f547cff9700 1 -- 172.21.15.118:0/110913535 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5474003680 con 0x7f5480071d50 2023-07-13T13:52:34.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.172+0000 7f547cff9700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f546c06ace0 0x7f546c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:34.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.172+0000 7f547cff9700 1 -- 172.21.15.118:0/110913535 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5474088d80 con 0x7f5480071d50 2023-07-13T13:52:34.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.172+0000 7f547f7fe700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f546c06ace0 0x7f546c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:34.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.172+0000 7f547f7fe700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f546c06ace0 0x7f546c06d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5470000c00 tx=0x7f5470008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:34.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.181+0000 7f547cff9700 1 -- 172.21.15.118:0/110913535 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5474053b40 con 0x7f5480071d50 2023-07-13T13:52:34.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.376+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f548015bfd0 con 0x7f5480071d50 2023-07-13T13:52:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.424+0000 7f547cff9700 1 -- 172.21.15.118:0/110913535 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f5474057160 con 0x7f5480071d50 2023-07-13T13:52:34.397 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:34.398 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f546c06ace0 msgr2=0x7f546c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f546c06ace0 0x7f546c06d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5470000c00 tx=0x7f5470008030 comp rx=0 tx=0).stop 2023-07-13T13:52:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 msgr2=0x7f54801e5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f54801e5330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f547400c430 tx=0x7f547400c740 comp rx=0 tx=0).stop 2023-07-13T13:52:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 shutdown_connections 2023-07-13T13:52:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f546c06ace0 0x7f546c06d190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5480152a90 0x7f54801474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:34.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5480071d50 0x7f54801e5330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:34.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 --2- 172.21.15.118:0/110913535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54800cb840 0x7f54801f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:34.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 >> 172.21.15.118:0/110913535 conn(0x7f548006cf10 msgr2=0x7f548006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:34.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 shutdown_connections 2023-07-13T13:52:34.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.427+0000 7f54864cf700 1 -- 172.21.15.118:0/110913535 wait complete. 2023-07-13T13:52:34.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-13T13:51:55.327381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-13T13:51:57.354158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-13T13:52:15.149076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-13T13:52:16.169659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-13T13:52:21.744112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-13T13:52:34.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-13T13:52:34.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.566+0000 7fd1be5b2700 1 Processor -- start 2023-07-13T13:52:34.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.566+0000 7fd1be5b2700 1 -- start start 2023-07-13T13:52:34.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.566+0000 7fd1be5b2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd1b8071cc0 0x7fd1b80c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:34.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.566+0000 7fd1be5b2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80c6ca0 con 0x7fd1b80720d0 2023-07-13T13:52:34.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.566+0000 7fd1be5b2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80716a0 con 0x7fd1b814f790 2023-07-13T13:52:34.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.566+0000 7fd1be5b2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80c6160 con 0x7fd1b8071cc0 2023-07-13T13:52:34.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.567+0000 7fd1bcb4f700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd1b80720d0 0x7fd1b80c7e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:52352/0 (socket says 172.21.15.118:52352) 2023-07-13T13:52:34.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.567+0000 7fd1bcb4f700 1 -- 172.21.15.118:0/4199477255 learned_addr learned my addr 172.21.15.118:0/4199477255 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:34.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.567+0000 7fd1b77fe700 1 --2- 172.21.15.118:0/4199477255 >> v2:172.21.15.123:3300/0 conn(0x7fd1b8071cc0 0x7fd1b80c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:34.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.570+0000 7fd1b6ffd700 1 -- 172.21.15.118:0/4199477255 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311544956 0 0) 0x7fd1b80c6ca0 con 0x7fd1b80720d0 2023-07-13T13:52:34.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.570+0000 7fd1b6ffd700 1 -- 172.21.15.118:0/4199477255 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a00035b0 con 0x7fd1b80720d0 2023-07-13T13:52:34.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.571+0000 7fd1b77fe700 1 -- 172.21.15.118:0/4199477255 >> v1:172.21.15.123:6789/0 conn(0x7fd1b814f790 legacy=0x7fd1b8070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.571+0000 7fd1b77fe700 1 -- 172.21.15.118:0/4199477255 >> v1:172.21.15.118:6789/0 conn(0x7fd1b80720d0 legacy=0x7fd1b80c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:34.544 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.571+0000 7fd1b77fe700 1 -- 172.21.15.118:0/4199477255 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80c6370 con 0x7fd1b8071cc0 2023-07-13T13:52:34.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.575+0000 7fd1b77fe700 1 --2- 172.21.15.118:0/4199477255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b8071cc0 0x7fd1b80c4380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009840 tx=0x7fd1a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64696aacf8459f server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:34.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1b6ffd700 1 -- 172.21.15.118:0/4199477255 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8011830 con 0x7fd1b8071cc0 2023-07-13T13:52:34.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1b6ffd700 1 -- 172.21.15.118:0/4199477255 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a8011990 con 0x7fd1b8071cc0 2023-07-13T13:52:34.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1b6ffd700 1 -- 172.21.15.118:0/4199477255 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8011d20 con 0x7fd1b8071cc0 2023-07-13T13:52:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1be5b2700 1 -- 172.21.15.118:0/4199477255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b8071cc0 msgr2=0x7fd1b80c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1be5b2700 1 --2- 172.21.15.118:0/4199477255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b8071cc0 0x7fd1b80c4380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009840 tx=0x7fd1a8009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1be5b2700 1 -- 172.21.15.118:0/4199477255 shutdown_connections 2023-07-13T13:52:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1be5b2700 1 --2- 172.21.15.118:0/4199477255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b8071cc0 0x7fd1b80c4380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:34.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1be5b2700 1 -- 172.21.15.118:0/4199477255 >> 172.21.15.118:0/4199477255 conn(0x7fd1b806cf60 msgr2=0x7fd1b806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:34.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1be5b2700 1 -- 172.21.15.118:0/4199477255 shutdown_connections 2023-07-13T13:52:34.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.579+0000 7fd1be5b2700 1 -- 172.21.15.118:0/4199477255 wait complete. 2023-07-13T13:52:34.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.581+0000 7fd1be5b2700 1 Processor -- start 2023-07-13T13:52:34.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.581+0000 7fd1be5b2700 1 -- start start 2023-07-13T13:52:34.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.581+0000 7fd1be5b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b8071cc0 0x7fd1b81e0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:34.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.581+0000 7fd1be5b2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd1b80720d0 0x7fd1b8143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:34.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.581+0000 7fd1be5b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b814f790 0x7fd1b806e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:34.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.581+0000 7fd1be5b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81e13b0 con 0x7fd1b8071cc0 2023-07-13T13:52:34.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.581+0000 7fd1be5b2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81e0e80 con 0x7fd1b814f790 2023-07-13T13:52:34.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.581+0000 7fd1be5b2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8144310 con 0x7fd1b80720d0 2023-07-13T13:52:34.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.582+0000 7fd1b77fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd1b80720d0 0x7fd1b8143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:34.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.582+0000 7fd1bcb4f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b814f790 0x7fd1b806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:34.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.582+0000 7fd1bcb4f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b814f790 0x7fd1b806e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:58568/0 (socket says 172.21.15.118:58568) 2023-07-13T13:52:34.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.582+0000 7fd1bcb4f700 1 -- 172.21.15.118:0/483835705 learned_addr learned my addr 172.21.15.118:0/483835705 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.587+0000 7fd1bcb4f700 1 -- 172.21.15.118:0/483835705 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd1b80720d0 msgr2=0x7fd1b8143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.587+0000 7fd1bcb4f700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd1b80720d0 0x7fd1b8143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.587+0000 7fd1bcb4f700 1 -- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b8071cc0 msgr2=0x7fd1b81e0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.587+0000 7fd1bcb4f700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b8071cc0 0x7fd1b81e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:34.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.587+0000 7fd1bcb4f700 1 -- 172.21.15.118:0/483835705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80094a0 con 0x7fd1b814f790 2023-07-13T13:52:34.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.589+0000 7fd1bcb4f700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b814f790 0x7fd1b806e910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000cb70 tx=0x7fd1b000ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:34.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.593+0000 7fd1b4ff9700 1 -- 172.21.15.118:0/483835705 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000aa60 con 0x7fd1b814f790 2023-07-13T13:52:34.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.593+0000 7fd1b4ff9700 1 -- 172.21.15.118:0/483835705 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b000abc0 con 0x7fd1b814f790 2023-07-13T13:52:34.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.593+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b81e10d0 con 0x7fd1b814f790 2023-07-13T13:52:34.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.593+0000 7fd1b4ff9700 1 -- 172.21.15.118:0/483835705 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0011470 con 0x7fd1b814f790 2023-07-13T13:52:34.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.593+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b81438b0 con 0x7fd1b814f790 2023-07-13T13:52:34.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.594+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b81451e0 con 0x7fd1b814f790 2023-07-13T13:52:34.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.840+0000 7fd1b4ff9700 1 -- 172.21.15.118:0/483835705 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1b00115d0 con 0x7fd1b814f790 2023-07-13T13:52:34.813 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.840+0000 7fd1b4ff9700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd1a406ad30 0x7fd1a406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:34.813 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.840+0000 7fd1b7fff700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd1a406ad30 0x7fd1a406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:34.813 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.841+0000 7fd1b7fff700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd1a406ad30 0x7fd1a406d1e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac000fb0 tx=0x7fd1ac007a30 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:34.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.845+0000 7fd1b4ff9700 1 -- 172.21.15.118:0/483835705 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd1b005e950 con 0x7fd1b814f790 2023-07-13T13:52:34.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:34.854+0000 7fd1b4ff9700 1 -- 172.21.15.118:0/483835705 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1b0056cd0 con 0x7fd1b814f790 2023-07-13T13:52:35.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.061+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1b81451e0 con 0x7fd1b814f790 2023-07-13T13:52:35.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.068+0000 7fd1b4ff9700 1 -- 172.21.15.118:0/483835705 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1b81451e0 con 0x7fd1b814f790 2023-07-13T13:52:35.040 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-07-13T13:52:35.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd1a406ad30 msgr2=0x7fd1a406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd1a406ad30 0x7fd1a406d1e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac000fb0 tx=0x7fd1ac007a30 comp rx=0 tx=0).stop 2023-07-13T13:52:35.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b814f790 msgr2=0x7fd1b806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b814f790 0x7fd1b806e910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000cb70 tx=0x7fd1b000ce80 comp rx=0 tx=0).stop 2023-07-13T13:52:35.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 shutdown_connections 2023-07-13T13:52:35.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd1a406ad30 0x7fd1a406d1e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1b814f790 0x7fd1b806e910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1b8071cc0 0x7fd1b81e0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 --2- 172.21.15.118:0/483835705 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd1b80720d0 0x7fd1b8143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 >> 172.21.15.118:0/483835705 conn(0x7fd1b806cf60 msgr2=0x7fd1b80c45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:35.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 shutdown_connections 2023-07-13T13:52:35.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.070+0000 7fd1be5b2700 1 -- 172.21.15.118:0/483835705 wait complete. 2023-07-13T13:52:35.054 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-13T13:52:35.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.207+0000 7f6a1ea1b700 1 Processor -- start 2023-07-13T13:52:35.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.207+0000 7f6a1ea1b700 1 -- start start 2023-07-13T13:52:35.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.208+0000 7f6a1ea1b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6a1814f790 0x7f6a18070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.208+0000 7f6a1ea1b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a180720d0 0x7f6a180c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.208+0000 7f6a1ea1b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180c6ca0 con 0x7f6a18071cc0 2023-07-13T13:52:35.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.208+0000 7f6a1ea1b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180c6160 con 0x7f6a1814f790 2023-07-13T13:52:35.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.208+0000 7f6a1ea1b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a18071430 con 0x7f6a180720d0 2023-07-13T13:52:35.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.209+0000 7f6a1cfb8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a180720d0 0x7f6a180c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.209+0000 7f6a1cfb8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a180720d0 0x7f6a180c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:58572/0 (socket says 172.21.15.118:58572) 2023-07-13T13:52:35.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.209+0000 7f6a1cfb8700 1 -- 172.21.15.118:0/624259584 learned_addr learned my addr 172.21.15.118:0/624259584 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:35.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.210+0000 7f6a17fff700 1 --2- 172.21.15.118:0/624259584 >> v2:172.21.15.118:3300/0 conn(0x7f6a1814f790 0x7f6a18070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.212+0000 7f6a1cfb8700 1 -- 172.21.15.118:0/624259584 >> v2:172.21.15.118:3300/0 conn(0x7f6a1814f790 msgr2=0x7f6a18070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:35.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.212+0000 7f6a1cfb8700 1 --2- 172.21.15.118:0/624259584 >> v2:172.21.15.118:3300/0 conn(0x7f6a1814f790 0x7f6a18070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.212+0000 7f6a1cfb8700 1 -- 172.21.15.118:0/624259584 >> v1:172.21.15.118:6789/0 conn(0x7f6a18071cc0 legacy=0x7f6a180c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:35.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.212+0000 7f6a1cfb8700 1 -- 172.21.15.118:0/624259584 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180716a0 con 0x7f6a180720d0 2023-07-13T13:52:35.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.214+0000 7f6a1cfb8700 1 --2- 172.21.15.118:0/624259584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a180720d0 0x7f6a180c7e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a181554f0 tx=0x7f6a1000d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=859a996cbb35338 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:35.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a16ffd700 1 -- 172.21.15.118:0/624259584 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10010070 con 0x7f6a180720d0 2023-07-13T13:52:35.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a16ffd700 1 -- 172.21.15.118:0/624259584 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000b2e0 con 0x7f6a180720d0 2023-07-13T13:52:35.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a16ffd700 1 -- 172.21.15.118:0/624259584 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000dcd0 con 0x7f6a180720d0 2023-07-13T13:52:35.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/624259584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a180720d0 msgr2=0x7f6a180c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/624259584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a180720d0 0x7f6a180c7e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a181554f0 tx=0x7f6a1000d430 comp rx=0 tx=0).stop 2023-07-13T13:52:35.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/624259584 shutdown_connections 2023-07-13T13:52:35.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/624259584 >> v2:172.21.15.118:3300/0 conn(0x7f6a1814f790 0x7f6a18070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/624259584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a180720d0 0x7f6a180c7e60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/624259584 >> 172.21.15.118:0/624259584 conn(0x7f6a1806cf60 msgr2=0x7f6a1806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:35.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/624259584 shutdown_connections 2023-07-13T13:52:35.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.218+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/624259584 wait complete. 2023-07-13T13:52:35.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.220+0000 7f6a1ea1b700 1 Processor -- start 2023-07-13T13:52:35.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.220+0000 7f6a1ea1b700 1 -- start start 2023-07-13T13:52:35.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.220+0000 7f6a1ea1b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a18071cc0 0x7f6a180c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.220+0000 7f6a1ea1b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a180720d0 0x7f6a18141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.221+0000 7f6a1ea1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1814f790 0x7f6a181423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.221+0000 7f6a1ea1b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181428f0 con 0x7f6a18071cc0 2023-07-13T13:52:35.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.221+0000 7f6a1ea1b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180c9560 con 0x7f6a1814f790 2023-07-13T13:52:35.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.221+0000 7f6a1ea1b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18154540 con 0x7f6a180720d0 2023-07-13T13:52:35.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.222+0000 7f6a1cfb8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1814f790 0x7f6a181423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.223+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a18071cc0 0x7f6a180c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.223+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a18071cc0 0x7f6a180c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41026/0 (socket says 172.21.15.118:41026) 2023-07-13T13:52:35.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.223+0000 7f6a17fff700 1 -- 172.21.15.118:0/598693151 learned_addr learned my addr 172.21.15.118:0/598693151 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:35.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.223+0000 7f6a177fe700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a180720d0 0x7f6a18141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.227+0000 7f6a17fff700 1 -- 172.21.15.118:0/598693151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a180720d0 msgr2=0x7f6a18141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.227+0000 7f6a17fff700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a180720d0 0x7f6a18141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.227+0000 7f6a17fff700 1 -- 172.21.15.118:0/598693151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1814f790 msgr2=0x7f6a181423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.227+0000 7f6a17fff700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1814f790 0x7f6a181423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.227+0000 7f6a17fff700 1 -- 172.21.15.118:0/598693151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1000bd40 con 0x7f6a18071cc0 2023-07-13T13:52:35.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.230+0000 7f6a17fff700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a18071cc0 0x7f6a180c9e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800e990 tx=0x7f6a0800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:35.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.236+0000 7f6a14ff9700 1 -- 172.21.15.118:0/598693151 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080096f0 con 0x7f6a18071cc0 2023-07-13T13:52:35.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.236+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a180c92a0 con 0x7f6a18071cc0 2023-07-13T13:52:35.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.236+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a18153ef0 con 0x7f6a18071cc0 2023-07-13T13:52:35.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.237+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1804e280 con 0x7f6a18071cc0 2023-07-13T13:52:35.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.506+0000 7f6a14ff9700 1 -- 172.21.15.118:0/598693151 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0800c690 con 0x7f6a18071cc0 2023-07-13T13:52:35.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.506+0000 7f6a14ff9700 1 -- 172.21.15.118:0/598693151 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800ca00 con 0x7f6a18071cc0 2023-07-13T13:52:35.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.560+0000 7f6a14ff9700 1 -- 172.21.15.118:0/598693151 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a0800cb60 con 0x7f6a18071cc0 2023-07-13T13:52:35.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.561+0000 7f6a14ff9700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6a0406ace0 0x7f6a0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.561+0000 7f6a14ff9700 1 -- 172.21.15.118:0/598693151 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a08089fd0 con 0x7f6a18071cc0 2023-07-13T13:52:35.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.561+0000 7f6a177fe700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6a0406ace0 0x7f6a0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.561+0000 7f6a177fe700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6a0406ace0 0x7f6a0406d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009960 tx=0x7f6a0c0090e0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:35.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.570+0000 7f6a14ff9700 1 -- 172.21.15.118:0/598693151 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6a08054c70 con 0x7f6a18071cc0 2023-07-13T13:52:35.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.756+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a18069f30 con 0x7f6a18071cc0 2023-07-13T13:52:35.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.764+0000 7f6a14ff9700 1 -- 172.21.15.118:0/598693151 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a08021020 con 0x7f6a18071cc0 2023-07-13T13:52:35.737 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-07-13T13:52:35.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6a0406ace0 msgr2=0x7f6a0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6a0406ace0 0x7f6a0406d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009960 tx=0x7f6a0c0090e0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a18071cc0 msgr2=0x7f6a180c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a18071cc0 0x7f6a180c9e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800e990 tx=0x7f6a0800eca0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 shutdown_connections 2023-07-13T13:52:35.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6a0406ace0 0x7f6a0406d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1814f790 0x7f6a181423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6a18071cc0 0x7f6a180c9e90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 --2- 172.21.15.118:0/598693151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a180720d0 0x7f6a18141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 >> 172.21.15.118:0/598693151 conn(0x7f6a1806cf60 msgr2=0x7f6a18147f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.766+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 shutdown_connections 2023-07-13T13:52:35.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.767+0000 7f6a1ea1b700 1 -- 172.21.15.118:0/598693151 wait complete. 2023-07-13T13:52:35.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-13T13:52:35.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.903+0000 7f05f8754700 1 Processor -- start 2023-07-13T13:52:35.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.903+0000 7f05f8754700 1 -- start start 2023-07-13T13:52:35.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.904+0000 7f05f8754700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0152970 0x7f05f0071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.904+0000 7f05f8754700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f0158b80 con 0x7f05f0070dd0 2023-07-13T13:52:35.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.904+0000 7f05f8754700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f0158e60 con 0x7f05f0158640 2023-07-13T13:52:35.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.904+0000 7f05f8754700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0159140 con 0x7f05f0152970 2023-07-13T13:52:35.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.905+0000 7f05f5cef700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f05f0070dd0 0x7f05f0069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:52364/0 (socket says 172.21.15.118:52364) 2023-07-13T13:52:35.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.905+0000 7f05f6cf1700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f05f0158640 0x7f05f00c8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:48438/0 (socket says 172.21.15.118:48438) 2023-07-13T13:52:35.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.905+0000 7f05f5cef700 1 -- 172.21.15.118:0/1494156954 learned_addr learned my addr 172.21.15.118:0/1494156954 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:35.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.905+0000 7f05f64f0700 1 --2- 172.21.15.118:0/1494156954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0152970 0x7f05f0071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.908+0000 7f05f54ee700 1 -- 172.21.15.118:0/1494156954 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288879953 0 0) 0x7f05f0158b80 con 0x7f05f0070dd0 2023-07-13T13:52:35.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.908+0000 7f05f54ee700 1 -- 172.21.15.118:0/1494156954 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05dc0035b0 con 0x7f05f0070dd0 2023-07-13T13:52:35.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.908+0000 7f05f64f0700 1 -- 172.21.15.118:0/1494156954 >> v1:172.21.15.123:6789/0 conn(0x7f05f0158640 legacy=0x7f05f00c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.908+0000 7f05f64f0700 1 -- 172.21.15.118:0/1494156954 >> v1:172.21.15.118:6789/0 conn(0x7f05f0070dd0 legacy=0x7f05f0069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.908+0000 7f05f64f0700 1 -- 172.21.15.118:0/1494156954 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0159420 con 0x7f05f0152970 2023-07-13T13:52:35.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.910+0000 7f05f64f0700 1 --2- 172.21.15.118:0/1494156954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0152970 0x7f05f0071c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009850 tx=0x7f05ec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ad46b319465e6e server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:35.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.914+0000 7f05f54ee700 1 -- 172.21.15.118:0/1494156954 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec005e30 con 0x7f05f0152970 2023-07-13T13:52:35.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.914+0000 7f05f54ee700 1 -- 172.21.15.118:0/1494156954 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec006030 con 0x7f05f0152970 2023-07-13T13:52:35.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.914+0000 7f05f54ee700 1 -- 172.21.15.118:0/1494156954 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0063e0 con 0x7f05f0152970 2023-07-13T13:52:35.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.915+0000 7f05f8754700 1 -- 172.21.15.118:0/1494156954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0152970 msgr2=0x7f05f0071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.915+0000 7f05f8754700 1 --2- 172.21.15.118:0/1494156954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0152970 0x7f05f0071c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05ec009850 tx=0x7f05ec009b60 comp rx=0 tx=0).stop 2023-07-13T13:52:35.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.915+0000 7f05f8754700 1 -- 172.21.15.118:0/1494156954 shutdown_connections 2023-07-13T13:52:35.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.915+0000 7f05f8754700 1 --2- 172.21.15.118:0/1494156954 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0152970 0x7f05f0071c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.915+0000 7f05f8754700 1 -- 172.21.15.118:0/1494156954 >> 172.21.15.118:0/1494156954 conn(0x7f05f006cf60 msgr2=0x7f05f006b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:35.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.915+0000 7f05f8754700 1 -- 172.21.15.118:0/1494156954 shutdown_connections 2023-07-13T13:52:35.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.915+0000 7f05f8754700 1 -- 172.21.15.118:0/1494156954 wait complete. 2023-07-13T13:52:35.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.916+0000 7f05f8754700 1 Processor -- start 2023-07-13T13:52:35.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.916+0000 7f05f8754700 1 -- start start 2023-07-13T13:52:35.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.917+0000 7f05f8754700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0070dd0 0x7f05f00cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.917+0000 7f05f8754700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f0152970 0x7f05f014ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.917+0000 7f05f8754700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f0158640 0x7f05f01e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.917+0000 7f05f8754700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00cb510 con 0x7f05f0158640 2023-07-13T13:52:35.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.917+0000 7f05f8754700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f014db10 con 0x7f05f0152970 2023-07-13T13:52:35.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.917+0000 7f05f8754700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f014ddf0 con 0x7f05f0070dd0 2023-07-13T13:52:35.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.918+0000 7f05f5cef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f0152970 0x7f05f014ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.918+0000 7f05f64f0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0070dd0 0x7f05f00cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.918+0000 7f05f6cf1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f0158640 0x7f05f01e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.918+0000 7f05f6cf1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f0158640 0x7f05f01e51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41042/0 (socket says 172.21.15.118:41042) 2023-07-13T13:52:35.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.918+0000 7f05f6cf1700 1 -- 172.21.15.118:0/2894554961 learned_addr learned my addr 172.21.15.118:0/2894554961 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:35.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.922+0000 7f05f6cf1700 1 -- 172.21.15.118:0/2894554961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0070dd0 msgr2=0x7f05f00cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.922+0000 7f05f6cf1700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0070dd0 0x7f05f00cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.922+0000 7f05f6cf1700 1 -- 172.21.15.118:0/2894554961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f0152970 msgr2=0x7f05f014ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:35.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.922+0000 7f05f6cf1700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f0152970 0x7f05f014ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:35.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.922+0000 7f05f6cf1700 1 -- 172.21.15.118:0/2894554961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec009430 con 0x7f05f0158640 2023-07-13T13:52:35.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.925+0000 7f05f6cf1700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f0158640 0x7f05f01e51f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f05e800cbc0 tx=0x7f05e800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:35.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.929+0000 7f05e6ffd700 1 -- 172.21.15.118:0/2894554961 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e800a9e0 con 0x7f05f0158640 2023-07-13T13:52:35.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.929+0000 7f05e6ffd700 1 -- 172.21.15.118:0/2894554961 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e800ab40 con 0x7f05f0158640 2023-07-13T13:52:35.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.929+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f014e0d0 con 0x7f05f0158640 2023-07-13T13:52:35.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.929+0000 7f05e6ffd700 1 -- 172.21.15.118:0/2894554961 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8007070 con 0x7f05f0158640 2023-07-13T13:52:35.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.929+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f014e690 con 0x7f05f0158640 2023-07-13T13:52:35.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.931+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f004e280 con 0x7f05f0158640 2023-07-13T13:52:35.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.950+0000 7f05e6ffd700 1 -- 172.21.15.118:0/2894554961 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05e80071d0 con 0x7f05f0158640 2023-07-13T13:52:35.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.951+0000 7f05e6ffd700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05d406ad30 0x7f05d406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:35.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.951+0000 7f05f64f0700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05d406ad30 0x7f05d406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:35.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:35.951+0000 7f05f64f0700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05d406ad30 0x7f05d406d1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0097a0 tx=0x7f05ec008070 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:36.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.192+0000 7f05e6ffd700 1 -- 172.21.15.118:0/2894554961 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05e805c2f0 con 0x7f05f0158640 2023-07-13T13:52:36.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.192+0000 7f05e6ffd700 1 -- 172.21.15.118:0/2894554961 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05e8054720 con 0x7f05f0158640 2023-07-13T13:52:36.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.378+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05f00cc050 con 0x7f05f0158640 2023-07-13T13:52:36.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.386+0000 7f05e6ffd700 1 -- 172.21.15.118:0/2894554961 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05e8017020 con 0x7f05f0158640 2023-07-13T13:52:36.359 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T13:52:36.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05d406ad30 msgr2=0x7f05d406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:36.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05d406ad30 0x7f05d406d1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0097a0 tx=0x7f05ec008070 comp rx=0 tx=0).stop 2023-07-13T13:52:36.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f0158640 msgr2=0x7f05f01e51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:36.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f0158640 0x7f05f01e51f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f05e800cbc0 tx=0x7f05e800ced0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 shutdown_connections 2023-07-13T13:52:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05d406ad30 0x7f05d406d1e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05f0158640 0x7f05f01e51f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05f0070dd0 0x7f05f00cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.388+0000 7f05f8754700 1 --2- 172.21.15.118:0/2894554961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f0152970 0x7f05f014ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.389+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 >> 172.21.15.118:0/2894554961 conn(0x7f05f006cf60 msgr2=0x7f05f0157740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.389+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 shutdown_connections 2023-07-13T13:52:36.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.389+0000 7f05f8754700 1 -- 172.21.15.118:0/2894554961 wait complete. 2023-07-13T13:52:36.372 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-13T13:52:36.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.524+0000 7f8ca3fdf700 1 Processor -- start 2023-07-13T13:52:36.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.525+0000 7f8ca3fdf700 1 -- start start 2023-07-13T13:52:36.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.525+0000 7f8ca3fdf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c9c152970 0x7f8c9c071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:36.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.525+0000 7f8ca3fdf700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c9c070dd0 0x7f8c9c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:36.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.525+0000 7f8ca3fdf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c158640 0x7f8c9c06a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:36.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.525+0000 7f8ca3fdf700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c158b80 con 0x7f8c9c070dd0 2023-07-13T13:52:36.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.525+0000 7f8ca3fdf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c158e60 con 0x7f8c9c152970 2023-07-13T13:52:36.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.525+0000 7f8ca3fdf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c159140 con 0x7f8c9c158640 2023-07-13T13:52:36.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.526+0000 7f8ca157a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c9c070dd0 0x7f8c9c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:36.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.526+0000 7f8ca257c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c158640 0x7f8c9c06a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:36.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.526+0000 7f8ca157a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c9c070dd0 0x7f8c9c069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41050/0 (socket says 172.21.15.118:41050) 2023-07-13T13:52:36.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.526+0000 7f8ca157a700 1 -- 172.21.15.118:0/1985394614 learned_addr learned my addr 172.21.15.118:0/1985394614 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:36.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.526+0000 7f8ca1d7b700 1 --2- 172.21.15.118:0/1985394614 >> v2:172.21.15.123:3300/0 conn(0x7f8c9c152970 0x7f8c9c071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:36.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.529+0000 7f8ca157a700 1 -- 172.21.15.118:0/1985394614 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c158640 msgr2=0x7f8c9c06a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:36.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.529+0000 7f8ca157a700 1 --2- 172.21.15.118:0/1985394614 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c158640 0x7f8c9c06a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.529+0000 7f8ca157a700 1 -- 172.21.15.118:0/1985394614 >> v2:172.21.15.123:3300/0 conn(0x7f8c9c152970 msgr2=0x7f8c9c071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:36.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.529+0000 7f8ca157a700 1 --2- 172.21.15.118:0/1985394614 >> v2:172.21.15.123:3300/0 conn(0x7f8c9c152970 0x7f8c9c071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.529+0000 7f8ca157a700 1 -- 172.21.15.118:0/1985394614 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c159420 con 0x7f8c9c070dd0 2023-07-13T13:52:36.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.534+0000 7f8ca157a700 1 --2- 172.21.15.118:0/1985394614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c070dd0 0x7f8c9c069f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c06d860 tx=0x7f8c98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6d3718dac78d4a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.538+0000 7f8ca0d79700 1 -- 172.21.15.118:0/1985394614 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011830 con 0x7f8c9c070dd0 2023-07-13T13:52:36.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.538+0000 7f8ca0d79700 1 -- 172.21.15.118:0/1985394614 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c98011990 con 0x7f8c9c070dd0 2023-07-13T13:52:36.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.538+0000 7f8ca0d79700 1 -- 172.21.15.118:0/1985394614 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011d20 con 0x7f8c9c070dd0 2023-07-13T13:52:36.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/1985394614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c070dd0 msgr2=0x7f8c9c069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:36.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/1985394614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c070dd0 0x7f8c9c069f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c06d860 tx=0x7f8c98009bd0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/1985394614 shutdown_connections 2023-07-13T13:52:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/1985394614 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c158640 0x7f8c9c06a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/1985394614 >> v2:172.21.15.123:3300/0 conn(0x7f8c9c152970 0x7f8c9c071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/1985394614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c070dd0 0x7f8c9c069f30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/1985394614 >> 172.21.15.118:0/1985394614 conn(0x7f8c9c06cf60 msgr2=0x7f8c9c06b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/1985394614 shutdown_connections 2023-07-13T13:52:36.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.539+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/1985394614 wait complete. 2023-07-13T13:52:36.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.540+0000 7f8ca3fdf700 1 Processor -- start 2023-07-13T13:52:36.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.540+0000 7f8ca3fdf700 1 -- start start 2023-07-13T13:52:36.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.541+0000 7f8ca3fdf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9c070dd0 0x7f8c9c0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:36.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.541+0000 7f8ca3fdf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c152970 0x7f8c9c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:36.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.541+0000 7f8ca3fdf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c158640 0x7f8c9c1485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:36.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.541+0000 7f8ca3fdf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c14af60 con 0x7f8c9c158640 2023-07-13T13:52:36.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.541+0000 7f8ca3fdf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0c4580 con 0x7f8c9c070dd0 2023-07-13T13:52:36.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.541+0000 7f8ca3fdf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c1505b0 con 0x7f8c9c152970 2023-07-13T13:52:36.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.542+0000 7f8ca257c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c158640 0x7f8c9c1485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:36.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.542+0000 7f8ca157a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c152970 0x7f8c9c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:36.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.542+0000 7f8ca1d7b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9c070dd0 0x7f8c9c0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:36.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.542+0000 7f8ca257c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c158640 0x7f8c9c1485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41060/0 (socket says 172.21.15.118:41060) 2023-07-13T13:52:36.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.542+0000 7f8ca257c700 1 -- 172.21.15.118:0/3139882433 learned_addr learned my addr 172.21.15.118:0/3139882433 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:36.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.545+0000 7f8ca257c700 1 -- 172.21.15.118:0/3139882433 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c152970 msgr2=0x7f8c9c148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:36.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.545+0000 7f8ca257c700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c152970 0x7f8c9c148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.546+0000 7f8ca257c700 1 -- 172.21.15.118:0/3139882433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9c070dd0 msgr2=0x7f8c9c0c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:36.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.546+0000 7f8ca257c700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9c070dd0 0x7f8c9c0c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:36.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.546+0000 7f8ca257c700 1 -- 172.21.15.118:0/3139882433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98009550 con 0x7f8c9c158640 2023-07-13T13:52:36.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.548+0000 7f8ca257c700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c158640 0x7f8c9c1485c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400efc0 tx=0x7f8c9400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:36.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.551+0000 7f8c8e7fc700 1 -- 172.21.15.118:0/3139882433 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400cad0 con 0x7f8c9c158640 2023-07-13T13:52:36.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.551+0000 7f8c8e7fc700 1 -- 172.21.15.118:0/3139882433 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9400f040 con 0x7f8c9c158640 2023-07-13T13:52:36.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.551+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c0c47b0 con 0x7f8c9c158640 2023-07-13T13:52:36.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.551+0000 7f8c8e7fc700 1 -- 172.21.15.118:0/3139882433 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400ce70 con 0x7f8c9c158640 2023-07-13T13:52:36.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.552+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c150ae0 con 0x7f8c9c158640 2023-07-13T13:52:36.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.552+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c06d570 con 0x7f8c9c158640 2023-07-13T13:52:36.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.817+0000 7f8c8e7fc700 1 -- 172.21.15.118:0/3139882433 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c94014480 con 0x7f8c9c158640 2023-07-13T13:52:36.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.818+0000 7f8c8e7fc700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:36.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.818+0000 7f8c8e7fc700 1 -- 172.21.15.118:0/3139882433 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c9408a740 con 0x7f8c9c158640 2023-07-13T13:52:36.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.818+0000 7f8ca1d7b700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:36.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.818+0000 7f8c8e7fc700 1 -- 172.21.15.118:0/3139882433 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c9408ab80 con 0x7f8c9c158640 2023-07-13T13:52:36.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:36.818+0000 7f8ca1d7b700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c8006ace0 0x7f8c8006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009bc0 tx=0x7f8c900091c0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:37.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.033+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c9c04e280 con 0x7f8c9c158640 2023-07-13T13:52:37.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.042+0000 7f8c8e7fc700 1 -- 172.21.15.118:0/3139882433 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c94058f70 con 0x7f8c9c158640 2023-07-13T13:52:37.014 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2023-07-13T13:52:37.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c8006ace0 msgr2=0x7f8c8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c8006ace0 0x7f8c8006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009bc0 tx=0x7f8c900091c0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c158640 msgr2=0x7f8c9c1485c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c158640 0x7f8c9c1485c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400efc0 tx=0x7f8c9400c0c0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 shutdown_connections 2023-07-13T13:52:37.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c8006ace0 0x7f8c8006d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c9c070dd0 0x7f8c9c0c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c9c158640 0x7f8c9c1485c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 --2- 172.21.15.118:0/3139882433 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c9c152970 0x7f8c9c148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 >> 172.21.15.118:0/3139882433 conn(0x7f8c9c06cf60 msgr2=0x7f8c9c06b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:37.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 shutdown_connections 2023-07-13T13:52:37.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.044+0000 7f8ca3fdf700 1 -- 172.21.15.118:0/3139882433 wait complete. 2023-07-13T13:52:37.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-13T13:52:37.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.180+0000 7f026f59a700 1 Processor -- start 2023-07-13T13:52:37.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.181+0000 7f026f59a700 1 -- start start 2023-07-13T13:52:37.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.181+0000 7f026f59a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02680b36d0 0x7f026815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.181+0000 7f026f59a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02680b3aa0 0x7f0268159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.181+0000 7f026f59a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0268158740 con 0x7f02680ce7e0 2023-07-13T13:52:37.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.181+0000 7f026f59a700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680c3af0 con 0x7f02680b36d0 2023-07-13T13:52:37.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.181+0000 7f026f59a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680c3dd0 con 0x7f02680b3aa0 2023-07-13T13:52:37.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.182+0000 7f026d336700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02680b36d0 0x7f026815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.182+0000 7f026cb35700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02680b3aa0 0x7f0268159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.182+0000 7f026d336700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02680b36d0 0x7f026815bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41064/0 (socket says 172.21.15.118:41064) 2023-07-13T13:52:37.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.182+0000 7f026cb35700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02680b3aa0 0x7f0268159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:58606/0 (socket says 172.21.15.118:58606) 2023-07-13T13:52:37.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.183+0000 7f026d336700 1 -- 172.21.15.118:0/3523707991 learned_addr learned my addr 172.21.15.118:0/3523707991 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:37.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.186+0000 7f026d336700 1 -- 172.21.15.118:0/3523707991 >> v2:172.21.15.123:3300/0 conn(0x7f02680b3aa0 msgr2=0x7f0268159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:37.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.186+0000 7f026d336700 1 --2- 172.21.15.118:0/3523707991 >> v2:172.21.15.123:3300/0 conn(0x7f02680b3aa0 0x7f0268159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.186+0000 7f026d336700 1 -- 172.21.15.118:0/3523707991 >> v1:172.21.15.123:6789/0 conn(0x7f02680ce7e0 legacy=0x7f026806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.186+0000 7f026d336700 1 -- 172.21.15.118:0/3523707991 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680c40b0 con 0x7f02680b36d0 2023-07-13T13:52:37.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.188+0000 7f026d336700 1 --2- 172.21.15.118:0/3523707991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f026815bcb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f026806d1b0 tx=0x7f0258009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a22eb720cae3ba server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:37.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f025ffff700 1 -- 172.21.15.118:0/3523707991 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258011830 con 0x7f02680b36d0 2023-07-13T13:52:37.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f025ffff700 1 -- 172.21.15.118:0/3523707991 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258011990 con 0x7f02680b36d0 2023-07-13T13:52:37.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f025ffff700 1 -- 172.21.15.118:0/3523707991 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258011d20 con 0x7f02680b36d0 2023-07-13T13:52:37.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f026f59a700 1 -- 172.21.15.118:0/3523707991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 msgr2=0x7f026815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f026f59a700 1 --2- 172.21.15.118:0/3523707991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f026815bcb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f026806d1b0 tx=0x7f0258009bd0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f026f59a700 1 -- 172.21.15.118:0/3523707991 shutdown_connections 2023-07-13T13:52:37.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f026f59a700 1 --2- 172.21.15.118:0/3523707991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f026815bcb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f026f59a700 1 --2- 172.21.15.118:0/3523707991 >> v2:172.21.15.123:3300/0 conn(0x7f02680b3aa0 0x7f0268159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f026f59a700 1 -- 172.21.15.118:0/3523707991 >> 172.21.15.118:0/3523707991 conn(0x7f0268071840 msgr2=0x7f026806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:37.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f026f59a700 1 -- 172.21.15.118:0/3523707991 shutdown_connections 2023-07-13T13:52:37.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.192+0000 7f026f59a700 1 -- 172.21.15.118:0/3523707991 wait complete. 2023-07-13T13:52:37.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.194+0000 7f026f59a700 1 Processor -- start 2023-07-13T13:52:37.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.194+0000 7f026f59a700 1 -- start start 2023-07-13T13:52:37.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.194+0000 7f026f59a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f0268157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.194+0000 7f026f59a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02680b3aa0 0x7f0268155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.194+0000 7f026f59a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02680ce7e0 0x7f02681ef220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.194+0000 7f026f59a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268153460 con 0x7f02680b36d0 2023-07-13T13:52:37.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.194+0000 7f026f59a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268154170 con 0x7f02680ce7e0 2023-07-13T13:52:37.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.194+0000 7f026f59a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0268154410 con 0x7f02680b3aa0 2023-07-13T13:52:37.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.195+0000 7f026d336700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f0268157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.195+0000 7f026db37700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02680ce7e0 0x7f02681ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.195+0000 7f026d336700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f0268157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41078/0 (socket says 172.21.15.118:41078) 2023-07-13T13:52:37.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.195+0000 7f026d336700 1 -- 172.21.15.118:0/2898152889 learned_addr learned my addr 172.21.15.118:0/2898152889 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:37.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.195+0000 7f026cb35700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02680b3aa0 0x7f0268155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.199+0000 7f026d336700 1 -- 172.21.15.118:0/2898152889 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02680b3aa0 msgr2=0x7f0268155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.199+0000 7f026d336700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02680b3aa0 0x7f0268155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.199+0000 7f026d336700 1 -- 172.21.15.118:0/2898152889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02680ce7e0 msgr2=0x7f02681ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.199+0000 7f026d336700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02680ce7e0 0x7f02681ef220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.199+0000 7f026d336700 1 -- 172.21.15.118:0/2898152889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009550 con 0x7f02680b36d0 2023-07-13T13:52:37.173 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.201+0000 7f026d336700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f0268157840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0258009c10 tx=0x7f0258004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:37.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.203+0000 7f025dffb700 1 -- 172.21.15.118:0/2898152889 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258004510 con 0x7f02680b36d0 2023-07-13T13:52:37.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.203+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02681546f0 con 0x7f02680b36d0 2023-07-13T13:52:37.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.204+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268154d40 con 0x7f02680b36d0 2023-07-13T13:52:37.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.205+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026804e280 con 0x7f02680b36d0 2023-07-13T13:52:37.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.205+0000 7f025dffb700 1 -- 172.21.15.118:0/2898152889 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025801e070 con 0x7f02680b36d0 2023-07-13T13:52:37.177 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.205+0000 7f025dffb700 1 -- 172.21.15.118:0/2898152889 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02580038a0 con 0x7f02680b36d0 2023-07-13T13:52:37.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.466+0000 7f025dffb700 1 -- 172.21.15.118:0/2898152889 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0258003a00 con 0x7f02680b36d0 2023-07-13T13:52:37.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.466+0000 7f025dffb700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f024c06ad10 0x7f024c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.466+0000 7f025dffb700 1 -- 172.21.15.118:0/2898152889 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f025808aa00 con 0x7f02680b36d0 2023-07-13T13:52:37.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.466+0000 7f026cb35700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f024c06ad10 0x7f024c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.467+0000 7f026cb35700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f024c06ad10 0x7f024c06d1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02680cd790 tx=0x7f0264009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:37.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.478+0000 7f025dffb700 1 -- 172.21.15.118:0/2898152889 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0258055730 con 0x7f02680b36d0 2023-07-13T13:52:37.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.666+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f026806ab20 con 0x7f02680b36d0 2023-07-13T13:52:37.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.674+0000 7f025dffb700 1 -- 172.21.15.118:0/2898152889 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0258003cb0 con 0x7f02680b36d0 2023-07-13T13:52:37.649 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T13:52:37.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f024c06ad10 msgr2=0x7f024c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f024c06ad10 0x7f024c06d1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f02680cd790 tx=0x7f0264009210 comp rx=0 tx=0).stop 2023-07-13T13:52:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 msgr2=0x7f0268157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f0268157840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0258009c10 tx=0x7f0258004750 comp rx=0 tx=0).stop 2023-07-13T13:52:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 shutdown_connections 2023-07-13T13:52:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f024c06ad10 0x7f024c06d1c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02680ce7e0 0x7f02681ef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02680b36d0 0x7f0268157840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 --2- 172.21.15.118:0/2898152889 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02680b3aa0 0x7f0268155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 >> 172.21.15.118:0/2898152889 conn(0x7f0268071840 msgr2=0x7f02680c9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 shutdown_connections 2023-07-13T13:52:37.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.677+0000 7f026f59a700 1 -- 172.21.15.118:0/2898152889 wait complete. 2023-07-13T13:52:37.662 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-13T13:52:37.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.812+0000 7fd63960e700 1 Processor -- start 2023-07-13T13:52:37.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.812+0000 7fd63960e700 1 -- start start 2023-07-13T13:52:37.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.812+0000 7fd63960e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd634158310 0x7fd634158740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.813+0000 7fd63960e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6340c4cf0 con 0x7fd63414f1d0 2023-07-13T13:52:37.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.813+0000 7fd63960e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd634071300 con 0x7fd6340c5b10 2023-07-13T13:52:37.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.813+0000 7fd63960e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63414f5a0 con 0x7fd634158310 2023-07-13T13:52:37.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.813+0000 7fd6327fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd6340c5b10 0x7fd6340c5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:48456/0 (socket says 172.21.15.118:48456) 2023-07-13T13:52:37.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.813+0000 7fd6327fc700 1 -- 172.21.15.118:0/4115844344 learned_addr learned my addr 172.21.15.118:0/4115844344 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:37.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.815+0000 7fd6337fe700 1 --2- 172.21.15.118:0/4115844344 >> v2:172.21.15.118:3300/0 conn(0x7fd634158310 0x7fd634158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.817+0000 7fd631ffb700 1 -- 172.21.15.118:0/4115844344 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306524153 0 0) 0x7fd634071300 con 0x7fd6340c5b10 2023-07-13T13:52:37.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.817+0000 7fd631ffb700 1 -- 172.21.15.118:0/4115844344 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd61c0035b0 con 0x7fd6340c5b10 2023-07-13T13:52:37.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.819+0000 7fd6337fe700 1 -- 172.21.15.118:0/4115844344 >> v1:172.21.15.123:6789/0 conn(0x7fd6340c5b10 legacy=0x7fd6340c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.819+0000 7fd6337fe700 1 -- 172.21.15.118:0/4115844344 >> v1:172.21.15.118:6789/0 conn(0x7fd63414f1d0 legacy=0x7fd634070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.819+0000 7fd6337fe700 1 -- 172.21.15.118:0/4115844344 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6340715e0 con 0x7fd634158310 2023-07-13T13:52:37.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.824+0000 7fd6337fe700 1 --2- 172.21.15.118:0/4115844344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd634158310 0x7fd634158740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009d90 tx=0x7fd62c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dff0aa34e53717 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:37.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd631ffb700 1 -- 172.21.15.118:0/4115844344 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00e070 con 0x7fd634158310 2023-07-13T13:52:37.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd631ffb700 1 -- 172.21.15.118:0/4115844344 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00bb20 con 0x7fd634158310 2023-07-13T13:52:37.802 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd631ffb700 1 -- 172.21.15.118:0/4115844344 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c012430 con 0x7fd634158310 2023-07-13T13:52:37.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd63960e700 1 -- 172.21.15.118:0/4115844344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd634158310 msgr2=0x7fd634158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd63960e700 1 --2- 172.21.15.118:0/4115844344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd634158310 0x7fd634158740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009d90 tx=0x7fd62c00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:37.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd63960e700 1 -- 172.21.15.118:0/4115844344 shutdown_connections 2023-07-13T13:52:37.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd63960e700 1 --2- 172.21.15.118:0/4115844344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd634158310 0x7fd634158740 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd63960e700 1 -- 172.21.15.118:0/4115844344 >> 172.21.15.118:0/4115844344 conn(0x7fd634069f30 msgr2=0x7fd63406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:37.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.829+0000 7fd63960e700 1 -- 172.21.15.118:0/4115844344 shutdown_connections 2023-07-13T13:52:37.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.830+0000 7fd63960e700 1 -- 172.21.15.118:0/4115844344 wait complete. 2023-07-13T13:52:37.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.831+0000 7fd63960e700 1 Processor -- start 2023-07-13T13:52:37.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.831+0000 7fd63960e700 1 -- start start 2023-07-13T13:52:37.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.832+0000 7fd63960e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6340c5b10 0x7fd63414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.832+0000 7fd63960e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd63414f1d0 0x7fd63406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.832+0000 7fd63960e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd634158310 0x7fd6340c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.832+0000 7fd63960e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63414b240 con 0x7fd63414f1d0 2023-07-13T13:52:37.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.832+0000 7fd63960e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341ec450 con 0x7fd6340c5b10 2023-07-13T13:52:37.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.832+0000 7fd63960e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341ec730 con 0x7fd634158310 2023-07-13T13:52:37.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.832+0000 7fd6327fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd63414f1d0 0x7fd63406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.833+0000 7fd6327fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd63414f1d0 0x7fd63406c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41088/0 (socket says 172.21.15.118:41088) 2023-07-13T13:52:37.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.833+0000 7fd6327fc700 1 -- 172.21.15.118:0/684285659 learned_addr learned my addr 172.21.15.118:0/684285659 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:37.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.833+0000 7fd632ffd700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6340c5b10 0x7fd63414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.833+0000 7fd6337fe700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd634158310 0x7fd6340c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.837+0000 7fd6327fc700 1 -- 172.21.15.118:0/684285659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd634158310 msgr2=0x7fd6340c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.837+0000 7fd6327fc700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd634158310 0x7fd6340c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.837+0000 7fd6327fc700 1 -- 172.21.15.118:0/684285659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6340c5b10 msgr2=0x7fd63414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:37.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.837+0000 7fd6327fc700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6340c5b10 0x7fd63414f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:37.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.837+0000 7fd6327fc700 1 -- 172.21.15.118:0/684285659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c009a70 con 0x7fd63414f1d0 2023-07-13T13:52:37.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.839+0000 7fd6327fc700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd63414f1d0 0x7fd63406c510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd628001eb0 tx=0x7fd62800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:37.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.843+0000 7fd61b7fe700 1 -- 172.21.15.118:0/684285659 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628005d70 con 0x7fd63414f1d0 2023-07-13T13:52:37.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.843+0000 7fd61b7fe700 1 -- 172.21.15.118:0/684285659 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6280070d0 con 0x7fd63414f1d0 2023-07-13T13:52:37.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.843+0000 7fd61b7fe700 1 -- 172.21.15.118:0/684285659 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628007460 con 0x7fd63414f1d0 2023-07-13T13:52:37.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.843+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6341eca10 con 0x7fd63414f1d0 2023-07-13T13:52:37.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.843+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6341ecfd0 con 0x7fd63414f1d0 2023-07-13T13:52:37.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.844+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6341ed1c0 con 0x7fd63414f1d0 2023-07-13T13:52:37.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.863+0000 7fd61b7fe700 1 -- 172.21.15.118:0/684285659 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6280075c0 con 0x7fd63414f1d0 2023-07-13T13:52:37.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.863+0000 7fd61b7fe700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd62006ace0 0x7fd62006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:37.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.863+0000 7fd632ffd700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd62006ace0 0x7fd62006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:37.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.864+0000 7fd632ffd700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd62006ace0 0x7fd62006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd624007fd0 tx=0x7fd624009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:37.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:37.985+0000 7fd61b7fe700 1 -- 172.21.15.118:0/684285659 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd62805ba50 con 0x7fd63414f1d0 2023-07-13T13:52:38.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.170+0000 7fd61b7fe700 1 -- 172.21.15.118:0/684285659 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd628053dd0 con 0x7fd63414f1d0 2023-07-13T13:52:38.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.390+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd63406d200 con 0x7fd63414f1d0 2023-07-13T13:52:38.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.397+0000 7fd61b7fe700 1 -- 172.21.15.118:0/684285659 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd628017080 con 0x7fd63414f1d0 2023-07-13T13:52:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd62006ace0 msgr2=0x7fd62006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd62006ace0 0x7fd62006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd624007fd0 tx=0x7fd624009040 comp rx=0 tx=0).stop 2023-07-13T13:52:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd63414f1d0 msgr2=0x7fd63406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd63414f1d0 0x7fd63406c510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd628001eb0 tx=0x7fd62800c7b0 comp rx=0 tx=0).stop 2023-07-13T13:52:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 shutdown_connections 2023-07-13T13:52:38.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd62006ace0 0x7fd62006d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6340c5b10 0x7fd63414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd634158310 0x7fd6340c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 --2- 172.21.15.118:0/684285659 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd63414f1d0 0x7fd63406c510 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 >> 172.21.15.118:0/684285659 conn(0x7fd634069f30 msgr2=0x7fd634073560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 shutdown_connections 2023-07-13T13:52:38.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.399+0000 7fd63960e700 1 -- 172.21.15.118:0/684285659 wait complete. 2023-07-13T13:52:38.375 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2023-07-13T13:52:38.384 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:52:38.385 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-13T13:52:38.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:38.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.592+0000 7f88e8af7700 1 Processor -- start 2023-07-13T13:52:38.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.592+0000 7f88e8af7700 1 -- start start 2023-07-13T13:52:38.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.592+0000 7f88e8af7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88e4152800 0x7f88e40cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:38.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.593+0000 7f88e8af7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e415bde0 con 0x7f88e406f540 2023-07-13T13:52:38.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.593+0000 7f88e8af7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e41592f0 con 0x7f88e415c980 2023-07-13T13:52:38.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.593+0000 7f88e8af7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e41595d0 con 0x7f88e4152800 2023-07-13T13:52:38.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.593+0000 7f88e1d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f88e406f540 0x7f88e415c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:52370/0 (socket says 172.21.15.118:52370) 2023-07-13T13:52:38.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.593+0000 7f88e1d9b700 1 -- 172.21.15.118:0/1412482037 learned_addr learned my addr 172.21.15.118:0/1412482037 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:38.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.593+0000 7f88e259c700 1 --2- 172.21.15.118:0/1412482037 >> v2:172.21.15.123:3300/0 conn(0x7f88e4152800 0x7f88e40cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:38.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.596+0000 7f88e159a700 1 -- 172.21.15.118:0/1412482037 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648644543 0 0) 0x7f88e415bde0 con 0x7f88e406f540 2023-07-13T13:52:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.596+0000 7f88e159a700 1 -- 172.21.15.118:0/1412482037 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88cc0035b0 con 0x7f88e406f540 2023-07-13T13:52:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.597+0000 7f88e259c700 1 -- 172.21.15.118:0/1412482037 >> v1:172.21.15.123:6789/0 conn(0x7f88e415c980 legacy=0x7f88e41630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.597+0000 7f88e259c700 1 -- 172.21.15.118:0/1412482037 >> v1:172.21.15.118:6789/0 conn(0x7f88e406f540 legacy=0x7f88e415c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:38.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.597+0000 7f88e259c700 1 -- 172.21.15.118:0/1412482037 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e406e790 con 0x7f88e4152800 2023-07-13T13:52:38.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.599+0000 7f88e259c700 1 --2- 172.21.15.118:0/1412482037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e4152800 0x7f88e40cb900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009840 tx=0x7f88d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec19e562ffe1bbef server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:38.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.603+0000 7f88e159a700 1 -- 172.21.15.118:0/1412482037 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8004230 con 0x7f88e4152800 2023-07-13T13:52:38.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.604+0000 7f88e159a700 1 -- 172.21.15.118:0/1412482037 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8004390 con 0x7f88e4152800 2023-07-13T13:52:38.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.604+0000 7f88e159a700 1 -- 172.21.15.118:0/1412482037 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80036a0 con 0x7f88e4152800 2023-07-13T13:52:38.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.605+0000 7f88e8af7700 1 -- 172.21.15.118:0/1412482037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e4152800 msgr2=0x7f88e40cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:38.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.605+0000 7f88e8af7700 1 --2- 172.21.15.118:0/1412482037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e4152800 0x7f88e40cb900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009840 tx=0x7f88d8009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:38.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.605+0000 7f88e8af7700 1 -- 172.21.15.118:0/1412482037 shutdown_connections 2023-07-13T13:52:38.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.605+0000 7f88e8af7700 1 --2- 172.21.15.118:0/1412482037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e4152800 0x7f88e40cb900 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:38.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.605+0000 7f88e8af7700 1 -- 172.21.15.118:0/1412482037 >> 172.21.15.118:0/1412482037 conn(0x7f88e406cf10 msgr2=0x7f88e406d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:38.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.605+0000 7f88e8af7700 1 -- 172.21.15.118:0/1412482037 shutdown_connections 2023-07-13T13:52:38.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.605+0000 7f88e8af7700 1 -- 172.21.15.118:0/1412482037 wait complete. 2023-07-13T13:52:38.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.606+0000 7f88e8af7700 1 Processor -- start 2023-07-13T13:52:38.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.606+0000 7f88e8af7700 1 -- start start 2023-07-13T13:52:38.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.607+0000 7f88e8af7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e406f540 0x7f88e406b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:38.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.607+0000 7f88e8af7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88e4152800 0x7f88e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:38.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.607+0000 7f88e8af7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e415c980 0x7f88e41f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:38.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.607+0000 7f88e8af7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e40cb290 con 0x7f88e406f540 2023-07-13T13:52:38.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.607+0000 7f88e8af7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e4151db0 con 0x7f88e415c980 2023-07-13T13:52:38.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.607+0000 7f88e8af7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e4151270 con 0x7f88e4152800 2023-07-13T13:52:38.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.608+0000 7f88e2d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e415c980 0x7f88e41f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:38.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.608+0000 7f88e1d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88e4152800 0x7f88e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:38.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.608+0000 7f88e2d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e415c980 0x7f88e41f1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:58640/0 (socket says 172.21.15.118:58640) 2023-07-13T13:52:38.582 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.608+0000 7f88e2d9d700 1 -- 172.21.15.118:0/2948161306 learned_addr learned my addr 172.21.15.118:0/2948161306 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:38.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.612+0000 7f88e2d9d700 1 -- 172.21.15.118:0/2948161306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88e4152800 msgr2=0x7f88e406b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:38.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.612+0000 7f88e2d9d700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88e4152800 0x7f88e406b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:38.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.612+0000 7f88e2d9d700 1 -- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e406f540 msgr2=0x7f88e406b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:38.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.612+0000 7f88e2d9d700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e406f540 0x7f88e406b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:38.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.612+0000 7f88e2d9d700 1 -- 172.21.15.118:0/2948161306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d80094a0 con 0x7f88e415c980 2023-07-13T13:52:38.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.614+0000 7f88e2d9d700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e415c980 0x7f88e41f1790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00b970 tx=0x7f88dc00bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:38.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.618+0000 7f88d2ffd700 1 -- 172.21.15.118:0/2948161306 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc00c930 con 0x7f88e415c980 2023-07-13T13:52:38.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.618+0000 7f88d2ffd700 1 -- 172.21.15.118:0/2948161306 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc00cad0 con 0x7f88e415c980 2023-07-13T13:52:38.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.618+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e4151510 con 0x7f88e415c980 2023-07-13T13:52:38.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.618+0000 7f88d2ffd700 1 -- 172.21.15.118:0/2948161306 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc00ce80 con 0x7f88e415c980 2023-07-13T13:52:38.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.618+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e4151ad0 con 0x7f88e415c980 2023-07-13T13:52:38.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.619+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e40743c0 con 0x7f88e415c980 2023-07-13T13:52:38.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.866+0000 7f88d2ffd700 1 -- 172.21.15.118:0/2948161306 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88dc014440 con 0x7f88e415c980 2023-07-13T13:52:38.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.867+0000 7f88d2ffd700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f88c406ace0 0x7f88c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:38.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.867+0000 7f88e259c700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f88c406ace0 0x7f88c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:38.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.867+0000 7f88e259c700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f88c406ace0 0x7f88c406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009b90 tx=0x7f88d8009f90 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:38.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.871+0000 7f88d2ffd700 1 -- 172.21.15.118:0/2948161306 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88dc05c5c0 con 0x7f88e415c980 2023-07-13T13:52:38.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:38.882+0000 7f88d2ffd700 1 -- 172.21.15.118:0/2948161306 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88dc0549f0 con 0x7f88e415c980 2023-07-13T13:52:39.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.072+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88e4071890 con 0x7f88e415c980 2023-07-13T13:52:39.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.118+0000 7f88d2ffd700 1 -- 172.21.15.118:0/2948161306 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f88dc023090 con 0x7f88e415c980 2023-07-13T13:52:39.093 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:39.093 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:39.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f88c406ace0 msgr2=0x7f88c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f88c406ace0 0x7f88c406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009b90 tx=0x7f88d8009f90 comp rx=0 tx=0).stop 2023-07-13T13:52:39.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e415c980 msgr2=0x7f88e41f1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e415c980 0x7f88e41f1790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00b970 tx=0x7f88dc00bc80 comp rx=0 tx=0).stop 2023-07-13T13:52:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 shutdown_connections 2023-07-13T13:52:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f88c406ace0 0x7f88c406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88e415c980 0x7f88e41f1790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e406f540 0x7f88e406b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 --2- 172.21.15.118:0/2948161306 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88e4152800 0x7f88e406b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 >> 172.21.15.118:0/2948161306 conn(0x7f88e406cf10 msgr2=0x7f88e40c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:39.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 shutdown_connections 2023-07-13T13:52:39.097 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.121+0000 7f88e8af7700 1 -- 172.21.15.118:0/2948161306 wait complete. 2023-07-13T13:52:39.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-13T13:51:55.327381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-13T13:51:57.354158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-13T13:52:15.149076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-13T13:52:16.169659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-13T13:52:21.744112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-13T13:52:39.107 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-13T13:52:39.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.258+0000 7fd6b0a70700 1 Processor -- start 2023-07-13T13:52:39.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.258+0000 7fd6b0a70700 1 -- start start 2023-07-13T13:52:39.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.259+0000 7fd6b0a70700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac0c5530 0x7fd6ac1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.260+0000 7fd6b0a70700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6ac070d10 0x7fd6ac071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.260+0000 7fd6b0a70700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ac0c7490 con 0x7fd6ac14ed40 2023-07-13T13:52:39.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.260+0000 7fd6b0a70700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac071e10 con 0x7fd6ac070d10 2023-07-13T13:52:39.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.260+0000 7fd6b0a70700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac155af0 con 0x7fd6ac0c5530 2023-07-13T13:52:39.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.260+0000 7fd6aa59c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd6ac14ed40 0x7fd6ac069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:52372/0 (socket says 172.21.15.118:52372) 2023-07-13T13:52:39.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.260+0000 7fd6aa59c700 1 -- 172.21.15.118:0/326865193 learned_addr learned my addr 172.21.15.118:0/326865193 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:39.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.260+0000 7fd6a9d9b700 1 --2- 172.21.15.118:0/326865193 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac0c5530 0x7fd6ac1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.260+0000 7fd6aad9d700 1 --2- 172.21.15.118:0/326865193 >> v2:172.21.15.123:3300/0 conn(0x7fd6ac070d10 0x7fd6ac071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.263+0000 7fd6a959a700 1 -- 172.21.15.118:0/326865193 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409637742 0 0) 0x7fd6a0001110 con 0x7fd6ac14ed40 2023-07-13T13:52:39.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.263+0000 7fd6a959a700 1 -- 172.21.15.118:0/326865193 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6940035b0 con 0x7fd6ac14ed40 2023-07-13T13:52:39.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.263+0000 7fd6a9d9b700 1 -- 172.21.15.118:0/326865193 >> v2:172.21.15.123:3300/0 conn(0x7fd6ac070d10 msgr2=0x7fd6ac071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:39.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.263+0000 7fd6a9d9b700 1 --2- 172.21.15.118:0/326865193 >> v2:172.21.15.123:3300/0 conn(0x7fd6ac070d10 0x7fd6ac071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.263+0000 7fd6a9d9b700 1 -- 172.21.15.118:0/326865193 >> v1:172.21.15.118:6789/0 conn(0x7fd6ac14ed40 legacy=0x7fd6ac069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.263+0000 7fd6a9d9b700 1 -- 172.21.15.118:0/326865193 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0c6150 con 0x7fd6ac0c5530 2023-07-13T13:52:39.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.265+0000 7fd6a9d9b700 1 --2- 172.21.15.118:0/326865193 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac0c5530 0x7fd6ac1555b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00a9e0 tx=0x7fd69c00acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61fb6c0b7af8ca93 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:39.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.269+0000 7fd6a959a700 1 -- 172.21.15.118:0/326865193 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00cb70 con 0x7fd6ac0c5530 2023-07-13T13:52:39.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.269+0000 7fd6a959a700 1 -- 172.21.15.118:0/326865193 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c00ccd0 con 0x7fd6ac0c5530 2023-07-13T13:52:39.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.269+0000 7fd6a959a700 1 -- 172.21.15.118:0/326865193 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c018620 con 0x7fd6ac0c5530 2023-07-13T13:52:39.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.270+0000 7fd6b0a70700 1 -- 172.21.15.118:0/326865193 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac0c5530 msgr2=0x7fd6ac1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.270+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/326865193 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac0c5530 0x7fd6ac1555b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00a9e0 tx=0x7fd69c00acf0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.270+0000 7fd6b0a70700 1 -- 172.21.15.118:0/326865193 shutdown_connections 2023-07-13T13:52:39.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.270+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/326865193 >> v2:172.21.15.123:3300/0 conn(0x7fd6ac070d10 0x7fd6ac071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.270+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/326865193 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac0c5530 0x7fd6ac1555b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.270+0000 7fd6b0a70700 1 -- 172.21.15.118:0/326865193 >> 172.21.15.118:0/326865193 conn(0x7fd6ac0cb800 msgr2=0x7fd6ac0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:39.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.270+0000 7fd6b0a70700 1 -- 172.21.15.118:0/326865193 shutdown_connections 2023-07-13T13:52:39.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.270+0000 7fd6b0a70700 1 -- 172.21.15.118:0/326865193 wait complete. 2023-07-13T13:52:39.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.271+0000 7fd6b0a70700 1 Processor -- start 2023-07-13T13:52:39.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.271+0000 7fd6b0a70700 1 -- start start 2023-07-13T13:52:39.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.272+0000 7fd6b0a70700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac070d10 0x7fd6ac14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.272+0000 7fd6b0a70700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6ac0c5530 0x7fd6ac0c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.272+0000 7fd6b0a70700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac14ed40 0x7fd6ac1dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.272+0000 7fd6b0a70700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1dcec0 con 0x7fd6ac0c5530 2023-07-13T13:52:39.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.272+0000 7fd6b0a70700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1ee140 con 0x7fd6ac070d10 2023-07-13T13:52:39.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.272+0000 7fd6b0a70700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0c28f0 con 0x7fd6ac14ed40 2023-07-13T13:52:39.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.272+0000 7fd6a9d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6ac0c5530 0x7fd6ac0c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.273+0000 7fd6aad9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac14ed40 0x7fd6ac1dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.273+0000 7fd6aa59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac070d10 0x7fd6ac14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.273+0000 7fd6a9d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6ac0c5530 0x7fd6ac0c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41094/0 (socket says 172.21.15.118:41094) 2023-07-13T13:52:39.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.273+0000 7fd6a9d9b700 1 -- 172.21.15.118:0/3898264872 learned_addr learned my addr 172.21.15.118:0/3898264872 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:39.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.277+0000 7fd6aad9d700 1 -- 172.21.15.118:0/3898264872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac070d10 msgr2=0x7fd6ac14d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.277+0000 7fd6aad9d700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac070d10 0x7fd6ac14d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.277+0000 7fd6aad9d700 1 -- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6ac0c5530 msgr2=0x7fd6ac0c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.277+0000 7fd6aad9d700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6ac0c5530 0x7fd6ac0c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.277+0000 7fd6aad9d700 1 -- 172.21.15.118:0/3898264872 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c00a640 con 0x7fd6ac14ed40 2023-07-13T13:52:39.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.279+0000 7fd6aad9d700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac14ed40 0x7fd6ac1dbc00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400eba0 tx=0x7fd6a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:39.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.283+0000 7fd69affd700 1 -- 172.21.15.118:0/3898264872 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4009a80 con 0x7fd6ac14ed40 2023-07-13T13:52:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.283+0000 7fd69affd700 1 -- 172.21.15.118:0/3898264872 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a400f040 con 0x7fd6ac14ed40 2023-07-13T13:52:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.283+0000 7fd69affd700 1 -- 172.21.15.118:0/3898264872 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400cc40 con 0x7fd6ac14ed40 2023-07-13T13:52:39.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.283+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac0c2bd0 con 0x7fd6ac14ed40 2023-07-13T13:52:39.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.283+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac0c3190 con 0x7fd6ac14ed40 2023-07-13T13:52:39.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.284+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac0724b0 con 0x7fd6ac14ed40 2023-07-13T13:52:39.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.534+0000 7fd69affd700 1 -- 172.21.15.118:0/3898264872 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6a4014480 con 0x7fd6ac14ed40 2023-07-13T13:52:39.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.534+0000 7fd69affd700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd68c06ad30 0x7fd68c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.534+0000 7fd6aa59c700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd68c06ad30 0x7fd68c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.535+0000 7fd6aa59c700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd68c06ad30 0x7fd68c06d1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0007fd0 tx=0x7fd6a0007c40 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:39.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.539+0000 7fd69affd700 1 -- 172.21.15.118:0/3898264872 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd6a405d0f0 con 0x7fd6ac14ed40 2023-07-13T13:52:39.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.549+0000 7fd69affd700 1 -- 172.21.15.118:0/3898264872 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd6a4058f00 con 0x7fd6ac14ed40 2023-07-13T13:52:39.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.739+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6ac0c5e00 con 0x7fd6ac14ed40 2023-07-13T13:52:39.732 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.759+0000 7fd69affd700 1 -- 172.21.15.118:0/3898264872 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6a4018020 con 0x7fd6ac14ed40 2023-07-13T13:52:39.733 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-07-13T13:52:39.734 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd68c06ad30 msgr2=0x7fd68c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd68c06ad30 0x7fd68c06d1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0007fd0 tx=0x7fd6a0007c40 comp rx=0 tx=0).stop 2023-07-13T13:52:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac14ed40 msgr2=0x7fd6ac1dbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac14ed40 0x7fd6ac1dbc00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400eba0 tx=0x7fd6a400eeb0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 shutdown_connections 2023-07-13T13:52:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd68c06ad30 0x7fd68c06d1e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.735 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac070d10 0x7fd6ac14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6ac14ed40 0x7fd6ac1dbc00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 --2- 172.21.15.118:0/3898264872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6ac0c5530 0x7fd6ac0c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 >> 172.21.15.118:0/3898264872 conn(0x7fd6ac0cb800 msgr2=0x7fd6ac153be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 shutdown_connections 2023-07-13T13:52:39.736 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.761+0000 7fd6b0a70700 1 -- 172.21.15.118:0/3898264872 wait complete. 2023-07-13T13:52:39.747 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-13T13:52:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.899+0000 7f627cefb700 1 Processor -- start 2023-07-13T13:52:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.899+0000 7f627cefb700 1 -- start start 2023-07-13T13:52:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.900+0000 7f627cefb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6278152970 0x7f6278071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.900+0000 7f627cefb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6278070dd0 0x7f6278069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.900+0000 7f627cefb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6278158b80 con 0x7f6278158640 2023-07-13T13:52:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.900+0000 7f627cefb700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6278158e60 con 0x7f6278152970 2023-07-13T13:52:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.900+0000 7f627cefb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6278159140 con 0x7f6278070dd0 2023-07-13T13:52:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.901+0000 7f627659c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6278152970 0x7f6278071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.901+0000 7f6275d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6278070dd0 0x7f6278069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.901+0000 7f6275d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6278070dd0 0x7f6278069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:58668/0 (socket says 172.21.15.118:58668) 2023-07-13T13:52:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.901+0000 7f6275d9b700 1 -- 172.21.15.118:0/339848301 learned_addr learned my addr 172.21.15.118:0/339848301 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:39.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.904+0000 7f6275d9b700 1 -- 172.21.15.118:0/339848301 >> v2:172.21.15.118:3300/0 conn(0x7f6278152970 msgr2=0x7f6278071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:39.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.904+0000 7f6275d9b700 1 --2- 172.21.15.118:0/339848301 >> v2:172.21.15.118:3300/0 conn(0x7f6278152970 0x7f6278071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.877 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.904+0000 7f6275d9b700 1 -- 172.21.15.118:0/339848301 >> v1:172.21.15.118:6789/0 conn(0x7f6278158640 legacy=0x7f62780c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.904+0000 7f6275d9b700 1 -- 172.21.15.118:0/339848301 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278159420 con 0x7f6278070dd0 2023-07-13T13:52:39.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.906+0000 7f6275d9b700 1 --2- 172.21.15.118:0/339848301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 0x7f6278069f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62780cb3c0 tx=0x7f626c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfb4e0b7994a4116 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:39.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.910+0000 7f627559a700 1 -- 172.21.15.118:0/339848301 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c011830 con 0x7f6278070dd0 2023-07-13T13:52:39.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.910+0000 7f627559a700 1 -- 172.21.15.118:0/339848301 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c011990 con 0x7f6278070dd0 2023-07-13T13:52:39.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.910+0000 7f627559a700 1 -- 172.21.15.118:0/339848301 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c011d20 con 0x7f6278070dd0 2023-07-13T13:52:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.911+0000 7f627cefb700 1 -- 172.21.15.118:0/339848301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 msgr2=0x7f6278069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.911+0000 7f627cefb700 1 --2- 172.21.15.118:0/339848301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 0x7f6278069f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62780cb3c0 tx=0x7f626c009bd0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.911+0000 7f627cefb700 1 -- 172.21.15.118:0/339848301 shutdown_connections 2023-07-13T13:52:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.911+0000 7f627cefb700 1 --2- 172.21.15.118:0/339848301 >> v2:172.21.15.118:3300/0 conn(0x7f6278152970 0x7f6278071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.911+0000 7f627cefb700 1 --2- 172.21.15.118:0/339848301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 0x7f6278069f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.911+0000 7f627cefb700 1 -- 172.21.15.118:0/339848301 >> 172.21.15.118:0/339848301 conn(0x7f627806cf60 msgr2=0x7f627806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.911+0000 7f627cefb700 1 -- 172.21.15.118:0/339848301 shutdown_connections 2023-07-13T13:52:39.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.911+0000 7f627cefb700 1 -- 172.21.15.118:0/339848301 wait complete. 2023-07-13T13:52:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.912+0000 7f627cefb700 1 Processor -- start 2023-07-13T13:52:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.912+0000 7f627cefb700 1 -- start start 2023-07-13T13:52:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.913+0000 7f627cefb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 0x7f6278151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.913+0000 7f627cefb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6278152970 0x7f62781f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.913+0000 7f627cefb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6278158640 0x7f627806e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.913+0000 7f627cefb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278155110 con 0x7f6278152970 2023-07-13T13:52:39.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.913+0000 7f627cefb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627814af10 con 0x7f6278070dd0 2023-07-13T13:52:39.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.913+0000 7f627cefb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62781f1620 con 0x7f6278158640 2023-07-13T13:52:39.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.913+0000 7f6275d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6278152970 0x7f62781f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.914+0000 7f627659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 0x7f6278151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.914+0000 7f6276d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6278158640 0x7f627806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.914+0000 7f6275d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6278152970 0x7f62781f1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41114/0 (socket says 172.21.15.118:41114) 2023-07-13T13:52:39.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.914+0000 7f6275d9b700 1 -- 172.21.15.118:0/2569492158 learned_addr learned my addr 172.21.15.118:0/2569492158 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:39.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.918+0000 7f6275d9b700 1 -- 172.21.15.118:0/2569492158 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6278158640 msgr2=0x7f627806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.918+0000 7f6275d9b700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6278158640 0x7f627806e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.918+0000 7f6275d9b700 1 -- 172.21.15.118:0/2569492158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 msgr2=0x7f6278151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:39.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.918+0000 7f6275d9b700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 0x7f6278151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:39.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.918+0000 7f6275d9b700 1 -- 172.21.15.118:0/2569492158 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009550 con 0x7f6278152970 2023-07-13T13:52:39.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.918+0000 7f627659c700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 0x7f6278151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:39.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.920+0000 7f6275d9b700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6278152970 0x7f62781f1ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f626c000c00 tx=0x7f626c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:39.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.925+0000 7f6266ffd700 1 -- 172.21.15.118:0/2569492158 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c004450 con 0x7f6278152970 2023-07-13T13:52:39.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.925+0000 7f6266ffd700 1 -- 172.21.15.118:0/2569492158 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c0045b0 con 0x7f6278152970 2023-07-13T13:52:39.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.925+0000 7f6266ffd700 1 -- 172.21.15.118:0/2569492158 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0038e0 con 0x7f6278152970 2023-07-13T13:52:39.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.925+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62781ede80 con 0x7f6278152970 2023-07-13T13:52:39.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.926+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62780c3940 con 0x7f6278152970 2023-07-13T13:52:39.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.927+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62781f13f0 con 0x7f6278152970 2023-07-13T13:52:39.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.946+0000 7f6266ffd700 1 -- 172.21.15.118:0/2569492158 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f626c003a40 con 0x7f6278152970 2023-07-13T13:52:39.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.946+0000 7f6266ffd700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f625806ace0 0x7f625806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:39.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.946+0000 7f627659c700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f625806ace0 0x7f625806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:39.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:39.947+0000 7f627659c700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f625806ace0 0x7f625806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6268009fb0 tx=0x7f62680091c0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:40.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.188+0000 7f6266ffd700 1 -- 172.21.15.118:0/2569492158 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f626c05d830 con 0x7f6278152970 2023-07-13T13:52:40.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.188+0000 7f6266ffd700 1 -- 172.21.15.118:0/2569492158 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f626c055bb0 con 0x7f6278152970 2023-07-13T13:52:40.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.374+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f627804e280 con 0x7f6278152970 2023-07-13T13:52:40.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.381+0000 7f6266ffd700 1 -- 172.21.15.118:0/2569492158 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f626c015020 con 0x7f6278152970 2023-07-13T13:52:40.355 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-07-13T13:52:40.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f625806ace0 msgr2=0x7f625806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:40.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f625806ace0 0x7f625806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6268009fb0 tx=0x7f62680091c0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6278152970 msgr2=0x7f62781f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:40.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6278152970 0x7f62781f1ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f626c000c00 tx=0x7f626c004750 comp rx=0 tx=0).stop 2023-07-13T13:52:40.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 shutdown_connections 2023-07-13T13:52:40.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f625806ace0 0x7f625806d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6278070dd0 0x7f6278151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6278158640 0x7f627806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 --2- 172.21.15.118:0/2569492158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6278152970 0x7f62781f1ab0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 >> 172.21.15.118:0/2569492158 conn(0x7f627806cf60 msgr2=0x7f62781568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:40.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 shutdown_connections 2023-07-13T13:52:40.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.384+0000 7f627cefb700 1 -- 172.21.15.118:0/2569492158 wait complete. 2023-07-13T13:52:40.369 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-13T13:52:40.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.520+0000 7f87457c2700 1 Processor -- start 2023-07-13T13:52:40.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.520+0000 7f87457c2700 1 -- start start 2023-07-13T13:52:40.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.521+0000 7f87457c2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f87401507d0 0x7f874015a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:40.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.521+0000 7f87457c2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87400c6fc0 0x7f87400c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:40.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.521+0000 7f87457c2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87400c7900 con 0x7f87401565e0 2023-07-13T13:52:40.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.521+0000 7f87457c2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87400c1820 con 0x7f87401507d0 2023-07-13T13:52:40.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.521+0000 7f87457c2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87400c1b00 con 0x7f87400c6fc0 2023-07-13T13:52:40.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.522+0000 7f873f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87400c6fc0 0x7f87400c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:40.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.522+0000 7f873f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87400c6fc0 0x7f87400c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:38284/0 (socket says 172.21.15.118:38284) 2023-07-13T13:52:40.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.522+0000 7f873f7fe700 1 -- 172.21.15.118:0/1807583450 learned_addr learned my addr 172.21.15.118:0/1807583450 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:40.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.525+0000 7f873f7fe700 1 -- 172.21.15.118:0/1807583450 >> v2:172.21.15.118:3300/0 conn(0x7f87401507d0 msgr2=0x7f874015a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:40.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.525+0000 7f873f7fe700 1 --2- 172.21.15.118:0/1807583450 >> v2:172.21.15.118:3300/0 conn(0x7f87401507d0 0x7f874015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.525+0000 7f873f7fe700 1 -- 172.21.15.118:0/1807583450 >> v1:172.21.15.118:6789/0 conn(0x7f87401565e0 legacy=0x7f874006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:40.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.525+0000 7f873f7fe700 1 -- 172.21.15.118:0/1807583450 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400c1de0 con 0x7f87400c6fc0 2023-07-13T13:52:40.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.527+0000 7f873f7fe700 1 --2- 172.21.15.118:0/1807583450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f87400c73c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8740071e60 tx=0x7f873800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82d35fbf7b1afd98 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:40.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f873dffb700 1 -- 172.21.15.118:0/1807583450 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873800e070 con 0x7f87400c6fc0 2023-07-13T13:52:40.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f873dffb700 1 -- 172.21.15.118:0/1807583450 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8738003a20 con 0x7f87400c6fc0 2023-07-13T13:52:40.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f873dffb700 1 -- 172.21.15.118:0/1807583450 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738003dd0 con 0x7f87400c6fc0 2023-07-13T13:52:40.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f87457c2700 1 -- 172.21.15.118:0/1807583450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 msgr2=0x7f87400c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:40.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f87457c2700 1 --2- 172.21.15.118:0/1807583450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f87400c73c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8740071e60 tx=0x7f873800b330 comp rx=0 tx=0).stop 2023-07-13T13:52:40.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f87457c2700 1 -- 172.21.15.118:0/1807583450 shutdown_connections 2023-07-13T13:52:40.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f87457c2700 1 --2- 172.21.15.118:0/1807583450 >> v2:172.21.15.118:3300/0 conn(0x7f87401507d0 0x7f874015a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f87457c2700 1 --2- 172.21.15.118:0/1807583450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f87400c73c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f87457c2700 1 -- 172.21.15.118:0/1807583450 >> 172.21.15.118:0/1807583450 conn(0x7f874006e060 msgr2=0x7f874006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:40.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f87457c2700 1 -- 172.21.15.118:0/1807583450 shutdown_connections 2023-07-13T13:52:40.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.532+0000 7f87457c2700 1 -- 172.21.15.118:0/1807583450 wait complete. 2023-07-13T13:52:40.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.534+0000 7f87457c2700 1 Processor -- start 2023-07-13T13:52:40.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.534+0000 7f87457c2700 1 -- start start 2023-07-13T13:52:40.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.534+0000 7f87457c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f8740141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:40.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.534+0000 7f87457c2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87401507d0 0x7f87401edf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:40.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.534+0000 7f87457c2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87401565e0 0x7f8740155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:40.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.534+0000 7f87457c2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8740141870 con 0x7f87401565e0 2023-07-13T13:52:40.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.534+0000 7f87457c2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874006b040 con 0x7f87400c6fc0 2023-07-13T13:52:40.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.534+0000 7f87457c2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400ae0d0 con 0x7f87401507d0 2023-07-13T13:52:40.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.535+0000 7f873effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f8740141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:40.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.535+0000 7f873effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f8740141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:38294/0 (socket says 172.21.15.118:38294) 2023-07-13T13:52:40.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.535+0000 7f873effd700 1 -- 172.21.15.118:0/3335439874 learned_addr learned my addr 172.21.15.118:0/3335439874 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:40.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.536+0000 7f873e7fc700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87401507d0 0x7f87401edf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:40.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.539+0000 7f873effd700 1 -- 172.21.15.118:0/3335439874 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87401507d0 msgr2=0x7f87401edf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:40.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.539+0000 7f873effd700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87401507d0 0x7f87401edf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.539+0000 7f873effd700 1 -- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87401565e0 msgr2=0x7f8740155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:40.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.539+0000 7f873effd700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87401565e0 0x7f8740155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.540+0000 7f873effd700 1 -- 172.21.15.118:0/3335439874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8738009b30 con 0x7f87400c6fc0 2023-07-13T13:52:40.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.542+0000 7f873effd700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f8740141330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f873000b530 tx=0x7f873000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:40.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.546+0000 7f87277fe700 1 -- 172.21.15.118:0/3335439874 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730011830 con 0x7f87400c6fc0 2023-07-13T13:52:40.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.546+0000 7f87277fe700 1 -- 172.21.15.118:0/3335439874 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8730011990 con 0x7f87400c6fc0 2023-07-13T13:52:40.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.546+0000 7f87277fe700 1 -- 172.21.15.118:0/3335439874 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730011d20 con 0x7f87400c6fc0 2023-07-13T13:52:40.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.546+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87400ac930 con 0x7f87400c6fc0 2023-07-13T13:52:40.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.546+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874006b270 con 0x7f87400c6fc0 2023-07-13T13:52:40.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.547+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87400708a0 con 0x7f87400c6fc0 2023-07-13T13:52:40.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.573+0000 7f87277fe700 1 -- 172.21.15.118:0/3335439874 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f873001a400 con 0x7f87400c6fc0 2023-07-13T13:52:40.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.573+0000 7f87277fe700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f872c06ad10 0x7f872c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:40.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.573+0000 7f873e7fc700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f872c06ad10 0x7f872c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:40.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.574+0000 7f873e7fc700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f872c06ad10 0x7f872c06d1c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8740148ba0 tx=0x7f87340090e0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:40.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.632+0000 7f87277fe700 1 -- 172.21.15.118:0/3335439874 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f873005c850 con 0x7f87400c6fc0 2023-07-13T13:52:40.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:40.814+0000 7f87277fe700 1 -- 172.21.15.118:0/3335439874 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8730054bd0 con 0x7f87400c6fc0 2023-07-13T13:52:40.981 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.008+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f874004e280 con 0x7f87400c6fc0 2023-07-13T13:52:40.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.016+0000 7f87277fe700 1 -- 172.21.15.118:0/3335439874 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8730015070 con 0x7f87400c6fc0 2023-07-13T13:52:40.989 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T13:52:40.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f872c06ad10 msgr2=0x7f872c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:40.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f872c06ad10 0x7f872c06d1c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8740148ba0 tx=0x7f87340090e0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 msgr2=0x7f8740141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:40.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f8740141330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f873000b530 tx=0x7f873000b840 comp rx=0 tx=0).stop 2023-07-13T13:52:40.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 shutdown_connections 2023-07-13T13:52:40.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f872c06ad10 0x7f872c06d1c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87400c6fc0 0x7f8740141330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f87401565e0 0x7f8740155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 --2- 172.21.15.118:0/3335439874 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87401507d0 0x7f87401edf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:40.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 >> 172.21.15.118:0/3335439874 conn(0x7f874006e060 msgr2=0x7f8740146410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:40.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 shutdown_connections 2023-07-13T13:52:40.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.018+0000 7f87457c2700 1 -- 172.21.15.118:0/3335439874 wait complete. 2023-07-13T13:52:41.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-13T13:52:41.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.154+0000 7f2db3dca700 1 Processor -- start 2023-07-13T13:52:41.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.154+0000 7f2db3dca700 1 -- start start 2023-07-13T13:52:41.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.155+0000 7f2db3dca700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2dac0c7400 0x7f2dac06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.155+0000 7f2db3dca700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0c8d40 con 0x7f2dac0c9810 2023-07-13T13:52:41.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.155+0000 7f2db3dca700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0aeeb0 con 0x7f2dac069f30 2023-07-13T13:52:41.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.155+0000 7f2db3dca700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac0af190 con 0x7f2dac0c7400 2023-07-13T13:52:41.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.156+0000 7f2db1365700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2dac0c9810 0x7f2dac160f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41712/0 (socket says 172.21.15.118:41712) 2023-07-13T13:52:41.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.156+0000 7f2db1365700 1 -- 172.21.15.118:0/2678228594 learned_addr learned my addr 172.21.15.118:0/2678228594 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:41.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.156+0000 7f2db2367700 1 --2- 172.21.15.118:0/2678228594 >> v2:172.21.15.123:3300/0 conn(0x7f2dac0c7400 0x7f2dac06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.159+0000 7f2db0b64700 1 -- 172.21.15.118:0/2678228594 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391750399 0 0) 0x7f2dac0c8d40 con 0x7f2dac0c9810 2023-07-13T13:52:41.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.159+0000 7f2db0b64700 1 -- 172.21.15.118:0/2678228594 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d980035b0 con 0x7f2dac0c9810 2023-07-13T13:52:41.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.160+0000 7f2db2367700 1 -- 172.21.15.118:0/2678228594 >> v1:172.21.15.123:6789/0 conn(0x7f2dac069f30 legacy=0x7f2dac15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.160+0000 7f2db2367700 1 -- 172.21.15.118:0/2678228594 >> v1:172.21.15.118:6789/0 conn(0x7f2dac0c9810 legacy=0x7f2dac160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.160+0000 7f2db2367700 1 -- 172.21.15.118:0/2678228594 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0c7f80 con 0x7f2dac0c7400 2023-07-13T13:52:41.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.162+0000 7f2db2367700 1 --2- 172.21.15.118:0/2678228594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac0c7400 0x7f2dac06ba50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009d90 tx=0x7f2da400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1044f4bbfd2b44af server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:41.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.167+0000 7f2db0b64700 1 -- 172.21.15.118:0/2678228594 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400e070 con 0x7f2dac0c7400 2023-07-13T13:52:41.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.167+0000 7f2db0b64700 1 -- 172.21.15.118:0/2678228594 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400bb20 con 0x7f2dac0c7400 2023-07-13T13:52:41.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.167+0000 7f2db0b64700 1 -- 172.21.15.118:0/2678228594 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4012430 con 0x7f2dac0c7400 2023-07-13T13:52:41.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.168+0000 7f2db3dca700 1 -- 172.21.15.118:0/2678228594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac0c7400 msgr2=0x7f2dac06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.168+0000 7f2db3dca700 1 --2- 172.21.15.118:0/2678228594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac0c7400 0x7f2dac06ba50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009d90 tx=0x7f2da400b330 comp rx=0 tx=0).stop 2023-07-13T13:52:41.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.168+0000 7f2db3dca700 1 -- 172.21.15.118:0/2678228594 shutdown_connections 2023-07-13T13:52:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.168+0000 7f2db3dca700 1 --2- 172.21.15.118:0/2678228594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac0c7400 0x7f2dac06ba50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.168+0000 7f2db3dca700 1 -- 172.21.15.118:0/2678228594 >> 172.21.15.118:0/2678228594 conn(0x7f2dac06ebd0 msgr2=0x7f2dac06efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.168+0000 7f2db3dca700 1 -- 172.21.15.118:0/2678228594 shutdown_connections 2023-07-13T13:52:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.168+0000 7f2db3dca700 1 -- 172.21.15.118:0/2678228594 wait complete. 2023-07-13T13:52:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.169+0000 7f2db3dca700 1 Processor -- start 2023-07-13T13:52:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.169+0000 7f2db3dca700 1 -- start start 2023-07-13T13:52:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db3dca700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac069f30 0x7f2dac0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db3dca700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dac0c7400 0x7f2dac0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db3dca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dac0c9810 0x7f2dac14eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db3dca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac14e090 con 0x7f2dac0c9810 2023-07-13T13:52:41.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db3dca700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0cb680 con 0x7f2dac069f30 2023-07-13T13:52:41.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db3dca700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0cb960 con 0x7f2dac0c7400 2023-07-13T13:52:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db2367700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dac0c9810 0x7f2dac14eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db1b66700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac069f30 0x7f2dac0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.170+0000 7f2db1365700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dac0c7400 0x7f2dac0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.171+0000 7f2db2367700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dac0c9810 0x7f2dac14eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41746/0 (socket says 172.21.15.118:41746) 2023-07-13T13:52:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.171+0000 7f2db2367700 1 -- 172.21.15.118:0/1360910946 learned_addr learned my addr 172.21.15.118:0/1360910946 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:41.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.175+0000 7f2db1b66700 1 -- 172.21.15.118:0/1360910946 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dac0c7400 msgr2=0x7f2dac0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.175+0000 7f2db1b66700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dac0c7400 0x7f2dac0cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.175+0000 7f2db1b66700 1 -- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dac0c9810 msgr2=0x7f2dac14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.175+0000 7f2db1b66700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dac0c9810 0x7f2dac14eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.175+0000 7f2db1b66700 1 -- 172.21.15.118:0/1360910946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4009a70 con 0x7f2dac069f30 2023-07-13T13:52:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.177+0000 7f2db1b66700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac069f30 0x7f2dac0b1fc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c440 tx=0x7f2d9c001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:41.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.179+0000 7f2da27fc700 1 -- 172.21.15.118:0/1360910946 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0052d0 con 0x7f2dac069f30 2023-07-13T13:52:41.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.179+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac0cbc40 con 0x7f2dac069f30 2023-07-13T13:52:41.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.179+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac14e5e0 con 0x7f2dac069f30 2023-07-13T13:52:41.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.180+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac0aea70 con 0x7f2dac069f30 2023-07-13T13:52:41.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.201+0000 7f2da27fc700 1 -- 172.21.15.118:0/1360910946 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c001120 con 0x7f2dac069f30 2023-07-13T13:52:41.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.202+0000 7f2da27fc700 1 -- 172.21.15.118:0/1360910946 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c006a80 con 0x7f2dac069f30 2023-07-13T13:52:41.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.202+0000 7f2da27fc700 1 -- 172.21.15.118:0/1360910946 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d9c006c60 con 0x7f2dac069f30 2023-07-13T13:52:41.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.203+0000 7f2da27fc700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2d9006ace0 0x7f2d9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.203+0000 7f2db1365700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2d9006ace0 0x7f2d9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.203+0000 7f2db1365700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2d9006ace0 0x7f2d9006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2dac1ec5e0 tx=0x7f2da8007dc0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:41.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.207+0000 7f2da27fc700 1 -- 172.21.15.118:0/1360910946 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d9c057960 con 0x7f2dac069f30 2023-07-13T13:52:41.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.442+0000 7f2da27fc700 1 -- 172.21.15.118:0/1360910946 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d9c053ca0 con 0x7f2dac069f30 2023-07-13T13:52:41.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.628+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2dac06deb0 con 0x7f2dac069f30 2023-07-13T13:52:41.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.634+0000 7f2da27fc700 1 -- 172.21.15.118:0/1360910946 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d9c0200a0 con 0x7f2dac069f30 2023-07-13T13:52:41.608 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2023-07-13T13:52:41.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2d9006ace0 msgr2=0x7f2d9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2d9006ace0 0x7f2d9006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2dac1ec5e0 tx=0x7f2da8007dc0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac069f30 msgr2=0x7f2dac0b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac069f30 0x7f2dac0b1fc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c440 tx=0x7f2d9c001e70 comp rx=0 tx=0).stop 2023-07-13T13:52:41.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 shutdown_connections 2023-07-13T13:52:41.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2d9006ace0 0x7f2d9006d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dac069f30 0x7f2dac0b1fc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2dac0c9810 0x7f2dac14eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 --2- 172.21.15.118:0/1360910946 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2dac0c7400 0x7f2dac0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 >> 172.21.15.118:0/1360910946 conn(0x7f2dac06ebd0 msgr2=0x7f2dac0c90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:41.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 shutdown_connections 2023-07-13T13:52:41.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.636+0000 7f2db3dca700 1 -- 172.21.15.118:0/1360910946 wait complete. 2023-07-13T13:52:41.621 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-13T13:52:41.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.772+0000 7f50382fd700 1 Processor -- start 2023-07-13T13:52:41.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.772+0000 7f50382fd700 1 -- start start 2023-07-13T13:52:41.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.773+0000 7f50382fd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f503006e120 0x7f50300caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.773+0000 7f50382fd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5030070660 con 0x7f5030158b10 2023-07-13T13:52:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.773+0000 7f50382fd700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5030158610 con 0x7f5030152af0 2023-07-13T13:52:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.773+0000 7f50382fd700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503006b940 con 0x7f503006e120 2023-07-13T13:52:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.773+0000 7f503689a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5030158b10 0x7f5030158f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41726/0 (socket says 172.21.15.118:41726) 2023-07-13T13:52:41.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.773+0000 7f503689a700 1 -- 172.21.15.118:0/3220177063 learned_addr learned my addr 172.21.15.118:0/3220177063 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:41.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.774+0000 7f5035898700 1 --2- 172.21.15.118:0/3220177063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f503006e120 0x7f50300caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.776+0000 7f5035097700 1 -- 172.21.15.118:0/3220177063 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915579467 0 0) 0x7f5030070660 con 0x7f5030158b10 2023-07-13T13:52:41.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.776+0000 7f5035097700 1 -- 172.21.15.118:0/3220177063 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f501c0035b0 con 0x7f5030158b10 2023-07-13T13:52:41.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.776+0000 7f5035097700 1 -- 172.21.15.118:0/3220177063 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372179868 0 0) 0x7f5030158610 con 0x7f5030152af0 2023-07-13T13:52:41.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.776+0000 7f5035097700 1 -- 172.21.15.118:0/3220177063 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5030070660 con 0x7f5030152af0 2023-07-13T13:52:41.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.777+0000 7f5035898700 1 -- 172.21.15.118:0/3220177063 >> v1:172.21.15.123:6789/0 conn(0x7f5030152af0 legacy=0x7f503006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.777+0000 7f5035898700 1 -- 172.21.15.118:0/3220177063 >> v1:172.21.15.118:6789/0 conn(0x7f5030158b10 legacy=0x7f5030158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.777+0000 7f5035898700 1 -- 172.21.15.118:0/3220177063 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50300c65d0 con 0x7f503006e120 2023-07-13T13:52:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.781+0000 7f5035898700 1 --2- 172.21.15.118:0/3220177063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f503006e120 0x7f50300caeb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5020009870 tx=0x7f5020009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40470e30f0ce340c server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:41.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.784+0000 7f5035097700 1 -- 172.21.15.118:0/3220177063 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020011830 con 0x7f503006e120 2023-07-13T13:52:41.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.786+0000 7f5035097700 1 -- 172.21.15.118:0/3220177063 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5020011990 con 0x7f503006e120 2023-07-13T13:52:41.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.786+0000 7f5035097700 1 -- 172.21.15.118:0/3220177063 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020011d00 con 0x7f503006e120 2023-07-13T13:52:41.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.787+0000 7f50382fd700 1 -- 172.21.15.118:0/3220177063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f503006e120 msgr2=0x7f50300caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.787+0000 7f50382fd700 1 --2- 172.21.15.118:0/3220177063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f503006e120 0x7f50300caeb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5020009870 tx=0x7f5020009b80 comp rx=0 tx=0).stop 2023-07-13T13:52:41.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.787+0000 7f50382fd700 1 -- 172.21.15.118:0/3220177063 shutdown_connections 2023-07-13T13:52:41.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.787+0000 7f50382fd700 1 --2- 172.21.15.118:0/3220177063 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f503006e120 0x7f50300caeb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.787+0000 7f50382fd700 1 -- 172.21.15.118:0/3220177063 >> 172.21.15.118:0/3220177063 conn(0x7f503006ab60 msgr2=0x7f50300ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.787+0000 7f50382fd700 1 -- 172.21.15.118:0/3220177063 shutdown_connections 2023-07-13T13:52:41.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.787+0000 7f50382fd700 1 -- 172.21.15.118:0/3220177063 wait complete. 2023-07-13T13:52:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.788+0000 7f50382fd700 1 Processor -- start 2023-07-13T13:52:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.788+0000 7f50382fd700 1 -- start start 2023-07-13T13:52:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.789+0000 7f50382fd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5030152af0 0x7f503014baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.789+0000 7f50382fd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5030158b10 0x7f50300c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.789+0000 7f50382fd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f503014ddc0 0x7f50300c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.789+0000 7f50382fd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50301f1670 con 0x7f5030158b10 2023-07-13T13:52:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.789+0000 7f50382fd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50301f1950 con 0x7f503014ddc0 2023-07-13T13:52:41.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.789+0000 7f50382fd700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50301f1c30 con 0x7f5030152af0 2023-07-13T13:52:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.790+0000 7f503689a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f503014ddc0 0x7f50300c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.790+0000 7f5035898700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5030158b10 0x7f50300c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.790+0000 7f5035898700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5030158b10 0x7f50300c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41758/0 (socket says 172.21.15.118:41758) 2023-07-13T13:52:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.790+0000 7f5035898700 1 -- 172.21.15.118:0/4035317150 learned_addr learned my addr 172.21.15.118:0/4035317150 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:41.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.791+0000 7f5036099700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5030152af0 0x7f503014baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.794+0000 7f5035898700 1 -- 172.21.15.118:0/4035317150 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5030152af0 msgr2=0x7f503014baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.794+0000 7f5035898700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5030152af0 0x7f503014baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.794+0000 7f5035898700 1 -- 172.21.15.118:0/4035317150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f503014ddc0 msgr2=0x7f50300c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:41.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.794+0000 7f5035898700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f503014ddc0 0x7f50300c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:41.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.794+0000 7f5035898700 1 -- 172.21.15.118:0/4035317150 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50200094a0 con 0x7f5030158b10 2023-07-13T13:52:41.769 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.796+0000 7f5035898700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5030158b10 0x7f50300c9770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5020009bc0 tx=0x7f5020004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:41.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.800+0000 7f5026ffd700 1 -- 172.21.15.118:0/4035317150 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502001a6e0 con 0x7f5030158b10 2023-07-13T13:52:41.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.800+0000 7f5026ffd700 1 -- 172.21.15.118:0/4035317150 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502001a840 con 0x7f5030158b10 2023-07-13T13:52:41.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.800+0000 7f5026ffd700 1 -- 172.21.15.118:0/4035317150 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502001abb0 con 0x7f5030158b10 2023-07-13T13:52:41.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.800+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50301f1f10 con 0x7f5030158b10 2023-07-13T13:52:41.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.800+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503014d1f0 con 0x7f5030158b10 2023-07-13T13:52:41.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.801+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50301f2430 con 0x7f5030158b10 2023-07-13T13:52:41.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.958+0000 7f5026ffd700 1 -- 172.21.15.118:0/4035317150 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5020022070 con 0x7f5030158b10 2023-07-13T13:52:41.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.959+0000 7f5026ffd700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f501406ad60 0x7f501406d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:41.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.959+0000 7f5026ffd700 1 -- 172.21.15.118:0/4035317150 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f502008a880 con 0x7f5030158b10 2023-07-13T13:52:41.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.959+0000 7f5036099700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f501406ad60 0x7f501406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:41.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:41.959+0000 7f5036099700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f501406ad60 0x7f501406d210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f502c0011e0 tx=0x7f502c009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:42.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.064+0000 7f5026ffd700 1 -- 172.21.15.118:0/4035317150 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5020055760 con 0x7f5030158b10 2023-07-13T13:52:42.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.263+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f50300cb4e0 con 0x7f5030158b10 2023-07-13T13:52:42.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.281+0000 7f5026ffd700 1 -- 172.21.15.118:0/4035317150 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5020058d80 con 0x7f5030158b10 2023-07-13T13:52:42.255 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T13:52:42.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f501406ad60 msgr2=0x7f501406d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:42.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f501406ad60 0x7f501406d210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f502c0011e0 tx=0x7f502c009040 comp rx=0 tx=0).stop 2023-07-13T13:52:42.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5030158b10 msgr2=0x7f50300c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:42.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5030158b10 0x7f50300c9770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5020009bc0 tx=0x7f5020004750 comp rx=0 tx=0).stop 2023-07-13T13:52:42.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 shutdown_connections 2023-07-13T13:52:42.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f501406ad60 0x7f501406d210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f503014ddc0 0x7f50300c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5030152af0 0x7f503014baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 --2- 172.21.15.118:0/4035317150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5030158b10 0x7f50300c9770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 >> 172.21.15.118:0/4035317150 conn(0x7f503006e120 msgr2=0x7f503014d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:42.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 shutdown_connections 2023-07-13T13:52:42.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.284+0000 7f50382fd700 1 -- 172.21.15.118:0/4035317150 wait complete. 2023-07-13T13:52:42.269 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-13T13:52:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.418+0000 7f2247060700 1 Processor -- start 2023-07-13T13:52:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.418+0000 7f2247060700 1 -- start start 2023-07-13T13:52:42.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.418+0000 7f2247060700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22400c9210 0x7f22400c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:42.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.418+0000 7f2247060700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22400b4370 0x7f224015be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:42.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.418+0000 7f2247060700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22400c59c0 con 0x7f2240152ce0 2023-07-13T13:52:42.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.418+0000 7f2247060700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22401530b0 con 0x7f22400b4370 2023-07-13T13:52:42.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.418+0000 7f2247060700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22400c9710 con 0x7f22400c9210 2023-07-13T13:52:42.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.419+0000 7f22455fd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22400b4370 0x7f224015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:42.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.419+0000 7f223ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22400c9210 0x7f22400c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:42.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.420+0000 7f22455fd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22400b4370 0x7f224015be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41772/0 (socket says 172.21.15.118:41772) 2023-07-13T13:52:42.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.420+0000 7f22455fd700 1 -- 172.21.15.118:0/1140165446 learned_addr learned my addr 172.21.15.118:0/1140165446 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:42.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.423+0000 7f22455fd700 1 -- 172.21.15.118:0/1140165446 >> v2:172.21.15.123:3300/0 conn(0x7f22400c9210 msgr2=0x7f22400c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:42.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.423+0000 7f22455fd700 1 --2- 172.21.15.118:0/1140165446 >> v2:172.21.15.123:3300/0 conn(0x7f22400c9210 0x7f22400c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.423+0000 7f22455fd700 1 -- 172.21.15.118:0/1140165446 >> v1:172.21.15.123:6789/0 conn(0x7f2240152ce0 legacy=0x7f224006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:42.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.423+0000 7f22455fd700 1 -- 172.21.15.118:0/1140165446 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240158990 con 0x7f22400b4370 2023-07-13T13:52:42.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.425+0000 7f22455fd700 1 --2- 172.21.15.118:0/1140165446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400b4370 0x7f224015be80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f22400cb9e0 tx=0x7f223800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc422a9166ec2491 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:42.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.427+0000 7f223f7fe700 1 -- 172.21.15.118:0/1140165446 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223800e070 con 0x7f22400b4370 2023-07-13T13:52:42.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.428+0000 7f223f7fe700 1 -- 172.21.15.118:0/1140165446 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223800b910 con 0x7f22400b4370 2023-07-13T13:52:42.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.428+0000 7f223f7fe700 1 -- 172.21.15.118:0/1140165446 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223800bcc0 con 0x7f22400b4370 2023-07-13T13:52:42.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.429+0000 7f2247060700 1 -- 172.21.15.118:0/1140165446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400b4370 msgr2=0x7f224015be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:42.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.429+0000 7f2247060700 1 --2- 172.21.15.118:0/1140165446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400b4370 0x7f224015be80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f22400cb9e0 tx=0x7f223800b330 comp rx=0 tx=0).stop 2023-07-13T13:52:42.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.429+0000 7f2247060700 1 -- 172.21.15.118:0/1140165446 shutdown_connections 2023-07-13T13:52:42.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.429+0000 7f2247060700 1 --2- 172.21.15.118:0/1140165446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400b4370 0x7f224015be80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.429+0000 7f2247060700 1 --2- 172.21.15.118:0/1140165446 >> v2:172.21.15.123:3300/0 conn(0x7f22400c9210 0x7f22400c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.429+0000 7f2247060700 1 -- 172.21.15.118:0/1140165446 >> 172.21.15.118:0/1140165446 conn(0x7f224006c7c0 msgr2=0x7f2240071660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:42.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.429+0000 7f2247060700 1 -- 172.21.15.118:0/1140165446 shutdown_connections 2023-07-13T13:52:42.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.429+0000 7f2247060700 1 -- 172.21.15.118:0/1140165446 wait complete. 2023-07-13T13:52:42.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.430+0000 7f2247060700 1 Processor -- start 2023-07-13T13:52:42.404 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.430+0000 7f2247060700 1 -- start start 2023-07-13T13:52:42.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.431+0000 7f2247060700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22400b4370 0x7f22400b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:42.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.431+0000 7f2247060700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400c9210 0x7f224014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:42.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.431+0000 7f2247060700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2240152ce0 0x7f22401f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:42.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.431+0000 7f2247060700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2240156e00 con 0x7f22400c9210 2023-07-13T13:52:42.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.431+0000 7f2247060700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400b2d90 con 0x7f22400b4370 2023-07-13T13:52:42.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.431+0000 7f2247060700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224015b710 con 0x7f2240152ce0 2023-07-13T13:52:42.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.432+0000 7f223ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400c9210 0x7f224014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:42.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.432+0000 7f2244dfc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22400b4370 0x7f22400b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:42.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.432+0000 7f22455fd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2240152ce0 0x7f22401f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:42.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.432+0000 7f223ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400c9210 0x7f224014d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41788/0 (socket says 172.21.15.118:41788) 2023-07-13T13:52:42.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.432+0000 7f223ffff700 1 -- 172.21.15.118:0/1340932901 learned_addr learned my addr 172.21.15.118:0/1340932901 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:42.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.436+0000 7f223ffff700 1 -- 172.21.15.118:0/1340932901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2240152ce0 msgr2=0x7f22401f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:42.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.436+0000 7f223ffff700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2240152ce0 0x7f22401f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.436+0000 7f223ffff700 1 -- 172.21.15.118:0/1340932901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22400b4370 msgr2=0x7f22400b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:42.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.436+0000 7f223ffff700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22400b4370 0x7f22400b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.436+0000 7f223ffff700 1 -- 172.21.15.118:0/1340932901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2238009b30 con 0x7f22400c9210 2023-07-13T13:52:42.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.438+0000 7f223ffff700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400c9210 0x7f224014d1f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f222c00e980 tx=0x7f222c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:42.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.442+0000 7f223d7fa700 1 -- 172.21.15.118:0/1340932901 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c009710 con 0x7f22400c9210 2023-07-13T13:52:42.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.442+0000 7f223d7fa700 1 -- 172.21.15.118:0/1340932901 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c00c690 con 0x7f22400c9210 2023-07-13T13:52:42.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.442+0000 7f223d7fa700 1 -- 172.21.15.118:0/1340932901 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c00ca20 con 0x7f22400c9210 2023-07-13T13:52:42.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.442+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224015b9f0 con 0x7f22400c9210 2023-07-13T13:52:42.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.443+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224014f840 con 0x7f22400c9210 2023-07-13T13:52:42.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.443+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22401f14e0 con 0x7f22400c9210 2023-07-13T13:52:42.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.706+0000 7f223d7fa700 1 -- 172.21.15.118:0/1340932901 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f222c00cb80 con 0x7f22400c9210 2023-07-13T13:52:42.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.707+0000 7f223d7fa700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f222406ade0 0x7f222406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:42.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.707+0000 7f223d7fa700 1 -- 172.21.15.118:0/1340932901 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f222c089d40 con 0x7f22400c9210 2023-07-13T13:52:42.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.707+0000 7f2244dfc700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f222406ade0 0x7f222406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:42.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.707+0000 7f223d7fa700 1 -- 172.21.15.118:0/1340932901 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f222c08a1c0 con 0x7f22400c9210 2023-07-13T13:52:42.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.707+0000 7f2244dfc700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f222406ade0 0x7f222406d290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2234001800 tx=0x7f2234009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:42.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.908+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f22401f14e0 con 0x7f22400c9210 2023-07-13T13:52:42.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.916+0000 7f223d7fa700 1 -- 172.21.15.118:0/1340932901 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f22401f14e0 con 0x7f22400c9210 2023-07-13T13:52:42.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f222406ade0 msgr2=0x7f222406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:42.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f222406ade0 0x7f222406d290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2234001800 tx=0x7f2234009040 comp rx=0 tx=0).stop 2023-07-13T13:52:42.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400c9210 msgr2=0x7f224014d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:42.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400c9210 0x7f224014d1f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f222c00e980 tx=0x7f222c00ec90 comp rx=0 tx=0).stop 2023-07-13T13:52:42.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 shutdown_connections 2023-07-13T13:52:42.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f222406ade0 0x7f222406d290 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22400b4370 0x7f22400b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2240152ce0 0x7f22401f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 --2- 172.21.15.118:0/1340932901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22400c9210 0x7f224014d1f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:42.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 >> 172.21.15.118:0/1340932901 conn(0x7f224006c7c0 msgr2=0x7f22400c3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:42.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 shutdown_connections 2023-07-13T13:52:42.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:42.918+0000 7f2247060700 1 -- 172.21.15.118:0/1340932901 wait complete. 2023-07-13T13:52:42.893 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2023-07-13T13:52:42.906 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2023-07-13T13:52:42.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:42.907 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-13T13:52:42.946 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[152708]: fuse finished with error 0 and tester_r 0 2023-07-13T13:52:42.947 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T13:52:43.046 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T13:52:43.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:52:43.047 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-13T13:52:43.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:43.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.297+0000 7f447a3a0700 1 Processor -- start 2023-07-13T13:52:43.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.297+0000 7f447a3a0700 1 -- start start 2023-07-13T13:52:43.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.298+0000 7f447a3a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c7360 0x7f447406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.298+0000 7f447a3a0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4474156160 0x7f4474160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.298+0000 7f447a3a0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f447415a080 con 0x7f447406de20 2023-07-13T13:52:43.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.298+0000 7f447a3a0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447406e730 con 0x7f4474156160 2023-07-13T13:52:43.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.298+0000 7f447a3a0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740c3270 con 0x7f44740c7360 2023-07-13T13:52:43.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.299+0000 7f447893d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4474156160 0x7f4474160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.299+0000 7f4473fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f447406de20 0x7f44740c2a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41732/0 (socket says 172.21.15.118:41732) 2023-07-13T13:52:43.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.299+0000 7f4473fff700 1 -- 172.21.15.118:0/275106746 learned_addr learned my addr 172.21.15.118:0/275106746 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:43.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.302+0000 7f44737fe700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c7360 0x7f447406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.303+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676555824 0 0) 0x7f447415a080 con 0x7f447406de20 2023-07-13T13:52:43.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.303+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f445c0035b0 con 0x7f447406de20 2023-07-13T13:52:43.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847471172 0 0) 0x7f445c0035b0 con 0x7f447406de20 2023-07-13T13:52:43.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c7360 msgr2=0x7f447406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:43.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c7360 0x7f447406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 >> v2:172.21.15.123:3300/0 conn(0x7f4474156160 msgr2=0x7f4474160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:43.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 --2- 172.21.15.118:0/275106746 >> v2:172.21.15.123:3300/0 conn(0x7f4474156160 0x7f4474160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44740c3550 con 0x7f447406de20 2023-07-13T13:52:43.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402946124 0 0) 0x7f4464001670 con 0x7f447406de20 2023-07-13T13:52:43.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 >> v1:172.21.15.118:6789/0 conn(0x7f447406de20 legacy=0x7f44740c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c7360 0x7f445c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f445c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f445c004d90 0x7f445c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447406e730 con 0x7f445c004080 2023-07-13T13:52:43.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44740c3270 con 0x7f445c004d90 2023-07-13T13:52:43.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.308+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c00bcd0 con 0x7f44740c7360 2023-07-13T13:52:43.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.311+0000 7f44737fe700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f445c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.316+0000 7f44737fe700 1 -- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c7360 msgr2=0x7f445c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:43.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.316+0000 7f44737fe700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c7360 0x7f445c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.316+0000 7f44737fe700 1 -- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f445c004d90 msgr2=0x7f445c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:43.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.316+0000 7f44737fe700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f445c004d90 0x7f445c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.316+0000 7f44737fe700 1 -- 172.21.15.118:0/275106746 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0035b0 con 0x7f445c004080 2023-07-13T13:52:43.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.318+0000 7f44737fe700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f445c004850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4468006fd0 tx=0x7f445c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3b5d13e7cd9940 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:43.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.322+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468004220 con 0x7f445c004080 2023-07-13T13:52:43.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.322+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4468004380 con 0x7f445c004080 2023-07-13T13:52:43.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.322+0000 7f4472ffd700 1 -- 172.21.15.118:0/275106746 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680036a0 con 0x7f445c004080 2023-07-13T13:52:43.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.323+0000 7f447a3a0700 1 -- 172.21.15.118:0/275106746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 msgr2=0x7f445c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.323+0000 7f447a3a0700 1 --2- 172.21.15.118:0/275106746 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f445c004850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4468006fd0 tx=0x7f445c005880 comp rx=0 tx=0).stop 2023-07-13T13:52:43.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.323+0000 7f447893d700 1 -- 172.21.15.118:0/275106746 reap_dead start 2023-07-13T13:52:43.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.323+0000 7f447a3a0700 1 -- 172.21.15.118:0/275106746 shutdown_connections 2023-07-13T13:52:43.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.323+0000 7f447a3a0700 1 -- 172.21.15.118:0/275106746 >> 172.21.15.118:0/275106746 conn(0x7f4474069f30 msgr2=0x7f447406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:43.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.323+0000 7f447a3a0700 1 -- 172.21.15.118:0/275106746 shutdown_connections 2023-07-13T13:52:43.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.323+0000 7f447a3a0700 1 -- 172.21.15.118:0/275106746 wait complete. 2023-07-13T13:52:43.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.325+0000 7f447a3a0700 1 Processor -- start 2023-07-13T13:52:43.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.325+0000 7f447a3a0700 1 -- start start 2023-07-13T13:52:43.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.325+0000 7f447a3a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f44741ec300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.325+0000 7f447a3a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c90e0 0x7f44741ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.325+0000 7f447a3a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4474158440 0x7f44741ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.326+0000 7f447a3a0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44740c8c50 con 0x7f445c004080 2023-07-13T13:52:43.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.326+0000 7f447a3a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44741edcb0 con 0x7f4474158440 2023-07-13T13:52:43.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.326+0000 7f447a3a0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4474157fd0 con 0x7f44740c90e0 2023-07-13T13:52:43.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.326+0000 7f4473fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f44741ec300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.326+0000 7f4473fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f44741ec300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41816/0 (socket says 172.21.15.118:41816) 2023-07-13T13:52:43.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.326+0000 7f4473fff700 1 -- 172.21.15.118:0/3492856350 learned_addr learned my addr 172.21.15.118:0/3492856350 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:43.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.331+0000 7f4473fff700 1 -- 172.21.15.118:0/3492856350 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c90e0 msgr2=0x7f44741ed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.331+0000 7f4473fff700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c90e0 0x7f44741ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.331+0000 7f4473fff700 1 -- 172.21.15.118:0/3492856350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4474158440 msgr2=0x7f44741ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.331+0000 7f4473fff700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4474158440 0x7f44741ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.331+0000 7f4473fff700 1 -- 172.21.15.118:0/3492856350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44740c7d60 con 0x7f445c004080 2023-07-13T13:52:43.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.333+0000 7f4473fff700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f44741ec300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f446400caa0 tx=0x7f446400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:43.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.337+0000 7f4470ff9700 1 -- 172.21.15.118:0/3492856350 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464004c80 con 0x7f445c004080 2023-07-13T13:52:43.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.337+0000 7f4470ff9700 1 -- 172.21.15.118:0/3492856350 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4464004de0 con 0x7f445c004080 2023-07-13T13:52:43.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.337+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44740c8040 con 0x7f445c004080 2023-07-13T13:52:43.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.337+0000 7f4470ff9700 1 -- 172.21.15.118:0/3492856350 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464007310 con 0x7f445c004080 2023-07-13T13:52:43.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.337+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44740c8600 con 0x7f445c004080 2023-07-13T13:52:43.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.338+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447406ee80 con 0x7f445c004080 2023-07-13T13:52:43.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.562+0000 7f4470ff9700 1 -- 172.21.15.118:0/3492856350 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4464007470 con 0x7f445c004080 2023-07-13T13:52:43.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.562+0000 7f4470ff9700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f446006ad60 0x7f446006d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.562+0000 7f44737fe700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f446006ad60 0x7f446006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.563+0000 7f44737fe700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f446006ad60 0x7f446006d210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4474157ef0 tx=0x7f4468011000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:43.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.568+0000 7f4470ff9700 1 -- 172.21.15.118:0/3492856350 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f446405be00 con 0x7f445c004080 2023-07-13T13:52:43.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.603+0000 7f4470ff9700 1 -- 172.21.15.118:0/3492856350 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4464054180 con 0x7f445c004080 2023-07-13T13:52:43.768 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.795+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44740c8f30 con 0x7f445c004080 2023-07-13T13:52:43.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.842+0000 7f4470ff9700 1 -- 172.21.15.118:0/3492856350 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f4464018020 con 0x7f445c004080 2023-07-13T13:52:43.816 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:43.816 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:43.818 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f446006ad60 msgr2=0x7f446006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.818 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f446006ad60 0x7f446006d210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4474157ef0 tx=0x7f4468011000 comp rx=0 tx=0).stop 2023-07-13T13:52:43.818 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 msgr2=0x7f44741ec300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f44741ec300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f446400caa0 tx=0x7f446400ce60 comp rx=0 tx=0).stop 2023-07-13T13:52:43.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 shutdown_connections 2023-07-13T13:52:43.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f446006ad60 0x7f446006d210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4474158440 0x7f44741ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f445c004080 0x7f44741ec300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 --2- 172.21.15.118:0/3492856350 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44740c90e0 0x7f44741ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 >> 172.21.15.118:0/3492856350 conn(0x7f4474069f30 msgr2=0x7f44741554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 shutdown_connections 2023-07-13T13:52:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.845+0000 7f447a3a0700 1 -- 172.21.15.118:0/3492856350 wait complete. 2023-07-13T13:52:43.830 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:43.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.978+0000 7f713d822700 1 Processor -- start 2023-07-13T13:52:43.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.978+0000 7f713d822700 1 -- start start 2023-07-13T13:52:43.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.979+0000 7f713d822700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f71380c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.979+0000 7f713d822700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380716a0 con 0x7f71380c6690 2023-07-13T13:52:43.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.979+0000 7f713d822700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380c6ad0 con 0x7f713814f840 2023-07-13T13:52:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.979+0000 7f713d822700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71380c7f30 con 0x7f7138071a50 2023-07-13T13:52:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.980+0000 7f71377fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f71380c6690 0x7f713815fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41746/0 (socket says 172.21.15.118:41746) 2023-07-13T13:52:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.980+0000 7f71377fe700 1 -- 172.21.15.118:0/4105745174 learned_addr learned my addr 172.21.15.118:0/4105745174 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:43.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.980+0000 7f71367fc700 1 --2- 172.21.15.118:0/4105745174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f71380c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.983+0000 7f7135ffb700 1 -- 172.21.15.118:0/4105745174 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550736838 0 0) 0x7f71380716a0 con 0x7f71380c6690 2023-07-13T13:52:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.983+0000 7f7135ffb700 1 -- 172.21.15.118:0/4105745174 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71200035b0 con 0x7f71380c6690 2023-07-13T13:52:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.983+0000 7f7135ffb700 1 -- 172.21.15.118:0/4105745174 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905811139 0 0) 0x7f71380c6ad0 con 0x7f713814f840 2023-07-13T13:52:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.983+0000 7f7135ffb700 1 -- 172.21.15.118:0/4105745174 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71380716a0 con 0x7f713814f840 2023-07-13T13:52:43.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.983+0000 7f71367fc700 1 -- 172.21.15.118:0/4105745174 >> v1:172.21.15.123:6789/0 conn(0x7f713814f840 legacy=0x7f71380cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.983+0000 7f71367fc700 1 -- 172.21.15.118:0/4105745174 >> v1:172.21.15.118:6789/0 conn(0x7f71380c6690 legacy=0x7f713815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.983+0000 7f71367fc700 1 -- 172.21.15.118:0/4105745174 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138156130 con 0x7f7138071a50 2023-07-13T13:52:43.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.985+0000 7f71367fc700 1 --2- 172.21.15.118:0/4105745174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f71380c89d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7128009870 tx=0x7f7128009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc7ff6a81838a6d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:43.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.989+0000 7f7135ffb700 1 -- 172.21.15.118:0/4105745174 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128011830 con 0x7f7138071a50 2023-07-13T13:52:43.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f7135ffb700 1 -- 172.21.15.118:0/4105745174 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7128011990 con 0x7f7138071a50 2023-07-13T13:52:43.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f7135ffb700 1 -- 172.21.15.118:0/4105745174 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128011d20 con 0x7f7138071a50 2023-07-13T13:52:43.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f713d822700 1 -- 172.21.15.118:0/4105745174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 msgr2=0x7f71380c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f713d822700 1 --2- 172.21.15.118:0/4105745174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f71380c89d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7128009870 tx=0x7f7128009b80 comp rx=0 tx=0).stop 2023-07-13T13:52:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f713d822700 1 -- 172.21.15.118:0/4105745174 shutdown_connections 2023-07-13T13:52:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f713d822700 1 --2- 172.21.15.118:0/4105745174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f71380c89d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f713d822700 1 -- 172.21.15.118:0/4105745174 >> 172.21.15.118:0/4105745174 conn(0x7f713806cf10 msgr2=0x7f713806d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f713d822700 1 -- 172.21.15.118:0/4105745174 shutdown_connections 2023-07-13T13:52:43.964 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.990+0000 7f713d822700 1 -- 172.21.15.118:0/4105745174 wait complete. 2023-07-13T13:52:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.992+0000 7f713d822700 1 Processor -- start 2023-07-13T13:52:43.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.992+0000 7f713d822700 1 -- start start 2023-07-13T13:52:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.992+0000 7f713d822700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f713814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.992+0000 7f713d822700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71380c6690 0x7f7138156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.992+0000 7f713d822700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f713814f840 0x7f71381ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.992+0000 7f713d822700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71381ed790 con 0x7f713814f840 2023-07-13T13:52:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.992+0000 7f713d822700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71381eda70 con 0x7f71380c6690 2023-07-13T13:52:43.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.992+0000 7f713d822700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71381edd50 con 0x7f7138071a50 2023-07-13T13:52:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.993+0000 7f71377fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f713814f840 0x7f71381ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.993+0000 7f71367fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71380c6690 0x7f7138156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.993+0000 7f7136ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f713814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:43.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.993+0000 7f71377fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f713814f840 0x7f71381ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41820/0 (socket says 172.21.15.118:41820) 2023-07-13T13:52:43.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.993+0000 7f71377fe700 1 -- 172.21.15.118:0/1683963902 learned_addr learned my addr 172.21.15.118:0/1683963902 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:43.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.998+0000 7f7136ffd700 1 -- 172.21.15.118:0/1683963902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71380c6690 msgr2=0x7f7138156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.998+0000 7f7136ffd700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71380c6690 0x7f7138156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.998+0000 7f7136ffd700 1 -- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f713814f840 msgr2=0x7f71381ea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:43.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.998+0000 7f7136ffd700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f713814f840 0x7f71381ea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:43.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.998+0000 7f7136ffd700 1 -- 172.21.15.118:0/1683963902 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280094a0 con 0x7f7138071a50 2023-07-13T13:52:43.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:43.998+0000 7f71367fc700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71380c6690 0x7f7138156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:43.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.000+0000 7f7136ffd700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f713814d7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f712c00c3c0 tx=0x7f712c001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:43.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.004+0000 7f711ffff700 1 -- 172.21.15.118:0/1683963902 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0052d0 con 0x7f7138071a50 2023-07-13T13:52:43.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.004+0000 7f711ffff700 1 -- 172.21.15.118:0/1683963902 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c005450 con 0x7f7138071a50 2023-07-13T13:52:43.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.004+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71381ee030 con 0x7f7138071a50 2023-07-13T13:52:43.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.004+0000 7f711ffff700 1 -- 172.21.15.118:0/1683963902 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0038c0 con 0x7f7138071a50 2023-07-13T13:52:43.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.004+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713814e180 con 0x7f7138071a50 2023-07-13T13:52:43.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.005+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7138073940 con 0x7f7138071a50 2023-07-13T13:52:44.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.029+0000 7f711ffff700 1 -- 172.21.15.118:0/1683963902 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f712c003a20 con 0x7f7138071a50 2023-07-13T13:52:44.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.029+0000 7f711ffff700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f712406ad30 0x7f712406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:44.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.029+0000 7f71367fc700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f712406ad30 0x7f712406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:44.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.030+0000 7f71367fc700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f712406ad30 0x7f712406d1e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7138071e20 tx=0x7f7128008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:44.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.258+0000 7f711ffff700 1 -- 172.21.15.118:0/1683963902 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f712c05b8e0 con 0x7f7138071a50 2023-07-13T13:52:44.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.268+0000 7f711ffff700 1 -- 172.21.15.118:0/1683963902 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f712c053c60 con 0x7f7138071a50 2023-07-13T13:52:44.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.453+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71381ea0b0 con 0x7f7138071a50 2023-07-13T13:52:44.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.644+0000 7f711ffff700 1 -- 172.21.15.118:0/1683963902 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f712c017020 con 0x7f7138071a50 2023-07-13T13:52:44.618 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:44.618 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.646+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f712406ad30 msgr2=0x7f712406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f712406ad30 0x7f712406d1e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7138071e20 tx=0x7f7128008030 comp rx=0 tx=0).stop 2023-07-13T13:52:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 msgr2=0x7f713814d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f713814d7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f712c00c3c0 tx=0x7f712c001e70 comp rx=0 tx=0).stop 2023-07-13T13:52:44.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 shutdown_connections 2023-07-13T13:52:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f712406ad30 0x7f712406d1e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f713814f840 0x7f71381ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7138071a50 0x7f713814d7d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 --2- 172.21.15.118:0/1683963902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71380c6690 0x7f7138156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 >> 172.21.15.118:0/1683963902 conn(0x7f713806cf10 msgr2=0x7f713814b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 shutdown_connections 2023-07-13T13:52:44.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.647+0000 7f713d822700 1 -- 172.21.15.118:0/1683963902 wait complete. 2023-07-13T13:52:44.633 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-13T13:52:44.769 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.796+0000 7ff0a0d3a700 1 Processor -- start 2023-07-13T13:52:44.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.796+0000 7ff0a0d3a700 1 -- start start 2023-07-13T13:52:44.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.797+0000 7ff0a0d3a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff09c0b36d0 0x7ff09c15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:44.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.797+0000 7ff0a0d3a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c159630 con 0x7ff09c159200 2023-07-13T13:52:44.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.797+0000 7ff0a0d3a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c158740 con 0x7ff09c0b3aa0 2023-07-13T13:52:44.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.797+0000 7ff0a0d3a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0c3af0 con 0x7ff09c0b36d0 2023-07-13T13:52:44.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.798+0000 7ff09ad9d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff09c159200 0x7ff09c06ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41750/0 (socket says 172.21.15.118:41750) 2023-07-13T13:52:44.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.798+0000 7ff09ad9d700 1 -- 172.21.15.118:0/3887896749 learned_addr learned my addr 172.21.15.118:0/3887896749 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:44.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.798+0000 7ff09a59c700 1 --2- 172.21.15.118:0/3887896749 >> v2:172.21.15.123:3300/0 conn(0x7ff09c0b36d0 0x7ff09c15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.801+0000 7ff09959a700 1 -- 172.21.15.118:0/3887896749 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425574446 0 0) 0x7ff09c159630 con 0x7ff09c159200 2023-07-13T13:52:44.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.801+0000 7ff09959a700 1 -- 172.21.15.118:0/3887896749 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0840035b0 con 0x7ff09c159200 2023-07-13T13:52:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.801+0000 7ff09a59c700 1 -- 172.21.15.118:0/3887896749 >> v1:172.21.15.123:6789/0 conn(0x7ff09c0b3aa0 legacy=0x7ff09c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.801+0000 7ff09a59c700 1 -- 172.21.15.118:0/3887896749 >> v1:172.21.15.118:6789/0 conn(0x7ff09c159200 legacy=0x7ff09c06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:44.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.801+0000 7ff09a59c700 1 -- 172.21.15.118:0/3887896749 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0c3dd0 con 0x7ff09c0b36d0 2023-07-13T13:52:44.778 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.805+0000 7ff09a59c700 1 --2- 172.21.15.118:0/3887896749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b36d0 0x7ff09c15bcb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff090009840 tx=0x7ff090009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5afb572a6a4355b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:44.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.809+0000 7ff09959a700 1 -- 172.21.15.118:0/3887896749 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090004230 con 0x7ff09c0b36d0 2023-07-13T13:52:44.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.809+0000 7ff09959a700 1 -- 172.21.15.118:0/3887896749 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff090004390 con 0x7ff09c0b36d0 2023-07-13T13:52:44.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.809+0000 7ff09959a700 1 -- 172.21.15.118:0/3887896749 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0900036c0 con 0x7ff09c0b36d0 2023-07-13T13:52:44.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.810+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/3887896749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b36d0 msgr2=0x7ff09c15bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:44.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.810+0000 7ff0a0d3a700 1 --2- 172.21.15.118:0/3887896749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b36d0 0x7ff09c15bcb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff090009840 tx=0x7ff090009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:44.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.810+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/3887896749 shutdown_connections 2023-07-13T13:52:44.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.810+0000 7ff0a0d3a700 1 --2- 172.21.15.118:0/3887896749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b36d0 0x7ff09c15bcb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:44.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.810+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/3887896749 >> 172.21.15.118:0/3887896749 conn(0x7ff09c071840 msgr2=0x7ff09c06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:44.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.810+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/3887896749 shutdown_connections 2023-07-13T13:52:44.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.810+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/3887896749 wait complete. 2023-07-13T13:52:44.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.811+0000 7ff0a0d3a700 1 Processor -- start 2023-07-13T13:52:44.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.811+0000 7ff0a0d3a700 1 -- start start 2023-07-13T13:52:44.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.812+0000 7ff0a0d3a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff09c0b36d0 0x7ff09c1f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:44.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.812+0000 7ff0a0d3a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b3aa0 0x7ff09c06bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:44.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.812+0000 7ff0a0d3a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff09c159200 0x7ff09c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:44.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.812+0000 7ff0a0d3a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c1eef20 con 0x7ff09c0b36d0 2023-07-13T13:52:44.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.812+0000 7ff0a0d3a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c1f2620 con 0x7ff09c0b3aa0 2023-07-13T13:52:44.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.812+0000 7ff0a0d3a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c1ee350 con 0x7ff09c159200 2023-07-13T13:52:44.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.812+0000 7ff09a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff09c0b36d0 0x7ff09c1f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:44.790 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.813+0000 7ff099d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b3aa0 0x7ff09c06bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:44.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.813+0000 7ff09ad9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff09c159200 0x7ff09c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:44.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.813+0000 7ff09a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff09c0b36d0 0x7ff09c1f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41824/0 (socket says 172.21.15.118:41824) 2023-07-13T13:52:44.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.813+0000 7ff099d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b3aa0 0x7ff09c06bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:38372/0 (socket says 172.21.15.118:38372) 2023-07-13T13:52:44.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.813+0000 7ff09a59c700 1 -- 172.21.15.118:0/2958177375 learned_addr learned my addr 172.21.15.118:0/2958177375 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:44.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.817+0000 7ff099d9b700 1 -- 172.21.15.118:0/2958177375 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff09c159200 msgr2=0x7ff09c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:44.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.817+0000 7ff099d9b700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff09c159200 0x7ff09c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:44.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.817+0000 7ff099d9b700 1 -- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff09c0b36d0 msgr2=0x7ff09c1f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:44.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.817+0000 7ff099d9b700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff09c0b36d0 0x7ff09c1f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:44.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.817+0000 7ff099d9b700 1 -- 172.21.15.118:0/2958177375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900094a0 con 0x7ff09c0b3aa0 2023-07-13T13:52:44.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.819+0000 7ff099d9b700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b3aa0 0x7ff09c06bbc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b3ec0 tx=0x7ff08c00c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:44.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.823+0000 7ff08affd700 1 -- 172.21.15.118:0/2958177375 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c012620 con 0x7ff09c0b3aa0 2023-07-13T13:52:44.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.823+0000 7ff08affd700 1 -- 172.21.15.118:0/2958177375 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c012780 con 0x7ff09c0b3aa0 2023-07-13T13:52:44.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.823+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c1ee5f0 con 0x7ff09c0b3aa0 2023-07-13T13:52:44.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.823+0000 7ff08affd700 1 -- 172.21.15.118:0/2958177375 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c012b30 con 0x7ff09c0b3aa0 2023-07-13T13:52:44.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.823+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c1eebb0 con 0x7ff09c0b3aa0 2023-07-13T13:52:44.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:44.824+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c152e70 con 0x7ff09c0b3aa0 2023-07-13T13:52:45.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.070+0000 7ff08affd700 1 -- 172.21.15.118:0/2958177375 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff08c01c460 con 0x7ff09c0b3aa0 2023-07-13T13:52:45.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.070+0000 7ff08affd700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff07c06ad60 0x7ff07c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:45.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.070+0000 7ff09a59c700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff07c06ad60 0x7ff07c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:45.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.071+0000 7ff09a59c700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff07c06ad60 0x7ff07c06d210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff090009b90 tx=0x7ff090010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:45.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.075+0000 7ff08affd700 1 -- 172.21.15.118:0/2958177375 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff08c05cab0 con 0x7ff09c0b3aa0 2023-07-13T13:52:45.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.085+0000 7ff08affd700 1 -- 172.21.15.118:0/2958177375 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff08c054e30 con 0x7ff09c0b3aa0 2023-07-13T13:52:45.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.317+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff09c0c4d50 con 0x7ff09c0b3aa0 2023-07-13T13:52:45.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.854+0000 7ff08affd700 1 -- 172.21.15.118:0/2958177375 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff08c058450 con 0x7ff09c0b3aa0 2023-07-13T13:52:45.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff07c06ad60 msgr2=0x7ff07c06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff07c06ad60 0x7ff07c06d210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff090009b90 tx=0x7ff090010000 comp rx=0 tx=0).stop 2023-07-13T13:52:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b3aa0 msgr2=0x7ff09c06bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b3aa0 0x7ff09c06bbc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b3ec0 tx=0x7ff08c00c6e0 comp rx=0 tx=0).stop 2023-07-13T13:52:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 shutdown_connections 2023-07-13T13:52:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff07c06ad60 0x7ff07c06d210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:45.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff09c159200 0x7ff09c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:45.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff09c0b36d0 0x7ff09c1f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:45.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 --2- 172.21.15.118:0/2958177375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff09c0b3aa0 0x7ff09c06bbc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:45.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 >> 172.21.15.118:0/2958177375 conn(0x7ff09c071840 msgr2=0x7ff09c0cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:45.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 shutdown_connections 2023-07-13T13:52:45.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.856+0000 7ff0a0d3a700 1 -- 172.21.15.118:0/2958177375 wait complete. 2023-07-13T13:52:45.841 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2023-07-13T13:52:45.842 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-13T13:52:45.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.994+0000 7f7ebb80f700 1 Processor -- start 2023-07-13T13:52:45.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.994+0000 7f7ebb80f700 1 -- start start 2023-07-13T13:52:45.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.995+0000 7f7ebb80f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7eb4070dd0 0x7f7eb4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:45.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.995+0000 7f7ebb80f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb4158b80 con 0x7f7eb4158640 2023-07-13T13:52:45.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.995+0000 7f7ebb80f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb4158e60 con 0x7f7eb4152970 2023-07-13T13:52:45.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.995+0000 7f7ebb80f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb4159140 con 0x7f7eb4070dd0 2023-07-13T13:52:45.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.995+0000 7f7eb9dac700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7eb4158640 0x7f7eb40c8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41762/0 (socket says 172.21.15.118:41762) 2023-07-13T13:52:45.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.995+0000 7f7eb9dac700 1 -- 172.21.15.118:0/3238393507 learned_addr learned my addr 172.21.15.118:0/3238393507 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:45.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.996+0000 7f7eb8daa700 1 --2- 172.21.15.118:0/3238393507 >> v2:172.21.15.123:3300/0 conn(0x7f7eb4070dd0 0x7f7eb4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:45.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.998+0000 7f7eabfff700 1 -- 172.21.15.118:0/3238393507 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285969898 0 0) 0x7f7eb4158b80 con 0x7f7eb4158640 2023-07-13T13:52:45.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:45.998+0000 7f7eabfff700 1 -- 172.21.15.118:0/3238393507 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea00035b0 con 0x7f7eb4158640 2023-07-13T13:52:45.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.000+0000 7f7eb8daa700 1 -- 172.21.15.118:0/3238393507 >> v1:172.21.15.123:6789/0 conn(0x7f7eb4152970 legacy=0x7f7eb4071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:45.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.000+0000 7f7eb8daa700 1 -- 172.21.15.118:0/3238393507 >> v1:172.21.15.118:6789/0 conn(0x7f7eb4158640 legacy=0x7f7eb40c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:45.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.000+0000 7f7eb8daa700 1 -- 172.21.15.118:0/3238393507 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4159420 con 0x7f7eb4070dd0 2023-07-13T13:52:45.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.003+0000 7f7eb8daa700 1 --2- 172.21.15.118:0/3238393507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4070dd0 0x7f7eb4069f30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009840 tx=0x7f7ea4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=563ed00a129e9ff4 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:45.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.007+0000 7f7eabfff700 1 -- 172.21.15.118:0/3238393507 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4011830 con 0x7f7eb4070dd0 2023-07-13T13:52:45.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.007+0000 7f7eabfff700 1 -- 172.21.15.118:0/3238393507 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea4011990 con 0x7f7eb4070dd0 2023-07-13T13:52:45.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.007+0000 7f7eabfff700 1 -- 172.21.15.118:0/3238393507 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4011d20 con 0x7f7eb4070dd0 2023-07-13T13:52:45.981 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.008+0000 7f7ebb80f700 1 -- 172.21.15.118:0/3238393507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4070dd0 msgr2=0x7f7eb4069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:45.981 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.008+0000 7f7ebb80f700 1 --2- 172.21.15.118:0/3238393507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4070dd0 0x7f7eb4069f30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009840 tx=0x7f7ea4009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:45.981 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.008+0000 7f7ebb80f700 1 -- 172.21.15.118:0/3238393507 shutdown_connections 2023-07-13T13:52:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.008+0000 7f7ebb80f700 1 --2- 172.21.15.118:0/3238393507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4070dd0 0x7f7eb4069f30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.008+0000 7f7ebb80f700 1 -- 172.21.15.118:0/3238393507 >> 172.21.15.118:0/3238393507 conn(0x7f7eb406cf60 msgr2=0x7f7eb406b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.008+0000 7f7ebb80f700 1 -- 172.21.15.118:0/3238393507 shutdown_connections 2023-07-13T13:52:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.008+0000 7f7ebb80f700 1 -- 172.21.15.118:0/3238393507 wait complete. 2023-07-13T13:52:45.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.009+0000 7f7ebb80f700 1 Processor -- start 2023-07-13T13:52:45.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.009+0000 7f7ebb80f700 1 -- start start 2023-07-13T13:52:45.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.010+0000 7f7ebb80f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7eb4070dd0 0x7f7eb4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:45.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.010+0000 7f7ebb80f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7eb4152970 0x7f7eb4148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:45.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.010+0000 7f7ebb80f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4158640 0x7f7eb4148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:45.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.010+0000 7f7ebb80f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb41e2d60 con 0x7f7eb4070dd0 2023-07-13T13:52:45.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.010+0000 7f7ebb80f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb41534d0 con 0x7f7eb4158640 2023-07-13T13:52:45.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.010+0000 7f7ebb80f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4149510 con 0x7f7eb4152970 2023-07-13T13:52:45.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.011+0000 7f7eb95ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7eb4070dd0 0x7f7eb4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:45.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.011+0000 7f7eb8daa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7eb4152970 0x7f7eb4148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:45.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.011+0000 7f7eb9dac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4158640 0x7f7eb4148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:45.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.011+0000 7f7eb95ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7eb4070dd0 0x7f7eb4154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41840/0 (socket says 172.21.15.118:41840) 2023-07-13T13:52:45.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.011+0000 7f7eb95ab700 1 -- 172.21.15.118:0/2113602004 learned_addr learned my addr 172.21.15.118:0/2113602004 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:45.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.015+0000 7f7eb9dac700 1 -- 172.21.15.118:0/2113602004 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7eb4152970 msgr2=0x7f7eb4148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:45.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.015+0000 7f7eb9dac700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7eb4152970 0x7f7eb4148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:45.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.015+0000 7f7eb9dac700 1 -- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7eb4070dd0 msgr2=0x7f7eb4154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:45.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.015+0000 7f7eb9dac700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7eb4070dd0 0x7f7eb4154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:45.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.015+0000 7f7eb9dac700 1 -- 172.21.15.118:0/2113602004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea40094a0 con 0x7f7eb4158640 2023-07-13T13:52:45.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.017+0000 7f7eb9dac700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4158640 0x7f7eb4148fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00ca80 tx=0x7f7eac00cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:45.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.021+0000 7f7ea9ffb700 1 -- 172.21.15.118:0/2113602004 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00a9e0 con 0x7f7eb4158640 2023-07-13T13:52:45.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.021+0000 7f7ea9ffb700 1 -- 172.21.15.118:0/2113602004 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00ab40 con 0x7f7eb4158640 2023-07-13T13:52:45.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.021+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb4152f90 con 0x7f7eb4158640 2023-07-13T13:52:45.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.021+0000 7f7ea9ffb700 1 -- 172.21.15.118:0/2113602004 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac012400 con 0x7f7eb4158640 2023-07-13T13:52:45.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.021+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb41e4a10 con 0x7f7eb4158640 2023-07-13T13:52:45.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.022+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb404e280 con 0x7f7eb4158640 2023-07-13T13:52:46.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.268+0000 7f7ea9ffb700 1 -- 172.21.15.118:0/2113602004 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7eac01b3b0 con 0x7f7eb4158640 2023-07-13T13:52:46.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.268+0000 7f7ea9ffb700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7e9806ad30 0x7f7e9806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:46.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.268+0000 7f7eb95ab700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7e9806ad30 0x7f7e9806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:46.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.269+0000 7f7eb95ab700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7e9806ad30 0x7f7e9806d1e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0001910 tx=0x7f7eb0009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:46.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.273+0000 7f7ea9ffb700 1 -- 172.21.15.118:0/2113602004 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7eac05c250 con 0x7f7eb4158640 2023-07-13T13:52:46.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.283+0000 7f7ea9ffb700 1 -- 172.21.15.118:0/2113602004 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7eac054680 con 0x7f7eb4158640 2023-07-13T13:52:46.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.513+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7eb40cc050 con 0x7f7eb4158640 2023-07-13T13:52:46.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.990+0000 7f7ea9ffb700 1 -- 172.21.15.118:0/2113602004 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7eac0210c0 con 0x7f7eb4158640 2023-07-13T13:52:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.991+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7e9806ad30 msgr2=0x7f7e9806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.991+0000 7f7ebb80f700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7e9806ad30 0x7f7e9806d1e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0001910 tx=0x7f7eb0009040 comp rx=0 tx=0).stop 2023-07-13T13:52:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4158640 msgr2=0x7f7eb4148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4158640 0x7f7eb4148fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00ca80 tx=0x7f7eac00cd90 comp rx=0 tx=0).stop 2023-07-13T13:52:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 shutdown_connections 2023-07-13T13:52:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7e9806ad30 0x7f7e9806d1e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eb4158640 0x7f7eb4148fd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7eb4070dd0 0x7f7eb4154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 --2- 172.21.15.118:0/2113602004 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7eb4152970 0x7f7eb4148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 >> 172.21.15.118:0/2113602004 conn(0x7f7eb406cf60 msgr2=0x7f7eb406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:46.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 shutdown_connections 2023-07-13T13:52:46.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:46.992+0000 7f7ebb80f700 1 -- 172.21.15.118:0/2113602004 wait complete. 2023-07-13T13:52:46.977 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-07-13T13:52:47.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.130+0000 7fdf44651700 1 Processor -- start 2023-07-13T13:52:47.103 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.130+0000 7fdf44651700 1 -- start start 2023-07-13T13:52:47.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.131+0000 7fdf44651700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf3c0c71c0 0x7fdf3c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:47.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.131+0000 7fdf44651700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c0703b0 0x7fdf3c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:47.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.131+0000 7fdf44651700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3c0c6d30 con 0x7fdf3c152730 2023-07-13T13:52:47.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.131+0000 7fdf44651700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3c0c6440 con 0x7fdf3c0c71c0 2023-07-13T13:52:47.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.131+0000 7fdf44651700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0c8160 con 0x7fdf3c0703b0 2023-07-13T13:52:47.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.131+0000 7fdf41bec700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdf3c0c71c0 0x7fdf3c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:47.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.131+0000 7fdf42bee700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c0703b0 0x7fdf3c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:47.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.132+0000 7fdf42bee700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c0703b0 0x7fdf3c0707e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:46744/0 (socket says 172.21.15.118:46744) 2023-07-13T13:52:47.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.132+0000 7fdf42bee700 1 -- 172.21.15.118:0/1252593947 learned_addr learned my addr 172.21.15.118:0/1252593947 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:47.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.135+0000 7fdf42bee700 1 -- 172.21.15.118:0/1252593947 >> v2:172.21.15.118:3300/0 conn(0x7fdf3c0c71c0 msgr2=0x7fdf3c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:47.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.135+0000 7fdf42bee700 1 --2- 172.21.15.118:0/1252593947 >> v2:172.21.15.118:3300/0 conn(0x7fdf3c0c71c0 0x7fdf3c069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:47.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.135+0000 7fdf42bee700 1 -- 172.21.15.118:0/1252593947 >> v1:172.21.15.118:6789/0 conn(0x7fdf3c152730 legacy=0x7fdf3c15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:47.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.135+0000 7fdf42bee700 1 -- 172.21.15.118:0/1252593947 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c0c66e0 con 0x7fdf3c0703b0 2023-07-13T13:52:47.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.137+0000 7fdf42bee700 1 --2- 172.21.15.118:0/1252593947 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c0703b0 0x7fdf3c0707e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009e50 tx=0x7fdf3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4446141a188c6a25 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:47.114 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.141+0000 7fdf413eb700 1 -- 172.21.15.118:0/1252593947 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400e070 con 0x7fdf3c0703b0 2023-07-13T13:52:47.114 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.141+0000 7fdf413eb700 1 -- 172.21.15.118:0/1252593947 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3400b910 con 0x7fdf3c0703b0 2023-07-13T13:52:47.114 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.141+0000 7fdf413eb700 1 -- 172.21.15.118:0/1252593947 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400bcc0 con 0x7fdf3c0703b0 2023-07-13T13:52:47.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.142+0000 7fdf44651700 1 -- 172.21.15.118:0/1252593947 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c0703b0 msgr2=0x7fdf3c0707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:47.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.142+0000 7fdf44651700 1 --2- 172.21.15.118:0/1252593947 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c0703b0 0x7fdf3c0707e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009e50 tx=0x7fdf3400b330 comp rx=0 tx=0).stop 2023-07-13T13:52:47.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.142+0000 7fdf44651700 1 -- 172.21.15.118:0/1252593947 shutdown_connections 2023-07-13T13:52:47.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.142+0000 7fdf44651700 1 --2- 172.21.15.118:0/1252593947 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c0703b0 0x7fdf3c0707e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:47.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.142+0000 7fdf44651700 1 --2- 172.21.15.118:0/1252593947 >> v2:172.21.15.118:3300/0 conn(0x7fdf3c0c71c0 0x7fdf3c069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:47.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.142+0000 7fdf44651700 1 -- 172.21.15.118:0/1252593947 >> 172.21.15.118:0/1252593947 conn(0x7fdf3c0cb800 msgr2=0x7fdf3c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:47.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.142+0000 7fdf44651700 1 -- 172.21.15.118:0/1252593947 shutdown_connections 2023-07-13T13:52:47.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.142+0000 7fdf44651700 1 -- 172.21.15.118:0/1252593947 wait complete. 2023-07-13T13:52:47.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.143+0000 7fdf44651700 1 Processor -- start 2023-07-13T13:52:47.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.143+0000 7fdf44651700 1 -- start start 2023-07-13T13:52:47.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.144+0000 7fdf44651700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf3c0703b0 0x7fdf3c1eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:47.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.144+0000 7fdf44651700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf3c0c71c0 0x7fdf3c0bb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:47.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.144+0000 7fdf44651700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c152730 0x7fdf3c1e1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:47.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.144+0000 7fdf44651700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c1ef000 con 0x7fdf3c0703b0 2023-07-13T13:52:47.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.144+0000 7fdf44651700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c1e1970 con 0x7fdf3c0c71c0 2023-07-13T13:52:47.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.144+0000 7fdf44651700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c0bd570 con 0x7fdf3c152730 2023-07-13T13:52:47.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.144+0000 7fdf423ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf3c0703b0 0x7fdf3c1eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.144+0000 7fdf41bec700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf3c0c71c0 0x7fdf3c0bb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.145+0000 7fdf423ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf3c0703b0 0x7fdf3c1eeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41858/0 (socket says 172.21.15.118:41858) 2023-07-13T13:52:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.145+0000 7fdf423ed700 1 -- 172.21.15.118:0/3512569016 learned_addr learned my addr 172.21.15.118:0/3512569016 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.145+0000 7fdf42bee700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c152730 0x7fdf3c1e1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:47.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.148+0000 7fdf423ed700 1 -- 172.21.15.118:0/3512569016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c152730 msgr2=0x7fdf3c1e1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:47.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.148+0000 7fdf423ed700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c152730 0x7fdf3c1e1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:47.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.148+0000 7fdf423ed700 1 -- 172.21.15.118:0/3512569016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf3c0c71c0 msgr2=0x7fdf3c0bb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:47.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.148+0000 7fdf423ed700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf3c0c71c0 0x7fdf3c0bb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:47.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.148+0000 7fdf423ed700 1 -- 172.21.15.118:0/3512569016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009b30 con 0x7fdf3c0703b0 2023-07-13T13:52:47.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.151+0000 7fdf423ed700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf3c0703b0 0x7fdf3c1eeac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c450 tx=0x7fdf3800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.155+0000 7fdf32ffd700 1 -- 172.21.15.118:0/3512569016 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf380052d0 con 0x7fdf3c0703b0 2023-07-13T13:52:47.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.156+0000 7fdf32ffd700 1 -- 172.21.15.118:0/3512569016 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf38005430 con 0x7fdf3c0703b0 2023-07-13T13:52:47.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.156+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3c0bd850 con 0x7fdf3c0703b0 2023-07-13T13:52:47.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.156+0000 7fdf32ffd700 1 -- 172.21.15.118:0/3512569016 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf380038c0 con 0x7fdf3c0703b0 2023-07-13T13:52:47.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.156+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3c1e1320 con 0x7fdf3c0703b0 2023-07-13T13:52:47.130 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.157+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3c1e1c50 con 0x7fdf3c0703b0 2023-07-13T13:52:47.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.176+0000 7fdf32ffd700 1 -- 172.21.15.118:0/3512569016 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf38003a20 con 0x7fdf3c0703b0 2023-07-13T13:52:47.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.177+0000 7fdf32ffd700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdf2006ad30 0x7fdf2006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:47.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.177+0000 7fdf41bec700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdf2006ad30 0x7fdf2006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:47.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.177+0000 7fdf41bec700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdf2006ad30 0x7fdf2006d1e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0c47f0 tx=0x7fdf2c009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:47.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.181+0000 7fdf32ffd700 1 -- 172.21.15.118:0/3512569016 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf3805b760 con 0x7fdf3c0703b0 2023-07-13T13:52:47.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.416+0000 7fdf32ffd700 1 -- 172.21.15.118:0/3512569016 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf38053ae0 con 0x7fdf3c0703b0 2023-07-13T13:52:47.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:47.645+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fdf3c0743c0 con 0x7fdf3c0703b0 2023-07-13T13:52:48.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.047+0000 7fdf32ffd700 1 -- 172.21.15.118:0/3512569016 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7fdf3800ce60 con 0x7fdf3c0703b0 2023-07-13T13:52:48.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdf2006ad30 msgr2=0x7fdf2006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdf2006ad30 0x7fdf2006d1e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0c47f0 tx=0x7fdf2c009210 comp rx=0 tx=0).stop 2023-07-13T13:52:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf3c0703b0 msgr2=0x7fdf3c1eeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf3c0703b0 0x7fdf3c1eeac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c450 tx=0x7fdf3800c760 comp rx=0 tx=0).stop 2023-07-13T13:52:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 shutdown_connections 2023-07-13T13:52:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdf2006ad30 0x7fdf2006d1e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdf3c152730 0x7fdf3c1e1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.023 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf3c0703b0 0x7fdf3c1eeac0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.024 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 --2- 172.21.15.118:0/3512569016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf3c0c71c0 0x7fdf3c0bb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.024 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 >> 172.21.15.118:0/3512569016 conn(0x7fdf3c0cb800 msgr2=0x7fdf3c0c2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:48.024 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 shutdown_connections 2023-07-13T13:52:48.024 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.049+0000 7fdf44651700 1 -- 172.21.15.118:0/3512569016 wait complete. 2023-07-13T13:52:48.034 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-13T13:52:48.035 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T13:52:48.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.184+0000 7f594f783700 1 Processor -- start 2023-07-13T13:52:48.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.184+0000 7f594f783700 1 -- start start 2023-07-13T13:52:48.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.185+0000 7f594f783700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f594814f840 0x7f59480c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.185+0000 7f594f783700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59480716a0 con 0x7f59480c6690 2023-07-13T13:52:48.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.185+0000 7f594f783700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59480c7f30 con 0x7f5948071a50 2023-07-13T13:52:48.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.185+0000 7f594f783700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59480c6a80 con 0x7f594814f840 2023-07-13T13:52:48.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.186+0000 7f594d51f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f594814f840 0x7f59480c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.186+0000 7f594cd1e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5948071a50 0x7f59480cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:58440/0 (socket says 172.21.15.118:58440) 2023-07-13T13:52:48.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.186+0000 7f594cd1e700 1 -- 172.21.15.118:0/1398480655 learned_addr learned my addr 172.21.15.118:0/1398480655 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:48.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.189+0000 7f593ffff700 1 -- 172.21.15.118:0/1398480655 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273063555 0 0) 0x7f59480c7f30 con 0x7f5948071a50 2023-07-13T13:52:48.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.189+0000 7f593ffff700 1 -- 172.21.15.118:0/1398480655 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59340035b0 con 0x7f5948071a50 2023-07-13T13:52:48.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.191+0000 7f594d51f700 1 -- 172.21.15.118:0/1398480655 >> v1:172.21.15.123:6789/0 conn(0x7f5948071a50 legacy=0x7f59480cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.191+0000 7f594d51f700 1 -- 172.21.15.118:0/1398480655 >> v1:172.21.15.118:6789/0 conn(0x7f59480c6690 legacy=0x7f594815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.191+0000 7f594d51f700 1 -- 172.21.15.118:0/1398480655 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948156130 con 0x7f594814f840 2023-07-13T13:52:48.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.194+0000 7f594d51f700 1 --2- 172.21.15.118:0/1398480655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f594814f840 0x7f59480c89d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5938009840 tx=0x7f5938009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b29b8a8938eede7 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:48.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.199+0000 7f593ffff700 1 -- 172.21.15.118:0/1398480655 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938011830 con 0x7f594814f840 2023-07-13T13:52:48.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.199+0000 7f593ffff700 1 -- 172.21.15.118:0/1398480655 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5938011990 con 0x7f594814f840 2023-07-13T13:52:48.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.199+0000 7f593ffff700 1 -- 172.21.15.118:0/1398480655 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938011d20 con 0x7f594814f840 2023-07-13T13:52:48.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.199+0000 7f594f783700 1 -- 172.21.15.118:0/1398480655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f594814f840 msgr2=0x7f59480c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.199+0000 7f594f783700 1 --2- 172.21.15.118:0/1398480655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f594814f840 0x7f59480c89d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5938009840 tx=0x7f5938009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:48.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.200+0000 7f594f783700 1 -- 172.21.15.118:0/1398480655 shutdown_connections 2023-07-13T13:52:48.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.200+0000 7f594f783700 1 --2- 172.21.15.118:0/1398480655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f594814f840 0x7f59480c89d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.200+0000 7f594f783700 1 -- 172.21.15.118:0/1398480655 >> 172.21.15.118:0/1398480655 conn(0x7f594806cf10 msgr2=0x7f594806d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:48.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.200+0000 7f594f783700 1 -- 172.21.15.118:0/1398480655 shutdown_connections 2023-07-13T13:52:48.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.200+0000 7f594f783700 1 -- 172.21.15.118:0/1398480655 wait complete. 2023-07-13T13:52:48.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.201+0000 7f594f783700 1 Processor -- start 2023-07-13T13:52:48.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.201+0000 7f594f783700 1 -- start start 2023-07-13T13:52:48.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.202+0000 7f594f783700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5948071a50 0x7f59481ec700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.178 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.202+0000 7f594f783700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59480c6690 0x7f5948149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.202+0000 7f594f783700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f594814f840 0x7f594814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.202+0000 7f594f783700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594806ae20 con 0x7f59480c6690 2023-07-13T13:52:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.202+0000 7f594f783700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59480c5040 con 0x7f594814f840 2023-07-13T13:52:48.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.202+0000 7f594f783700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5948069f30 con 0x7f5948071a50 2023-07-13T13:52:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.202+0000 7f594dd20700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f594814f840 0x7f594814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.203+0000 7f594d51f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5948071a50 0x7f59481ec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.203+0000 7f594cd1e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59480c6690 0x7f5948149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.203+0000 7f594cd1e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59480c6690 0x7f5948149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41876/0 (socket says 172.21.15.118:41876) 2023-07-13T13:52:48.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.203+0000 7f594cd1e700 1 -- 172.21.15.118:0/1460223586 learned_addr learned my addr 172.21.15.118:0/1460223586 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:48.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.207+0000 7f594cd1e700 1 -- 172.21.15.118:0/1460223586 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5948071a50 msgr2=0x7f59481ec700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.207+0000 7f594cd1e700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5948071a50 0x7f59481ec700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.207+0000 7f594cd1e700 1 -- 172.21.15.118:0/1460223586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f594814f840 msgr2=0x7f594814ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.207+0000 7f594cd1e700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f594814f840 0x7f594814ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.207+0000 7f594cd1e700 1 -- 172.21.15.118:0/1460223586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59380094a0 con 0x7f59480c6690 2023-07-13T13:52:48.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.207+0000 7f594dd20700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f594814f840 0x7f594814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:48.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.209+0000 7f594cd1e700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59480c6690 0x7f5948149120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f594400c700 tx=0x7f594400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:48.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.223+0000 7f593dffb700 1 -- 172.21.15.118:0/1460223586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944005d70 con 0x7f59480c6690 2023-07-13T13:52:48.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.223+0000 7f593dffb700 1 -- 172.21.15.118:0/1460223586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59440070d0 con 0x7f59480c6690 2023-07-13T13:52:48.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.223+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594806a210 con 0x7f59480c6690 2023-07-13T13:52:48.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.223+0000 7f593dffb700 1 -- 172.21.15.118:0/1460223586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944007460 con 0x7f59480c6690 2023-07-13T13:52:48.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.223+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594806a7d0 con 0x7f59480c6690 2023-07-13T13:52:48.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.224+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59480c8e70 con 0x7f59480c6690 2023-07-13T13:52:48.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.492+0000 7f593dffb700 1 -- 172.21.15.118:0/1460223586 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59440075c0 con 0x7f59480c6690 2023-07-13T13:52:48.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.492+0000 7f593dffb700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f592c06ad10 0x7f592c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.492+0000 7f593dffb700 1 -- 172.21.15.118:0/1460223586 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5944088f60 con 0x7f59480c6690 2023-07-13T13:52:48.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.492+0000 7f594d51f700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f592c06ad10 0x7f592c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.493+0000 7f593dffb700 1 -- 172.21.15.118:0/1460223586 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59440893a0 con 0x7f59480c6690 2023-07-13T13:52:48.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.493+0000 7f594d51f700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f592c06ad10 0x7f592c06d1c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f59380090b0 tx=0x7f593801c040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:48.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.727+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59480743c0 con 0x7f59480c6690 2023-07-13T13:52:48.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.746+0000 7f593dffb700 1 -- 172.21.15.118:0/1460223586 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6197 (secure 0 0 0) 0x7f5944017090 con 0x7f59480c6690 2023-07-13T13:52:48.720 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:48.720 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1760692596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1760692596},{"type":"v1","addr":"172.21.15.118:6835","nonce":1760692596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3512155037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3512155037},{"type":"v1","addr":"172.21.15.123:6833","nonce":3512155037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/439561314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":439561314},{"type":"v1","addr":"172.21.15.123:6835","nonce":439561314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2359037201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359037201},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359037201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3040631544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3040631544},{"type":"v1","addr":"172.21.15.118:6839","nonce":3040631544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-13T13:52:17.418144+0000","modified":"2023-07-13T13:52:47.871510+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/3588922803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":3588922803},{"type":"v1","addr":"172.21.15.118:6837","nonce":3588922803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-13T13:52:48.722 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f592c06ad10 msgr2=0x7f592c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.722 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f592c06ad10 0x7f592c06d1c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f59380090b0 tx=0x7f593801c040 comp rx=0 tx=0).stop 2023-07-13T13:52:48.723 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59480c6690 msgr2=0x7f5948149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.723 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59480c6690 0x7f5948149120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f594400c700 tx=0x7f594400ca10 comp rx=0 tx=0).stop 2023-07-13T13:52:48.723 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 shutdown_connections 2023-07-13T13:52:48.724 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f592c06ad10 0x7f592c06d1c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.724 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f594814f840 0x7f594814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.724 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5948071a50 0x7f59481ec700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.725 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 --2- 172.21.15.118:0/1460223586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59480c6690 0x7f5948149120 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.725 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 >> 172.21.15.118:0/1460223586 conn(0x7f594806cf10 msgr2=0x7f59480c6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:48.725 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 shutdown_connections 2023-07-13T13:52:48.726 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.748+0000 7f594f783700 1 -- 172.21.15.118:0/1460223586 wait complete. 2023-07-13T13:52:48.726 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 10 2023-07-13T13:52:48.733 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:48.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.881+0000 7f961ab2a700 1 Processor -- start 2023-07-13T13:52:48.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.881+0000 7f961ab2a700 1 -- start start 2023-07-13T13:52:48.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.882+0000 7f961ab2a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f961406de20 0x7f961406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.882+0000 7f961ab2a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f96140c7360 0x7f96140c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.882+0000 7f961ab2a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961415a080 con 0x7f9614156160 2023-07-13T13:52:48.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.882+0000 7f961ab2a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961406e730 con 0x7f96140c7360 2023-07-13T13:52:48.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.882+0000 7f961ab2a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140c2fc0 con 0x7f961406de20 2023-07-13T13:52:48.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.883+0000 7f96188c6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f961406de20 0x7f961406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.883+0000 7f9613fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f96140c7360 0x7f96140c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.883+0000 7f96188c6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f961406de20 0x7f961406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:46766/0 (socket says 172.21.15.118:46766) 2023-07-13T13:52:48.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.883+0000 7f96188c6700 1 -- 172.21.15.118:0/2726269248 learned_addr learned my addr 172.21.15.118:0/2726269248 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:48.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.886+0000 7f9613fff700 1 -- 172.21.15.118:0/2726269248 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f961406de20 msgr2=0x7f961406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:48.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.886+0000 7f9613fff700 1 --2- 172.21.15.118:0/2726269248 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f961406de20 0x7f961406e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.886+0000 7f9613fff700 1 -- 172.21.15.118:0/2726269248 >> v1:172.21.15.123:6789/0 conn(0x7f9614156160 legacy=0x7f96140c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:48.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.886+0000 7f9613fff700 1 -- 172.21.15.118:0/2726269248 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140c3270 con 0x7f96140c7360 2023-07-13T13:52:48.862 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.889+0000 7f9613fff700 1 --2- 172.21.15.118:0/2726269248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96140c7360 0x7f96140c2a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9600009840 tx=0x7f9600009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5556b51d09bf8f84 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.893+0000 7f96137fe700 1 -- 172.21.15.118:0/2726269248 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600004230 con 0x7f96140c7360 2023-07-13T13:52:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.893+0000 7f96137fe700 1 -- 172.21.15.118:0/2726269248 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600004390 con 0x7f96140c7360 2023-07-13T13:52:48.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.893+0000 7f96137fe700 1 -- 172.21.15.118:0/2726269248 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96000036a0 con 0x7f96140c7360 2023-07-13T13:52:48.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.894+0000 7f961ab2a700 1 -- 172.21.15.118:0/2726269248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96140c7360 msgr2=0x7f96140c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.894+0000 7f961ab2a700 1 --2- 172.21.15.118:0/2726269248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96140c7360 0x7f96140c2a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9600009840 tx=0x7f9600009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:48.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.894+0000 7f961ab2a700 1 -- 172.21.15.118:0/2726269248 shutdown_connections 2023-07-13T13:52:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.894+0000 7f961ab2a700 1 --2- 172.21.15.118:0/2726269248 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f961406de20 0x7f961406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.894+0000 7f961ab2a700 1 --2- 172.21.15.118:0/2726269248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96140c7360 0x7f96140c2a80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.894+0000 7f961ab2a700 1 -- 172.21.15.118:0/2726269248 >> 172.21.15.118:0/2726269248 conn(0x7f9614069f30 msgr2=0x7f961406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.894+0000 7f961ab2a700 1 -- 172.21.15.118:0/2726269248 shutdown_connections 2023-07-13T13:52:48.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.894+0000 7f961ab2a700 1 -- 172.21.15.118:0/2726269248 wait complete. 2023-07-13T13:52:48.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.895+0000 7f961ab2a700 1 Processor -- start 2023-07-13T13:52:48.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.895+0000 7f961ab2a700 1 -- start start 2023-07-13T13:52:48.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.896+0000 7f961ab2a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f961406de20 0x7f9614158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.896+0000 7f961ab2a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96140c7360 0x7f96140c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.896+0000 7f961ab2a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9614156160 0x7f9614148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.896+0000 7f961ab2a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140c94b0 con 0x7f96140c7360 2023-07-13T13:52:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.896+0000 7f961ab2a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9614149ec0 con 0x7f961406de20 2023-07-13T13:52:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.896+0000 7f961ab2a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961414e170 con 0x7f9614156160 2023-07-13T13:52:48.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.896+0000 7f9613fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96140c7360 0x7f96140c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.897+0000 7f96188c6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f961406de20 0x7f9614158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.897+0000 7f96190c7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9614156160 0x7f9614148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.897+0000 7f9613fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96140c7360 0x7f96140c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41886/0 (socket says 172.21.15.118:41886) 2023-07-13T13:52:48.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.897+0000 7f9613fff700 1 -- 172.21.15.118:0/1080247964 learned_addr learned my addr 172.21.15.118:0/1080247964 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:48.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.901+0000 7f96190c7700 1 -- 172.21.15.118:0/1080247964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f961406de20 msgr2=0x7f9614158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.901+0000 7f96190c7700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f961406de20 0x7f9614158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.901+0000 7f96190c7700 1 -- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96140c7360 msgr2=0x7f96140c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.901+0000 7f96190c7700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96140c7360 0x7f96140c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:48.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.901+0000 7f96190c7700 1 -- 172.21.15.118:0/1080247964 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000094a0 con 0x7f9614156160 2023-07-13T13:52:48.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.903+0000 7f96190c7700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9614156160 0x7f9614148fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c780 tx=0x7f960c00ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.908+0000 7f96117fa700 1 -- 172.21.15.118:0/1080247964 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c003e10 con 0x7f9614156160 2023-07-13T13:52:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.908+0000 7f96117fa700 1 -- 172.21.15.118:0/1080247964 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c0050d0 con 0x7f9614156160 2023-07-13T13:52:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.908+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9614149c20 con 0x7f9614156160 2023-07-13T13:52:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.908+0000 7f96117fa700 1 -- 172.21.15.118:0/1080247964 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c005480 con 0x7f9614156160 2023-07-13T13:52:48.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.908+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96140c63e0 con 0x7f9614156160 2023-07-13T13:52:48.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.909+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96140c95f0 con 0x7f9614156160 2023-07-13T13:52:48.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.928+0000 7f96117fa700 1 -- 172.21.15.118:0/1080247964 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f960c0055e0 con 0x7f9614156160 2023-07-13T13:52:48.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.929+0000 7f96117fa700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f95f806ad30 0x7f95f806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:48.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.929+0000 7f96188c6700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f95f806ad30 0x7f95f806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:48.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:48.929+0000 7f96188c6700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f95f806ad30 0x7f95f806d1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f960800dfd0 tx=0x7f960800f040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:49.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.041+0000 7f96117fa700 1 -- 172.21.15.118:0/1080247964 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f960c05baf0 con 0x7f9614156160 2023-07-13T13:52:49.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.175+0000 7f96117fa700 1 -- 172.21.15.118:0/1080247964 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f960c053e70 con 0x7f9614156160 2023-07-13T13:52:49.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.370+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96140c95f0 con 0x7f9614156160 2023-07-13T13:52:49.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.418+0000 7f96117fa700 1 -- 172.21.15.118:0/1080247964 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f96140c95f0 con 0x7f9614156160 2023-07-13T13:52:49.391 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:49.391 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:49.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f95f806ad30 msgr2=0x7f95f806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:49.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f95f806ad30 0x7f95f806d1e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f960800dfd0 tx=0x7f960800f040 comp rx=0 tx=0).stop 2023-07-13T13:52:49.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9614156160 msgr2=0x7f9614148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:49.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9614156160 0x7f9614148fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c780 tx=0x7f960c00ca90 comp rx=0 tx=0).stop 2023-07-13T13:52:49.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 shutdown_connections 2023-07-13T13:52:49.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f95f806ad30 0x7f95f806d1e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f961406de20 0x7f9614158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9614156160 0x7f9614148fb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 --2- 172.21.15.118:0/1080247964 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96140c7360 0x7f96140c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 >> 172.21.15.118:0/1080247964 conn(0x7f9614069f30 msgr2=0x7f961414c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:49.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 shutdown_connections 2023-07-13T13:52:49.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.419+0000 7f961ab2a700 1 -- 172.21.15.118:0/1080247964 wait complete. 2023-07-13T13:52:49.406 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-13T13:52:49.406 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T13:52:49.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.555+0000 7fd9ab5d5700 1 Processor -- start 2023-07-13T13:52:49.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.556+0000 7fd9ab5d5700 1 -- start start 2023-07-13T13:52:49.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.556+0000 7fd9ab5d5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9a40c99c0 0x7fd9a40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:49.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.556+0000 7fd9ab5d5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd9a4158390 0x7fd9a4162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:49.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.556+0000 7fd9ab5d5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a40c8b40 con 0x7fd9a40c9d90 2023-07-13T13:52:49.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.556+0000 7fd9ab5d5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a40c9600 con 0x7fd9a4158390 2023-07-13T13:52:49.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.556+0000 7fd9ab5d5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a406c080 con 0x7fd9a40c99c0 2023-07-13T13:52:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.567+0000 7fd9a9b72700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd9a4158390 0x7fd9a4162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.568+0000 7fd9a9b72700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd9a4158390 0x7fd9a4162cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41896/0 (socket says 172.21.15.118:41896) 2023-07-13T13:52:49.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.568+0000 7fd9a9b72700 1 -- 172.21.15.118:0/2396560034 learned_addr learned my addr 172.21.15.118:0/2396560034 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:49.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.570+0000 7fd9a9b72700 1 -- 172.21.15.118:0/2396560034 >> v2:172.21.15.123:3300/0 conn(0x7fd9a40c99c0 msgr2=0x7fd9a40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:49.544 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.570+0000 7fd9a9b72700 1 --2- 172.21.15.118:0/2396560034 >> v2:172.21.15.123:3300/0 conn(0x7fd9a40c99c0 0x7fd9a40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.544 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.570+0000 7fd9a9b72700 1 -- 172.21.15.118:0/2396560034 >> v1:172.21.15.123:6789/0 conn(0x7fd9a40c9d90 legacy=0x7fd9a40c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:49.544 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.570+0000 7fd9a9b72700 1 -- 172.21.15.118:0/2396560034 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a40ca910 con 0x7fd9a4158390 2023-07-13T13:52:49.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.572+0000 7fd9a9b72700 1 --2- 172.21.15.118:0/2396560034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a4158390 0x7fd9a4162cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40cb0b0 tx=0x7fd99c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6533531a045e0391 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:49.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.579+0000 7fd99bfff700 1 -- 172.21.15.118:0/2396560034 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c00e070 con 0x7fd9a4158390 2023-07-13T13:52:49.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.579+0000 7fd99bfff700 1 -- 172.21.15.118:0/2396560034 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c003a20 con 0x7fd9a4158390 2023-07-13T13:52:49.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.579+0000 7fd99bfff700 1 -- 172.21.15.118:0/2396560034 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c003dd0 con 0x7fd9a4158390 2023-07-13T13:52:49.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.580+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/2396560034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a4158390 msgr2=0x7fd9a4162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:49.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.580+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/2396560034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a4158390 0x7fd9a4162cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40cb0b0 tx=0x7fd99c00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:49.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.580+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/2396560034 shutdown_connections 2023-07-13T13:52:49.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.580+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/2396560034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a4158390 0x7fd9a4162cd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.580+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/2396560034 >> v2:172.21.15.123:3300/0 conn(0x7fd9a40c99c0 0x7fd9a40c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.580+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/2396560034 >> 172.21.15.118:0/2396560034 conn(0x7fd9a406c750 msgr2=0x7fd9a406cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:49.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.580+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/2396560034 shutdown_connections 2023-07-13T13:52:49.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.580+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/2396560034 wait complete. 2023-07-13T13:52:49.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.581+0000 7fd9ab5d5700 1 Processor -- start 2023-07-13T13:52:49.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.581+0000 7fd9ab5d5700 1 -- start start 2023-07-13T13:52:49.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.582+0000 7fd9ab5d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a40c99c0 0x7fd9a40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:49.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.582+0000 7fd9ab5d5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd9a40c9d90 0x7fd9a41df540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.582+0000 7fd9ab5d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9a4158390 0x7fd9a4152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.582+0000 7fd9ab5d5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4155270 con 0x7fd9a40c99c0 2023-07-13T13:52:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.582+0000 7fd9ab5d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41e14f0 con 0x7fd9a4158390 2023-07-13T13:52:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.582+0000 7fd9ab5d5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41e17d0 con 0x7fd9a40c9d90 2023-07-13T13:52:49.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.583+0000 7fd9a9371700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a40c99c0 0x7fd9a40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:49.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.583+0000 7fd9a9371700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a40c99c0 0x7fd9a40cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:41906/0 (socket says 172.21.15.118:41906) 2023-07-13T13:52:49.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.583+0000 7fd9a9371700 1 -- 172.21.15.118:0/154265087 learned_addr learned my addr 172.21.15.118:0/154265087 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:49.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.587+0000 7fd9a9371700 1 -- 172.21.15.118:0/154265087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd9a40c9d90 msgr2=0x7fd9a41df540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:49.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.587+0000 7fd9a9371700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd9a40c9d90 0x7fd9a41df540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.587+0000 7fd9a9371700 1 -- 172.21.15.118:0/154265087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9a4158390 msgr2=0x7fd9a4152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:49.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.587+0000 7fd9a9371700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9a4158390 0x7fd9a4152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:49.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.587+0000 7fd9a9371700 1 -- 172.21.15.118:0/154265087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c009b30 con 0x7fd9a40c99c0 2023-07-13T13:52:49.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.590+0000 7fd9a9371700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a40c99c0 0x7fd9a40cb350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000b530 tx=0x7fd9a000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:49.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.592+0000 7fd999ffb700 1 -- 172.21.15.118:0/154265087 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0011830 con 0x7fd9a40c99c0 2023-07-13T13:52:49.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.592+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a4154940 con 0x7fd9a40c99c0 2023-07-13T13:52:49.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.592+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a4154f00 con 0x7fd9a40c99c0 2023-07-13T13:52:49.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.593+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a41550e0 con 0x7fd9a40c99c0 2023-07-13T13:52:49.725 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.752+0000 7fd999ffb700 1 -- 172.21.15.118:0/154265087 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a0011990 con 0x7fd9a40c99c0 2023-07-13T13:52:49.725 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.752+0000 7fd999ffb700 1 -- 172.21.15.118:0/154265087 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0009380 con 0x7fd9a40c99c0 2023-07-13T13:52:49.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.820+0000 7fd999ffb700 1 -- 172.21.15.118:0/154265087 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd9a001a400 con 0x7fd9a40c99c0 2023-07-13T13:52:49.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.820+0000 7fd999ffb700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd98806ad10 0x7fd98806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:49.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.820+0000 7fd999ffb700 1 -- 172.21.15.118:0/154265087 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd9a0089ee0 con 0x7fd9a40c99c0 2023-07-13T13:52:49.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.820+0000 7fd9a8b70700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd98806ad10 0x7fd98806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:49.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.821+0000 7fd9a8b70700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd98806ad10 0x7fd98806d1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9a41548d0 tx=0x7fd994007a20 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:49.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:49.858+0000 7fd999ffb700 1 -- 172.21.15.118:0/154265087 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd9a0054b80 con 0x7fd9a40c99c0 2023-07-13T13:52:50.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.039+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9a40cef60 con 0x7fd98806ad10 2023-07-13T13:52:50.022 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.049+0000 7fd999ffb700 1 -- 172.21.15.118:0/154265087 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367357 (secure 0 0 0) 0x7fd9940050d0 con 0x7fd98806ad10 2023-07-13T13:52:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:50.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd98806ad10 msgr2=0x7fd98806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd98806ad10 0x7fd98806d1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd9a41548d0 tx=0x7fd994007a20 comp rx=0 tx=0).stop 2023-07-13T13:52:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a40c99c0 msgr2=0x7fd9a40cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a40c99c0 0x7fd9a40cb350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000b530 tx=0x7fd9a000b8f0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 shutdown_connections 2023-07-13T13:52:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd98806ad10 0x7fd98806d1c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9a4158390 0x7fd9a4152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd9a40c99c0 0x7fd9a40cb350 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 --2- 172.21.15.118:0/154265087 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd9a40c9d90 0x7fd9a41df540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 >> 172.21.15.118:0/154265087 conn(0x7fd9a406c750 msgr2=0x7fd9a4156170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:50.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 shutdown_connections 2023-07-13T13:52:50.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.052+0000 7fd9ab5d5700 1 -- 172.21.15.118:0/154265087 wait complete. 2023-07-13T13:52:50.030 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T13:52:50.037 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-13T13:52:48.925250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218748,"kb_used_data":2592,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755972,"statfs":{"total":773094113280,"available":772870115328,"internally_reserved":0,"allocated":2654208,"data_stored":2212488,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003047"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886498+0000","last_change":"2023-07-13T13:52:17.926057+0000","last_active":"2023-07-13T13:52:24.886498+0000","last_peered":"2023-07-13T13:52:24.886498+0000","last_clean":"2023-07-13T13:52:24.886498+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T13:52:24.886498+0000","last_undegraded":"2023-07-13T13:52:24.886498+0000","last_fullsized":"2023-07-13T13:52:24.886498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:32:31.730703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928026+0000","last_change":"2023-07-13T13:52:17.952706+0000","last_active":"2023-07-13T13:52:24.928026+0000","last_peered":"2023-07-13T13:52:24.928026+0000","last_clean":"2023-07-13T13:52:24.928026+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T13:52:24.928026+0000","last_undegraded":"2023-07-13T13:52:24.928026+0000","last_fullsized":"2023-07-13T13:52:24.928026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928336+0000","last_change":"2023-07-13T13:52:17.943505+0000","last_active":"2023-07-13T13:52:24.928336+0000","last_peered":"2023-07-13T13:52:24.928336+0000","last_clean":"2023-07-13T13:52:24.928336+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T13:52:24.928336+0000","last_undegraded":"2023-07-13T13:52:24.928336+0000","last_fullsized":"2023-07-13T13:52:24.928336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:42.655686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927626+0000","last_change":"2023-07-13T13:52:17.933893+0000","last_active":"2023-07-13T13:52:24.927626+0000","last_peered":"2023-07-13T13:52:24.927626+0000","last_clean":"2023-07-13T13:52:24.927626+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T13:52:24.927626+0000","last_undegraded":"2023-07-13T13:52:24.927626+0000","last_fullsized":"2023-07-13T13:52:24.927626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:13:20.456240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927809+0000","last_change":"2023-07-13T13:52:17.886730+0000","last_active":"2023-07-13T13:52:24.927809+0000","last_peered":"2023-07-13T13:52:24.927809+0000","last_clean":"2023-07-13T13:52:24.927809+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T13:52:24.927809+0000","last_undegraded":"2023-07-13T13:52:24.927809+0000","last_fullsized":"2023-07-13T13:52:24.927809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:35:09.042667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927978+0000","last_change":"2023-07-13T13:52:17.942599+0000","last_active":"2023-07-13T13:52:24.927978+0000","last_peered":"2023-07-13T13:52:24.927978+0000","last_clean":"2023-07-13T13:52:24.927978+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T13:52:24.927978+0000","last_undegraded":"2023-07-13T13:52:24.927978+0000","last_fullsized":"2023-07-13T13:52:24.927978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:32.256216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930041+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T13:52:24.930041+0000","last_peered":"2023-07-13T13:52:24.930041+0000","last_clean":"2023-07-13T13:52:24.930041+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T13:52:24.930041+0000","last_undegraded":"2023-07-13T13:52:24.930041+0000","last_fullsized":"2023-07-13T13:52:24.930041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:39:57.261271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927323+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T13:52:24.927323+0000","last_peered":"2023-07-13T13:52:24.927323+0000","last_clean":"2023-07-13T13:52:24.927323+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T13:52:24.927323+0000","last_undegraded":"2023-07-13T13:52:24.927323+0000","last_fullsized":"2023-07-13T13:52:24.927323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:15:51.471433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927391+0000","last_change":"2023-07-13T13:52:17.887431+0000","last_active":"2023-07-13T13:52:24.927391+0000","last_peered":"2023-07-13T13:52:24.927391+0000","last_clean":"2023-07-13T13:52:24.927391+0000","last_became_active":"2023-07-13T13:52:17.887217+0000","last_became_peered":"2023-07-13T13:52:17.887217+0000","last_unstale":"2023-07-13T13:52:24.927391+0000","last_undegraded":"2023-07-13T13:52:24.927391+0000","last_fullsized":"2023-07-13T13:52:24.927391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:42:21.528797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929243+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T13:52:24.929243+0000","last_peered":"2023-07-13T13:52:24.929243+0000","last_clean":"2023-07-13T13:52:24.929243+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T13:52:24.929243+0000","last_undegraded":"2023-07-13T13:52:24.929243+0000","last_fullsized":"2023-07-13T13:52:24.929243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:39:57.261271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928606+0000","last_change":"2023-07-13T13:52:17.951567+0000","last_active":"2023-07-13T13:52:24.928606+0000","last_peered":"2023-07-13T13:52:24.928606+0000","last_clean":"2023-07-13T13:52:24.928606+0000","last_became_active":"2023-07-13T13:52:17.951313+0000","last_became_peered":"2023-07-13T13:52:17.951313+0000","last_unstale":"2023-07-13T13:52:24.928606+0000","last_undegraded":"2023-07-13T13:52:24.928606+0000","last_fullsized":"2023-07-13T13:52:24.928606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:38:28.382470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886331+0000","last_change":"2023-07-13T13:52:17.943253+0000","last_active":"2023-07-13T13:52:24.886331+0000","last_peered":"2023-07-13T13:52:24.886331+0000","last_clean":"2023-07-13T13:52:24.886331+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T13:52:24.886331+0000","last_undegraded":"2023-07-13T13:52:24.886331+0000","last_fullsized":"2023-07-13T13:52:24.886331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:44.391054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886211+0000","last_change":"2023-07-13T13:52:17.925230+0000","last_active":"2023-07-13T13:52:24.886211+0000","last_peered":"2023-07-13T13:52:24.886211+0000","last_clean":"2023-07-13T13:52:24.886211+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T13:52:24.886211+0000","last_undegraded":"2023-07-13T13:52:24.886211+0000","last_fullsized":"2023-07-13T13:52:24.886211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:36:06.777414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927582+0000","last_change":"2023-07-13T13:52:17.925445+0000","last_active":"2023-07-13T13:52:24.927582+0000","last_peered":"2023-07-13T13:52:24.927582+0000","last_clean":"2023-07-13T13:52:24.927582+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T13:52:24.927582+0000","last_undegraded":"2023-07-13T13:52:24.927582+0000","last_fullsized":"2023-07-13T13:52:24.927582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:39:08.733896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929915+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T13:52:24.929915+0000","last_peered":"2023-07-13T13:52:24.929915+0000","last_clean":"2023-07-13T13:52:24.929915+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T13:52:24.929915+0000","last_undegraded":"2023-07-13T13:52:24.929915+0000","last_fullsized":"2023-07-13T13:52:24.929915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:24:28.814149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927178+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T13:52:24.927178+0000","last_peered":"2023-07-13T13:52:24.927178+0000","last_clean":"2023-07-13T13:52:24.927178+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T13:52:24.927178+0000","last_undegraded":"2023-07-13T13:52:24.927178+0000","last_fullsized":"2023-07-13T13:52:24.927178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:44:32.655763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927416+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T13:52:24.927416+0000","last_peered":"2023-07-13T13:52:24.927416+0000","last_clean":"2023-07-13T13:52:24.927416+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T13:52:24.927416+0000","last_undegraded":"2023-07-13T13:52:24.927416+0000","last_fullsized":"2023-07-13T13:52:24.927416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:56:45.107513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928765+0000","last_change":"2023-07-13T13:52:17.942704+0000","last_active":"2023-07-13T13:52:24.928765+0000","last_peered":"2023-07-13T13:52:24.928765+0000","last_clean":"2023-07-13T13:52:24.928765+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T13:52:24.928765+0000","last_undegraded":"2023-07-13T13:52:24.928765+0000","last_fullsized":"2023-07-13T13:52:24.928765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:12.764288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886100+0000","last_change":"2023-07-13T13:52:17.934990+0000","last_active":"2023-07-13T13:52:24.886100+0000","last_peered":"2023-07-13T13:52:24.886100+0000","last_clean":"2023-07-13T13:52:24.886100+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T13:52:24.886100+0000","last_undegraded":"2023-07-13T13:52:24.886100+0000","last_fullsized":"2023-07-13T13:52:24.886100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:46:44.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928683+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T13:52:24.928683+0000","last_peered":"2023-07-13T13:52:24.928683+0000","last_clean":"2023-07-13T13:52:24.928683+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T13:52:24.928683+0000","last_undegraded":"2023-07-13T13:52:24.928683+0000","last_fullsized":"2023-07-13T13:52:24.928683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:25:08.080128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930485+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T13:52:24.930485+0000","last_peered":"2023-07-13T13:52:24.930485+0000","last_clean":"2023-07-13T13:52:24.930485+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T13:52:24.930485+0000","last_undegraded":"2023-07-13T13:52:24.930485+0000","last_fullsized":"2023-07-13T13:52:24.930485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:16:21.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927206+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T13:52:24.927206+0000","last_peered":"2023-07-13T13:52:24.927206+0000","last_clean":"2023-07-13T13:52:24.927206+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T13:52:24.927206+0000","last_undegraded":"2023-07-13T13:52:24.927206+0000","last_fullsized":"2023-07-13T13:52:24.927206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:35:36.595395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879195+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T13:52:24.879195+0000","last_peered":"2023-07-13T13:52:24.879195+0000","last_clean":"2023-07-13T13:52:24.879195+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T13:52:24.879195+0000","last_undegraded":"2023-07-13T13:52:24.879195+0000","last_fullsized":"2023-07-13T13:52:24.879195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:05.503930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929402+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T13:52:24.929402+0000","last_peered":"2023-07-13T13:52:24.929402+0000","last_clean":"2023-07-13T13:52:24.929402+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T13:52:24.929402+0000","last_undegraded":"2023-07-13T13:52:24.929402+0000","last_fullsized":"2023-07-13T13:52:24.929402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:03:58.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892101+0000","last_change":"2023-07-13T13:52:17.951443+0000","last_active":"2023-07-13T13:52:24.892101+0000","last_peered":"2023-07-13T13:52:24.892101+0000","last_clean":"2023-07-13T13:52:24.892101+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T13:52:24.892101+0000","last_undegraded":"2023-07-13T13:52:24.892101+0000","last_fullsized":"2023-07-13T13:52:24.892101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:15:13.905216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892221+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T13:52:24.892221+0000","last_peered":"2023-07-13T13:52:24.892221+0000","last_clean":"2023-07-13T13:52:24.892221+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T13:52:24.892221+0000","last_undegraded":"2023-07-13T13:52:24.892221+0000","last_fullsized":"2023-07-13T13:52:24.892221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:25:07.338467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929170+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T13:52:24.929170+0000","last_peered":"2023-07-13T13:52:24.929170+0000","last_clean":"2023-07-13T13:52:24.929170+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T13:52:24.929170+0000","last_undegraded":"2023-07-13T13:52:24.929170+0000","last_fullsized":"2023-07-13T13:52:24.929170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:24:28.814149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928347+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T13:52:24.928347+0000","last_peered":"2023-07-13T13:52:24.928347+0000","last_clean":"2023-07-13T13:52:24.928347+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T13:52:24.928347+0000","last_undegraded":"2023-07-13T13:52:24.928347+0000","last_fullsized":"2023-07-13T13:52:24.928347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:27.502582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927905+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T13:52:24.927905+0000","last_peered":"2023-07-13T13:52:24.927905+0000","last_clean":"2023-07-13T13:52:24.927905+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T13:52:24.927905+0000","last_undegraded":"2023-07-13T13:52:24.927905+0000","last_fullsized":"2023-07-13T13:52:24.927905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.301671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879893+0000","last_change":"2023-07-13T13:52:17.948432+0000","last_active":"2023-07-13T13:52:24.879893+0000","last_peered":"2023-07-13T13:52:24.879893+0000","last_clean":"2023-07-13T13:52:24.879893+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T13:52:24.879893+0000","last_undegraded":"2023-07-13T13:52:24.879893+0000","last_fullsized":"2023-07-13T13:52:24.879893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:56:28.970102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927636+0000","last_change":"2023-07-13T13:52:23.984769+0000","last_active":"2023-07-13T13:52:24.927636+0000","last_peered":"2023-07-13T13:52:24.927636+0000","last_clean":"2023-07-13T13:52:24.927636+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T13:52:24.927636+0000","last_undegraded":"2023-07-13T13:52:24.927636+0000","last_fullsized":"2023-07-13T13:52:24.927636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:04:41.174657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891603+0000","last_change":"2023-07-13T13:52:16.667863+0000","last_active":"2023-07-13T13:52:24.891603+0000","last_peered":"2023-07-13T13:52:24.891603+0000","last_clean":"2023-07-13T13:52:24.891603+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T13:52:24.891603+0000","last_undegraded":"2023-07-13T13:52:24.891603+0000","last_fullsized":"2023-07-13T13:52:24.891603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:26:34.960591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927548+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T13:52:24.927548+0000","last_peered":"2023-07-13T13:52:24.927548+0000","last_clean":"2023-07-13T13:52:24.927548+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T13:52:24.927548+0000","last_undegraded":"2023-07-13T13:52:24.927548+0000","last_fullsized":"2023-07-13T13:52:24.927548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:34:06.937251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927832+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T13:52:24.927832+0000","last_peered":"2023-07-13T13:52:24.927832+0000","last_clean":"2023-07-13T13:52:24.927832+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T13:52:24.927832+0000","last_undegraded":"2023-07-13T13:52:24.927832+0000","last_fullsized":"2023-07-13T13:52:24.927832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:44:38.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879435+0000","last_change":"2023-07-13T13:52:16.607515+0000","last_active":"2023-07-13T13:52:24.879435+0000","last_peered":"2023-07-13T13:52:24.879435+0000","last_clean":"2023-07-13T13:52:24.879435+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T13:52:24.879435+0000","last_undegraded":"2023-07-13T13:52:24.879435+0000","last_fullsized":"2023-07-13T13:52:24.879435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:24:27.668099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927817+0000","last_change":"2023-07-13T13:52:17.934538+0000","last_active":"2023-07-13T13:52:24.927817+0000","last_peered":"2023-07-13T13:52:24.927817+0000","last_clean":"2023-07-13T13:52:24.927817+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T13:52:24.927817+0000","last_undegraded":"2023-07-13T13:52:24.927817+0000","last_fullsized":"2023-07-13T13:52:24.927817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:55:29.065632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927005+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T13:52:24.927005+0000","last_peered":"2023-07-13T13:52:24.927005+0000","last_clean":"2023-07-13T13:52:24.927005+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T13:52:24.927005+0000","last_undegraded":"2023-07-13T13:52:24.927005+0000","last_fullsized":"2023-07-13T13:52:24.927005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:54:23.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927512+0000","last_change":"2023-07-13T13:52:16.668908+0000","last_active":"2023-07-13T13:52:24.927512+0000","last_peered":"2023-07-13T13:52:24.927512+0000","last_clean":"2023-07-13T13:52:24.927512+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T13:52:24.927512+0000","last_undegraded":"2023-07-13T13:52:24.927512+0000","last_fullsized":"2023-07-13T13:52:24.927512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:15:12.759166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879407+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T13:52:24.879407+0000","last_peered":"2023-07-13T13:52:24.879407+0000","last_clean":"2023-07-13T13:52:24.879407+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T13:52:24.879407+0000","last_undegraded":"2023-07-13T13:52:24.879407+0000","last_fullsized":"2023-07-13T13:52:24.879407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:11:59.869006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929061+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T13:52:24.929061+0000","last_peered":"2023-07-13T13:52:24.929061+0000","last_clean":"2023-07-13T13:52:24.929061+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T13:52:24.929061+0000","last_undegraded":"2023-07-13T13:52:24.929061+0000","last_fullsized":"2023-07-13T13:52:24.929061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:11.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928227+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T13:52:24.928227+0000","last_peered":"2023-07-13T13:52:24.928227+0000","last_clean":"2023-07-13T13:52:24.928227+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T13:52:24.928227+0000","last_undegraded":"2023-07-13T13:52:24.928227+0000","last_fullsized":"2023-07-13T13:52:24.928227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:18.698131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879193+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T13:52:24.879193+0000","last_peered":"2023-07-13T13:52:24.879193+0000","last_clean":"2023-07-13T13:52:24.879193+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T13:52:24.879193+0000","last_undegraded":"2023-07-13T13:52:24.879193+0000","last_fullsized":"2023-07-13T13:52:24.879193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:11.920803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879638+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T13:52:24.879638+0000","last_peered":"2023-07-13T13:52:24.879638+0000","last_clean":"2023-07-13T13:52:24.879638+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T13:52:24.879638+0000","last_undegraded":"2023-07-13T13:52:24.879638+0000","last_fullsized":"2023-07-13T13:52:24.879638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:40:03.468109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929117+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T13:52:24.929117+0000","last_peered":"2023-07-13T13:52:24.929117+0000","last_clean":"2023-07-13T13:52:24.929117+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T13:52:24.929117+0000","last_undegraded":"2023-07-13T13:52:24.929117+0000","last_fullsized":"2023-07-13T13:52:24.929117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:34.746141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892115+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T13:52:24.892115+0000","last_peered":"2023-07-13T13:52:24.892115+0000","last_clean":"2023-07-13T13:52:24.892115+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T13:52:24.892115+0000","last_undegraded":"2023-07-13T13:52:24.892115+0000","last_fullsized":"2023-07-13T13:52:24.892115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:45:09.342439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891618+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T13:52:24.891618+0000","last_peered":"2023-07-13T13:52:24.891618+0000","last_clean":"2023-07-13T13:52:24.891618+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T13:52:24.891618+0000","last_undegraded":"2023-07-13T13:52:24.891618+0000","last_fullsized":"2023-07-13T13:52:24.891618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:54:40.996212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:33.640166+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T13:52:33.640166+0000","last_peered":"2023-07-13T13:52:33.640166+0000","last_clean":"2023-07-13T13:52:33.640166+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T13:52:33.640166+0000","last_undegraded":"2023-07-13T13:52:33.640166+0000","last_fullsized":"2023-07-13T13:52:33.640166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:47:20.741487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928282+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T13:52:24.928282+0000","last_peered":"2023-07-13T13:52:24.928282+0000","last_clean":"2023-07-13T13:52:24.928282+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T13:52:24.928282+0000","last_undegraded":"2023-07-13T13:52:24.928282+0000","last_fullsized":"2023-07-13T13:52:24.928282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:37:56.904122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928351+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T13:52:24.928351+0000","last_peered":"2023-07-13T13:52:24.928351+0000","last_clean":"2023-07-13T13:52:24.928351+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T13:52:24.928351+0000","last_undegraded":"2023-07-13T13:52:24.928351+0000","last_fullsized":"2023-07-13T13:52:24.928351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:08.398023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930607+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T13:52:24.930607+0000","last_peered":"2023-07-13T13:52:24.930607+0000","last_clean":"2023-07-13T13:52:24.930607+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T13:52:24.930607+0000","last_undegraded":"2023-07-13T13:52:24.930607+0000","last_fullsized":"2023-07-13T13:52:24.930607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:11:03.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879700+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T13:52:24.879700+0000","last_peered":"2023-07-13T13:52:24.879700+0000","last_clean":"2023-07-13T13:52:24.879700+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T13:52:24.879700+0000","last_undegraded":"2023-07-13T13:52:24.879700+0000","last_fullsized":"2023-07-13T13:52:24.879700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:11:25.930718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879777+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T13:52:24.879777+0000","last_peered":"2023-07-13T13:52:24.879777+0000","last_clean":"2023-07-13T13:52:24.879777+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T13:52:24.879777+0000","last_undegraded":"2023-07-13T13:52:24.879777+0000","last_fullsized":"2023-07-13T13:52:24.879777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:11:10.845693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927068+0000","last_change":"2023-07-13T13:52:16.663350+0000","last_active":"2023-07-13T13:52:24.927068+0000","last_peered":"2023-07-13T13:52:24.927068+0000","last_clean":"2023-07-13T13:52:24.927068+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T13:52:24.927068+0000","last_undegraded":"2023-07-13T13:52:24.927068+0000","last_fullsized":"2023-07-13T13:52:24.927068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:16:40.928511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929053+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T13:52:24.929053+0000","last_peered":"2023-07-13T13:52:24.929053+0000","last_clean":"2023-07-13T13:52:24.929053+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T13:52:24.929053+0000","last_undegraded":"2023-07-13T13:52:24.929053+0000","last_fullsized":"2023-07-13T13:52:24.929053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:09.969490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879939+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T13:52:24.879939+0000","last_peered":"2023-07-13T13:52:24.879939+0000","last_clean":"2023-07-13T13:52:24.879939+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T13:52:24.879939+0000","last_undegraded":"2023-07-13T13:52:24.879939+0000","last_fullsized":"2023-07-13T13:52:24.879939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:22:04.157829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929796+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T13:52:24.929796+0000","last_peered":"2023-07-13T13:52:24.929796+0000","last_clean":"2023-07-13T13:52:24.929796+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T13:52:24.929796+0000","last_undegraded":"2023-07-13T13:52:24.929796+0000","last_fullsized":"2023-07-13T13:52:24.929796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:08.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927667+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T13:52:24.927667+0000","last_peered":"2023-07-13T13:52:24.927667+0000","last_clean":"2023-07-13T13:52:24.927667+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T13:52:24.927667+0000","last_undegraded":"2023-07-13T13:52:24.927667+0000","last_fullsized":"2023-07-13T13:52:24.927667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:36:21.525254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927942+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T13:52:24.927942+0000","last_peered":"2023-07-13T13:52:24.927942+0000","last_clean":"2023-07-13T13:52:24.927942+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T13:52:24.927942+0000","last_undegraded":"2023-07-13T13:52:24.927942+0000","last_fullsized":"2023-07-13T13:52:24.927942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:48.589588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.926948+0000","last_change":"2023-07-13T13:52:16.692808+0000","last_active":"2023-07-13T13:52:24.926948+0000","last_peered":"2023-07-13T13:52:24.926948+0000","last_clean":"2023-07-13T13:52:24.926948+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T13:52:24.926948+0000","last_undegraded":"2023-07-13T13:52:24.926948+0000","last_fullsized":"2023-07-13T13:52:24.926948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:00:42.596139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879892+0000","last_change":"2023-07-13T13:52:17.838408+0000","last_active":"2023-07-13T13:52:24.879892+0000","last_peered":"2023-07-13T13:52:24.879892+0000","last_clean":"2023-07-13T13:52:24.879892+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T13:52:24.879892+0000","last_undegraded":"2023-07-13T13:52:24.879892+0000","last_fullsized":"2023-07-13T13:52:24.879892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:43:05.930281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930256+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T13:52:24.930256+0000","last_peered":"2023-07-13T13:52:24.930256+0000","last_clean":"2023-07-13T13:52:24.930256+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T13:52:24.930256+0000","last_undegraded":"2023-07-13T13:52:24.930256+0000","last_fullsized":"2023-07-13T13:52:24.930256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:05:12.912559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930302+0000","last_change":"2023-07-13T13:52:16.666097+0000","last_active":"2023-07-13T13:52:24.930302+0000","last_peered":"2023-07-13T13:52:24.930302+0000","last_clean":"2023-07-13T13:52:24.930302+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T13:52:24.930302+0000","last_undegraded":"2023-07-13T13:52:24.930302+0000","last_fullsized":"2023-07-13T13:52:24.930302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:11:24.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927205+0000","last_change":"2023-07-13T13:52:17.838908+0000","last_active":"2023-07-13T13:52:24.927205+0000","last_peered":"2023-07-13T13:52:24.927205+0000","last_clean":"2023-07-13T13:52:24.927205+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T13:52:24.927205+0000","last_undegraded":"2023-07-13T13:52:24.927205+0000","last_fullsized":"2023-07-13T13:52:24.927205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:24:00.106035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.885940+0000","last_change":"2023-07-13T13:52:23.993113+0000","last_active":"2023-07-13T13:52:24.885940+0000","last_peered":"2023-07-13T13:52:24.885940+0000","last_clean":"2023-07-13T13:52:24.885940+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T13:52:24.885940+0000","last_undegraded":"2023-07-13T13:52:24.885940+0000","last_fullsized":"2023-07-13T13:52:24.885940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:30:48.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930956+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T13:52:24.930956+0000","last_peered":"2023-07-13T13:52:24.930956+0000","last_clean":"2023-07-13T13:52:24.930956+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T13:52:24.930956+0000","last_undegraded":"2023-07-13T13:52:24.930956+0000","last_fullsized":"2023-07-13T13:52:24.930956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:21:56.804941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927753+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T13:52:24.927753+0000","last_peered":"2023-07-13T13:52:24.927753+0000","last_clean":"2023-07-13T13:52:24.927753+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T13:52:24.927753+0000","last_undegraded":"2023-07-13T13:52:24.927753+0000","last_fullsized":"2023-07-13T13:52:24.927753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:01:04.196253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886100+0000","last_change":"2023-07-13T13:52:23.992085+0000","last_active":"2023-07-13T13:52:24.886100+0000","last_peered":"2023-07-13T13:52:24.886100+0000","last_clean":"2023-07-13T13:52:24.886100+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T13:52:24.886100+0000","last_undegraded":"2023-07-13T13:52:24.886100+0000","last_fullsized":"2023-07-13T13:52:24.886100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:06:27.010221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929367+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T13:52:24.929367+0000","last_peered":"2023-07-13T13:52:24.929367+0000","last_clean":"2023-07-13T13:52:24.929367+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T13:52:24.929367+0000","last_undegraded":"2023-07-13T13:52:24.929367+0000","last_fullsized":"2023-07-13T13:52:24.929367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:01.045136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927219+0000","last_change":"2023-07-13T13:52:17.952164+0000","last_active":"2023-07-13T13:52:24.927219+0000","last_peered":"2023-07-13T13:52:24.927219+0000","last_clean":"2023-07-13T13:52:24.927219+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T13:52:24.927219+0000","last_undegraded":"2023-07-13T13:52:24.927219+0000","last_fullsized":"2023-07-13T13:52:24.927219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:19.822713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886204+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T13:52:24.886204+0000","last_peered":"2023-07-13T13:52:24.886204+0000","last_clean":"2023-07-13T13:52:24.886204+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T13:52:24.886204+0000","last_undegraded":"2023-07-13T13:52:24.886204+0000","last_fullsized":"2023-07-13T13:52:24.886204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:04:58.692798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928015+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T13:52:24.928015+0000","last_peered":"2023-07-13T13:52:24.928015+0000","last_clean":"2023-07-13T13:52:24.928015+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T13:52:24.928015+0000","last_undegraded":"2023-07-13T13:52:24.928015+0000","last_fullsized":"2023-07-13T13:52:24.928015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:04.357880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927647+0000","last_change":"2023-07-13T13:52:17.952349+0000","last_active":"2023-07-13T13:52:24.927647+0000","last_peered":"2023-07-13T13:52:24.927647+0000","last_clean":"2023-07-13T13:52:24.927647+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T13:52:24.927647+0000","last_undegraded":"2023-07-13T13:52:24.927647+0000","last_fullsized":"2023-07-13T13:52:24.927647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:25:07.338467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886269+0000","last_change":"2023-07-13T13:52:23.987269+0000","last_active":"2023-07-13T13:52:24.886269+0000","last_peered":"2023-07-13T13:52:24.886269+0000","last_clean":"2023-07-13T13:52:24.886269+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T13:52:24.886269+0000","last_undegraded":"2023-07-13T13:52:24.886269+0000","last_fullsized":"2023-07-13T13:52:24.886269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:31.468664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879419+0000","last_change":"2023-07-13T13:52:16.607455+0000","last_active":"2023-07-13T13:52:24.879419+0000","last_peered":"2023-07-13T13:52:24.879419+0000","last_clean":"2023-07-13T13:52:24.879419+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T13:52:24.879419+0000","last_undegraded":"2023-07-13T13:52:24.879419+0000","last_fullsized":"2023-07-13T13:52:24.879419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:08.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928550+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T13:52:24.928550+0000","last_peered":"2023-07-13T13:52:24.928550+0000","last_clean":"2023-07-13T13:52:24.928550+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T13:52:24.928550+0000","last_undegraded":"2023-07-13T13:52:24.928550+0000","last_fullsized":"2023-07-13T13:52:24.928550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:05:24.675504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891810+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T13:52:24.891810+0000","last_peered":"2023-07-13T13:52:24.891810+0000","last_clean":"2023-07-13T13:52:24.891810+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T13:52:24.891810+0000","last_undegraded":"2023-07-13T13:52:24.891810+0000","last_fullsized":"2023-07-13T13:52:24.891810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:16:48.281399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927299+0000","last_change":"2023-07-13T13:52:16.692899+0000","last_active":"2023-07-13T13:52:24.927299+0000","last_peered":"2023-07-13T13:52:24.927299+0000","last_clean":"2023-07-13T13:52:24.927299+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T13:52:24.927299+0000","last_undegraded":"2023-07-13T13:52:24.927299+0000","last_fullsized":"2023-07-13T13:52:24.927299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:32:47.704876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928496+0000","last_change":"2023-07-13T13:52:17.942165+0000","last_active":"2023-07-13T13:52:24.928496+0000","last_peered":"2023-07-13T13:52:24.928496+0000","last_clean":"2023-07-13T13:52:24.928496+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T13:52:24.928496+0000","last_undegraded":"2023-07-13T13:52:24.928496+0000","last_fullsized":"2023-07-13T13:52:24.928496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:12:48.876978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930289+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T13:52:24.930289+0000","last_peered":"2023-07-13T13:52:24.930289+0000","last_clean":"2023-07-13T13:52:24.930289+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T13:52:24.930289+0000","last_undegraded":"2023-07-13T13:52:24.930289+0000","last_fullsized":"2023-07-13T13:52:24.930289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:11:32.137556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927452+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T13:52:24.927452+0000","last_peered":"2023-07-13T13:52:24.927452+0000","last_clean":"2023-07-13T13:52:24.927452+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T13:52:24.927452+0000","last_undegraded":"2023-07-13T13:52:24.927452+0000","last_fullsized":"2023-07-13T13:52:24.927452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:03.894064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929645+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T13:52:24.929645+0000","last_peered":"2023-07-13T13:52:24.929645+0000","last_clean":"2023-07-13T13:52:24.929645+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T13:52:24.929645+0000","last_undegraded":"2023-07-13T13:52:24.929645+0000","last_fullsized":"2023-07-13T13:52:24.929645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:35:22.230584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929592+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T13:52:24.929592+0000","last_peered":"2023-07-13T13:52:24.929592+0000","last_clean":"2023-07-13T13:52:24.929592+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T13:52:24.929592+0000","last_undegraded":"2023-07-13T13:52:24.929592+0000","last_fullsized":"2023-07-13T13:52:24.929592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:00:18.335695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879297+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T13:52:24.879297+0000","last_peered":"2023-07-13T13:52:24.879297+0000","last_clean":"2023-07-13T13:52:24.879297+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T13:52:24.879297+0000","last_undegraded":"2023-07-13T13:52:24.879297+0000","last_fullsized":"2023-07-13T13:52:24.879297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:18.698131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892152+0000","last_change":"2023-07-13T13:52:17.949610+0000","last_active":"2023-07-13T13:52:24.892152+0000","last_peered":"2023-07-13T13:52:24.892152+0000","last_clean":"2023-07-13T13:52:24.892152+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T13:52:24.892152+0000","last_undegraded":"2023-07-13T13:52:24.892152+0000","last_fullsized":"2023-07-13T13:52:24.892152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:40.017246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927555+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T13:52:24.927555+0000","last_peered":"2023-07-13T13:52:24.927555+0000","last_clean":"2023-07-13T13:52:24.927555+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T13:52:24.927555+0000","last_undegraded":"2023-07-13T13:52:24.927555+0000","last_fullsized":"2023-07-13T13:52:24.927555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:45:15.549277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891895+0000","last_change":"2023-07-13T13:51:59.916015+0000","last_active":"2023-07-13T13:52:24.891895+0000","last_peered":"2023-07-13T13:52:24.891895+0000","last_clean":"2023-07-13T13:52:24.891895+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T13:52:24.891895+0000","last_undegraded":"2023-07-13T13:52:24.891895+0000","last_fullsized":"2023-07-13T13:52:24.891895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:58:56.377294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928791+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T13:52:24.928791+0000","last_peered":"2023-07-13T13:52:24.928791+0000","last_clean":"2023-07-13T13:52:24.928791+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T13:52:24.928791+0000","last_undegraded":"2023-07-13T13:52:24.928791+0000","last_fullsized":"2023-07-13T13:52:24.928791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:03:57.800032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891909+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T13:52:24.891909+0000","last_peered":"2023-07-13T13:52:24.891909+0000","last_clean":"2023-07-13T13:52:24.891909+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T13:52:24.891909+0000","last_undegraded":"2023-07-13T13:52:24.891909+0000","last_fullsized":"2023-07-13T13:52:24.891909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:42:21.528797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927325+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T13:52:24.927325+0000","last_peered":"2023-07-13T13:52:24.927325+0000","last_clean":"2023-07-13T13:52:24.927325+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T13:52:24.927325+0000","last_undegraded":"2023-07-13T13:52:24.927325+0000","last_fullsized":"2023-07-13T13:52:24.927325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:59:20.772189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927700+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T13:52:24.927700+0000","last_peered":"2023-07-13T13:52:24.927700+0000","last_clean":"2023-07-13T13:52:24.927700+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T13:52:24.927700+0000","last_undegraded":"2023-07-13T13:52:24.927700+0000","last_fullsized":"2023-07-13T13:52:24.927700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:01:43.426649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928641+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T13:52:24.928641+0000","last_peered":"2023-07-13T13:52:24.928641+0000","last_clean":"2023-07-13T13:52:24.928641+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T13:52:24.928641+0000","last_undegraded":"2023-07-13T13:52:24.928641+0000","last_fullsized":"2023-07-13T13:52:24.928641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:59.268490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891765+0000","last_change":"2023-07-13T13:52:17.947909+0000","last_active":"2023-07-13T13:52:24.891765+0000","last_peered":"2023-07-13T13:52:24.891765+0000","last_clean":"2023-07-13T13:52:24.891765+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T13:52:24.891765+0000","last_undegraded":"2023-07-13T13:52:24.891765+0000","last_fullsized":"2023-07-13T13:52:24.891765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:53:25.856736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886512+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T13:52:24.886512+0000","last_peered":"2023-07-13T13:52:24.886512+0000","last_clean":"2023-07-13T13:52:24.886512+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T13:52:24.886512+0000","last_undegraded":"2023-07-13T13:52:24.886512+0000","last_fullsized":"2023-07-13T13:52:24.886512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:27:42.531825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886027+0000","last_change":"2023-07-13T13:52:01.224691+0000","last_active":"2023-07-13T13:52:24.886027+0000","last_peered":"2023-07-13T13:52:24.886027+0000","last_clean":"2023-07-13T13:52:24.886027+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T13:52:24.886027+0000","last_undegraded":"2023-07-13T13:52:24.886027+0000","last_fullsized":"2023-07-13T13:52:24.886027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:51.173302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891536+0000","last_change":"2023-07-13T13:52:16.668065+0000","last_active":"2023-07-13T13:52:24.891536+0000","last_peered":"2023-07-13T13:52:24.891536+0000","last_clean":"2023-07-13T13:52:24.891536+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T13:52:24.891536+0000","last_undegraded":"2023-07-13T13:52:24.891536+0000","last_fullsized":"2023-07-13T13:52:24.891536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:24:28.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892038+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T13:52:24.892038+0000","last_peered":"2023-07-13T13:52:24.892038+0000","last_clean":"2023-07-13T13:52:24.892038+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T13:52:24.892038+0000","last_undegraded":"2023-07-13T13:52:24.892038+0000","last_fullsized":"2023-07-13T13:52:24.892038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:49:06.930579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928758+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T13:52:24.928758+0000","last_peered":"2023-07-13T13:52:24.928758+0000","last_clean":"2023-07-13T13:52:24.928758+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T13:52:24.928758+0000","last_undegraded":"2023-07-13T13:52:24.928758+0000","last_fullsized":"2023-07-13T13:52:24.928758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:18.127640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927999+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T13:52:24.927999+0000","last_peered":"2023-07-13T13:52:24.927999+0000","last_clean":"2023-07-13T13:52:24.927999+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T13:52:24.927999+0000","last_undegraded":"2023-07-13T13:52:24.927999+0000","last_fullsized":"2023-07-13T13:52:24.927999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:03:53.732745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929281+0000","last_change":"2023-07-13T13:51:57.962882+0000","last_active":"2023-07-13T13:52:24.929281+0000","last_peered":"2023-07-13T13:52:24.929281+0000","last_clean":"2023-07-13T13:52:24.929281+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T13:52:24.929281+0000","last_undegraded":"2023-07-13T13:52:24.929281+0000","last_fullsized":"2023-07-13T13:52:24.929281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_clean_scrub_stamp":"2023-07-13T13:51:55.598839+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:58.978619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879350+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T13:52:24.879350+0000","last_peered":"2023-07-13T13:52:24.879350+0000","last_clean":"2023-07-13T13:52:24.879350+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T13:52:24.879350+0000","last_undegraded":"2023-07-13T13:52:24.879350+0000","last_fullsized":"2023-07-13T13:52:24.879350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:03:57.800032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927892+0000","last_change":"2023-07-13T13:52:17.942525+0000","last_active":"2023-07-13T13:52:24.927892+0000","last_peered":"2023-07-13T13:52:24.927892+0000","last_clean":"2023-07-13T13:52:24.927892+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T13:52:24.927892+0000","last_undegraded":"2023-07-13T13:52:24.927892+0000","last_fullsized":"2023-07-13T13:52:24.927892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:00:29.156794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930844+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T13:52:24.930844+0000","last_peered":"2023-07-13T13:52:24.930844+0000","last_clean":"2023-07-13T13:52:24.930844+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T13:52:24.930844+0000","last_undegraded":"2023-07-13T13:52:24.930844+0000","last_fullsized":"2023-07-13T13:52:24.930844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:05:12.912559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929506+0000","last_change":"2023-07-13T13:52:00.016430+0000","last_active":"2023-07-13T13:52:24.929506+0000","last_peered":"2023-07-13T13:52:24.929506+0000","last_clean":"2023-07-13T13:52:24.929506+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T13:52:24.929506+0000","last_undegraded":"2023-07-13T13:52:24.929506+0000","last_fullsized":"2023-07-13T13:52:24.929506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:11:41.680948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.926955+0000","last_change":"2023-07-13T13:52:16.630297+0000","last_active":"2023-07-13T13:52:24.926955+0000","last_peered":"2023-07-13T13:52:24.926955+0000","last_clean":"2023-07-13T13:52:24.926955+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T13:52:24.926955+0000","last_undegraded":"2023-07-13T13:52:24.926955+0000","last_fullsized":"2023-07-13T13:52:24.926955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:53:24.710686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927322+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T13:52:24.927322+0000","last_peered":"2023-07-13T13:52:24.927322+0000","last_clean":"2023-07-13T13:52:24.927322+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T13:52:24.927322+0000","last_undegraded":"2023-07-13T13:52:24.927322+0000","last_fullsized":"2023-07-13T13:52:24.927322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:23:18.465639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927124+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T13:52:24.927124+0000","last_peered":"2023-07-13T13:52:24.927124+0000","last_clean":"2023-07-13T13:52:24.927124+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T13:52:24.927124+0000","last_undegraded":"2023-07-13T13:52:24.927124+0000","last_fullsized":"2023-07-13T13:52:24.927124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:15:57.574963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929249+0000","last_change":"2023-07-13T13:52:00.019670+0000","last_active":"2023-07-13T13:52:24.929249+0000","last_peered":"2023-07-13T13:52:24.929249+0000","last_clean":"2023-07-13T13:52:24.929249+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T13:52:24.929249+0000","last_undegraded":"2023-07-13T13:52:24.929249+0000","last_fullsized":"2023-07-13T13:52:24.929249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:19.305122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892015+0000","last_change":"2023-07-13T13:52:16.668244+0000","last_active":"2023-07-13T13:52:24.892015+0000","last_peered":"2023-07-13T13:52:24.892015+0000","last_clean":"2023-07-13T13:52:24.892015+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T13:52:24.892015+0000","last_undegraded":"2023-07-13T13:52:24.892015+0000","last_fullsized":"2023-07-13T13:52:24.892015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:56:43.961463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927745+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T13:52:24.927745+0000","last_peered":"2023-07-13T13:52:24.927745+0000","last_clean":"2023-07-13T13:52:24.927745+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T13:52:24.927745+0000","last_undegraded":"2023-07-13T13:52:24.927745+0000","last_fullsized":"2023-07-13T13:52:24.927745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:12:41.254584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929834+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T13:52:24.929834+0000","last_peered":"2023-07-13T13:52:24.929834+0000","last_clean":"2023-07-13T13:52:24.929834+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T13:52:24.929834+0000","last_undegraded":"2023-07-13T13:52:24.929834+0000","last_fullsized":"2023-07-13T13:52:24.929834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:37:00.550738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.880010+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T13:52:24.880010+0000","last_peered":"2023-07-13T13:52:24.880010+0000","last_clean":"2023-07-13T13:52:24.880010+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T13:52:24.880010+0000","last_undegraded":"2023-07-13T13:52:24.880010+0000","last_fullsized":"2023-07-13T13:52:24.880010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:13:01.211759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891905+0000","last_change":"2023-07-13T13:51:59.757569+0000","last_active":"2023-07-13T13:52:24.891905+0000","last_peered":"2023-07-13T13:52:24.891905+0000","last_clean":"2023-07-13T13:52:24.891905+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T13:52:24.891905+0000","last_undegraded":"2023-07-13T13:52:24.891905+0000","last_fullsized":"2023-07-13T13:52:24.891905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:23:00.277581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879225+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T13:52:24.879225+0000","last_peered":"2023-07-13T13:52:24.879225+0000","last_clean":"2023-07-13T13:52:24.879225+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T13:52:24.879225+0000","last_undegraded":"2023-07-13T13:52:24.879225+0000","last_fullsized":"2023-07-13T13:52:24.879225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879206+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T13:52:24.879206+0000","last_peered":"2023-07-13T13:52:24.879206+0000","last_clean":"2023-07-13T13:52:24.879206+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T13:52:24.879206+0000","last_undegraded":"2023-07-13T13:52:24.879206+0000","last_fullsized":"2023-07-13T13:52:24.879206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:48.589588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927710+0000","last_change":"2023-07-13T13:52:00.015919+0000","last_active":"2023-07-13T13:52:24.927710+0000","last_peered":"2023-07-13T13:52:24.927710+0000","last_clean":"2023-07-13T13:52:24.927710+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T13:52:24.927710+0000","last_undegraded":"2023-07-13T13:52:24.927710+0000","last_fullsized":"2023-07-13T13:52:24.927710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:46:47.618201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927436+0000","last_change":"2023-07-13T13:52:16.665545+0000","last_active":"2023-07-13T13:52:24.927436+0000","last_peered":"2023-07-13T13:52:24.927436+0000","last_clean":"2023-07-13T13:52:24.927436+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T13:52:24.927436+0000","last_undegraded":"2023-07-13T13:52:24.927436+0000","last_fullsized":"2023-07-13T13:52:24.927436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:49:05.784529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927636+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T13:52:24.927636+0000","last_peered":"2023-07-13T13:52:24.927636+0000","last_clean":"2023-07-13T13:52:24.927636+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T13:52:24.927636+0000","last_undegraded":"2023-07-13T13:52:24.927636+0000","last_fullsized":"2023-07-13T13:52:24.927636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:16:16.297416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892883+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T13:52:24.892883+0000","last_peered":"2023-07-13T13:52:24.892883+0000","last_clean":"2023-07-13T13:52:24.892883+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T13:52:24.892883+0000","last_undegraded":"2023-07-13T13:52:24.892883+0000","last_fullsized":"2023-07-13T13:52:24.892883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:36:27.732091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927759+0000","last_change":"2023-07-13T13:52:16.631174+0000","last_active":"2023-07-13T13:52:24.927759+0000","last_peered":"2023-07-13T13:52:24.927759+0000","last_clean":"2023-07-13T13:52:24.927759+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T13:52:24.927759+0000","last_undegraded":"2023-07-13T13:52:24.927759+0000","last_fullsized":"2023-07-13T13:52:24.927759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:23:47.339702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886111+0000","last_change":"2023-07-13T13:52:17.952450+0000","last_active":"2023-07-13T13:52:24.886111+0000","last_peered":"2023-07-13T13:52:24.886111+0000","last_clean":"2023-07-13T13:52:24.886111+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T13:52:24.886111+0000","last_undegraded":"2023-07-13T13:52:24.886111+0000","last_fullsized":"2023-07-13T13:52:24.886111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:54:12.474885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928304+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T13:52:24.928304+0000","last_peered":"2023-07-13T13:52:24.928304+0000","last_clean":"2023-07-13T13:52:24.928304+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T13:52:24.928304+0000","last_undegraded":"2023-07-13T13:52:24.928304+0000","last_fullsized":"2023-07-13T13:52:24.928304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:48.589588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928144+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T13:52:24.928144+0000","last_peered":"2023-07-13T13:52:24.928144+0000","last_clean":"2023-07-13T13:52:24.928144+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T13:52:24.928144+0000","last_undegraded":"2023-07-13T13:52:24.928144+0000","last_fullsized":"2023-07-13T13:52:24.928144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:36.347129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928459+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T13:52:24.928459+0000","last_peered":"2023-07-13T13:52:24.928459+0000","last_clean":"2023-07-13T13:52:24.928459+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T13:52:24.928459+0000","last_undegraded":"2023-07-13T13:52:24.928459+0000","last_fullsized":"2023-07-13T13:52:24.928459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:32:17.932880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927922+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T13:52:24.927922+0000","last_peered":"2023-07-13T13:52:24.927922+0000","last_clean":"2023-07-13T13:52:24.927922+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T13:52:24.927922+0000","last_undegraded":"2023-07-13T13:52:24.927922+0000","last_fullsized":"2023-07-13T13:52:24.927922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:50:50.731203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928843+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T13:52:24.928843+0000","last_peered":"2023-07-13T13:52:24.928843+0000","last_clean":"2023-07-13T13:52:24.928843+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T13:52:24.928843+0000","last_undegraded":"2023-07-13T13:52:24.928843+0000","last_fullsized":"2023-07-13T13:52:24.928843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:11:58.722955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927870+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T13:52:24.927870+0000","last_peered":"2023-07-13T13:52:24.927870+0000","last_clean":"2023-07-13T13:52:24.927870+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T13:52:24.927870+0000","last_undegraded":"2023-07-13T13:52:24.927870+0000","last_fullsized":"2023-07-13T13:52:24.927870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:04:57.309588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927014+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T13:52:24.927014+0000","last_peered":"2023-07-13T13:52:24.927014+0000","last_clean":"2023-07-13T13:52:24.927014+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T13:52:24.927014+0000","last_undegraded":"2023-07-13T13:52:24.927014+0000","last_fullsized":"2023-07-13T13:52:24.927014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:02.313280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879724+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T13:52:24.879724+0000","last_peered":"2023-07-13T13:52:24.879724+0000","last_clean":"2023-07-13T13:52:24.879724+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T13:52:24.879724+0000","last_undegraded":"2023-07-13T13:52:24.879724+0000","last_fullsized":"2023-07-13T13:52:24.879724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:16:20.785254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879350+0000","last_change":"2023-07-13T13:52:17.925281+0000","last_active":"2023-07-13T13:52:24.879350+0000","last_peered":"2023-07-13T13:52:24.879350+0000","last_clean":"2023-07-13T13:52:24.879350+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T13:52:24.879350+0000","last_undegraded":"2023-07-13T13:52:24.879350+0000","last_fullsized":"2023-07-13T13:52:24.879350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:02.191186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891831+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T13:52:24.891831+0000","last_peered":"2023-07-13T13:52:24.891831+0000","last_clean":"2023-07-13T13:52:24.891831+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T13:52:24.891831+0000","last_undegraded":"2023-07-13T13:52:24.891831+0000","last_fullsized":"2023-07-13T13:52:24.891831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:35:42.802232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927618+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T13:52:24.927618+0000","last_peered":"2023-07-13T13:52:24.927618+0000","last_clean":"2023-07-13T13:52:24.927618+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T13:52:24.927618+0000","last_undegraded":"2023-07-13T13:52:24.927618+0000","last_fullsized":"2023-07-13T13:52:24.927618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:38.871196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927419+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T13:52:24.927419+0000","last_peered":"2023-07-13T13:52:24.927419+0000","last_clean":"2023-07-13T13:52:24.927419+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T13:52:24.927419+0000","last_undegraded":"2023-07-13T13:52:24.927419+0000","last_fullsized":"2023-07-13T13:52:24.927419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:37:29.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927179+0000","last_change":"2023-07-13T13:52:17.933894+0000","last_active":"2023-07-13T13:52:24.927179+0000","last_peered":"2023-07-13T13:52:24.927179+0000","last_clean":"2023-07-13T13:52:24.927179+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T13:52:24.927179+0000","last_undegraded":"2023-07-13T13:52:24.927179+0000","last_fullsized":"2023-07-13T13:52:24.927179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:55:58.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879592+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T13:52:24.879592+0000","last_peered":"2023-07-13T13:52:24.879592+0000","last_clean":"2023-07-13T13:52:24.879592+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T13:52:24.879592+0000","last_undegraded":"2023-07-13T13:52:24.879592+0000","last_fullsized":"2023-07-13T13:52:24.879592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:05:06.705721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928085+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T13:52:24.928085+0000","last_peered":"2023-07-13T13:52:24.928085+0000","last_clean":"2023-07-13T13:52:24.928085+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T13:52:24.928085+0000","last_undegraded":"2023-07-13T13:52:24.928085+0000","last_fullsized":"2023-07-13T13:52:24.928085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:03:23.227917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879302+0000","last_change":"2023-07-13T13:52:17.838377+0000","last_active":"2023-07-13T13:52:24.879302+0000","last_peered":"2023-07-13T13:52:24.879302+0000","last_clean":"2023-07-13T13:52:24.879302+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T13:52:24.879302+0000","last_undegraded":"2023-07-13T13:52:24.879302+0000","last_fullsized":"2023-07-13T13:52:24.879302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:37.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892135+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T13:52:24.892135+0000","last_peered":"2023-07-13T13:52:24.892135+0000","last_clean":"2023-07-13T13:52:24.892135+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T13:52:24.892135+0000","last_undegraded":"2023-07-13T13:52:24.892135+0000","last_fullsized":"2023-07-13T13:52:24.892135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:34:06.937251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":722199,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":718771,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":127911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":131671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":128473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T13:52:50.047 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T13:52:50.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.228+0000 7fc10b49d700 1 Processor -- start 2023-07-13T13:52:50.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.229+0000 7fc10b49d700 1 -- start start 2023-07-13T13:52:50.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.229+0000 7fc10b49d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc1040c7360 0x7fc10406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.229+0000 7fc10b49d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc104156160 0x7fc104160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.229+0000 7fc10b49d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10415a080 con 0x7fc10406de20 2023-07-13T13:52:50.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.229+0000 7fc10b49d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10406e730 con 0x7fc1040c7360 2023-07-13T13:52:50.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.229+0000 7fc10b49d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1040c3270 con 0x7fc104156160 2023-07-13T13:52:50.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.256+0000 7fc109a3a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc104156160 0x7fc104160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.256+0000 7fc109a3a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc104156160 0x7fc104160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:38446/0 (socket says 172.21.15.118:38446) 2023-07-13T13:52:50.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.256+0000 7fc109a3a700 1 -- 172.21.15.118:0/2215577996 learned_addr learned my addr 172.21.15.118:0/2215577996 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:50.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.261+0000 7fc108a38700 1 --2- 172.21.15.118:0/2215577996 >> v2:172.21.15.118:3300/0 conn(0x7fc1040c7360 0x7fc10406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.261+0000 7fc0fbfff700 1 -- 172.21.15.118:0/2215577996 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216574579 0 0) 0x7fc10415a080 con 0x7fc10406de20 2023-07-13T13:52:50.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.261+0000 7fc0fbfff700 1 -- 172.21.15.118:0/2215577996 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f00035b0 con 0x7fc10406de20 2023-07-13T13:52:50.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.263+0000 7fc109a3a700 1 -- 172.21.15.118:0/2215577996 >> v2:172.21.15.118:3300/0 conn(0x7fc1040c7360 msgr2=0x7fc10406e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:50.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.263+0000 7fc109a3a700 1 --2- 172.21.15.118:0/2215577996 >> v2:172.21.15.118:3300/0 conn(0x7fc1040c7360 0x7fc10406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.263+0000 7fc109a3a700 1 -- 172.21.15.118:0/2215577996 >> v1:172.21.15.123:6789/0 conn(0x7fc10406de20 legacy=0x7fc1040c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.263+0000 7fc109a3a700 1 -- 172.21.15.118:0/2215577996 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1040c3550 con 0x7fc104156160 2023-07-13T13:52:50.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.269+0000 7fc109a3a700 1 --2- 172.21.15.118:0/2215577996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc104156160 0x7fc104160ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1040c3830 tx=0x7fc0fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b221141e6ade3039 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:50.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.274+0000 7fc0fbfff700 1 -- 172.21.15.118:0/2215577996 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00e070 con 0x7fc104156160 2023-07-13T13:52:50.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.274+0000 7fc0fbfff700 1 -- 172.21.15.118:0/2215577996 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc00b910 con 0x7fc104156160 2023-07-13T13:52:50.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.274+0000 7fc0fbfff700 1 -- 172.21.15.118:0/2215577996 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00bcc0 con 0x7fc104156160 2023-07-13T13:52:50.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.275+0000 7fc10b49d700 1 -- 172.21.15.118:0/2215577996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc104156160 msgr2=0x7fc104160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.275+0000 7fc10b49d700 1 --2- 172.21.15.118:0/2215577996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc104156160 0x7fc104160ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1040c3830 tx=0x7fc0fc00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:50.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.275+0000 7fc10b49d700 1 -- 172.21.15.118:0/2215577996 shutdown_connections 2023-07-13T13:52:50.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.275+0000 7fc10b49d700 1 --2- 172.21.15.118:0/2215577996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc104156160 0x7fc104160ae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.275+0000 7fc10b49d700 1 --2- 172.21.15.118:0/2215577996 >> v2:172.21.15.118:3300/0 conn(0x7fc1040c7360 0x7fc10406e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.275+0000 7fc10b49d700 1 -- 172.21.15.118:0/2215577996 >> 172.21.15.118:0/2215577996 conn(0x7fc104069f30 msgr2=0x7fc10406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:50.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.275+0000 7fc10b49d700 1 -- 172.21.15.118:0/2215577996 shutdown_connections 2023-07-13T13:52:50.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.275+0000 7fc10b49d700 1 -- 172.21.15.118:0/2215577996 wait complete. 2023-07-13T13:52:50.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.277+0000 7fc10b49d700 1 Processor -- start 2023-07-13T13:52:50.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.277+0000 7fc10b49d700 1 -- start start 2023-07-13T13:52:50.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.277+0000 7fc10b49d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc10406de20 0x7fc1040cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.277+0000 7fc10b49d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc1040c7360 0x7fc10414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.277+0000 7fc10b49d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104156160 0x7fc1041ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.277+0000 7fc10b49d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040cb3b0 con 0x7fc104156160 2023-07-13T13:52:50.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.277+0000 7fc10b49d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040ca440 con 0x7fc10406de20 2023-07-13T13:52:50.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.277+0000 7fc10b49d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040caa00 con 0x7fc1040c7360 2023-07-13T13:52:50.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.278+0000 7fc109a3a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104156160 0x7fc1041ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.278+0000 7fc108a38700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc1040c7360 0x7fc10414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.278+0000 7fc109a3a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104156160 0x7fc1041ef400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43086/0 (socket says 172.21.15.118:43086) 2023-07-13T13:52:50.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.278+0000 7fc109a3a700 1 -- 172.21.15.118:0/1592077353 learned_addr learned my addr 172.21.15.118:0/1592077353 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:50.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.278+0000 7fc109239700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc10406de20 0x7fc1040cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.283+0000 7fc109239700 1 -- 172.21.15.118:0/1592077353 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc1040c7360 msgr2=0x7fc10414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.283+0000 7fc109239700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc1040c7360 0x7fc10414f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.283+0000 7fc109239700 1 -- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104156160 msgr2=0x7fc1041ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.283+0000 7fc109239700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104156160 0x7fc1041ef400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.283+0000 7fc109239700 1 -- 172.21.15.118:0/1592077353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc009b30 con 0x7fc10406de20 2023-07-13T13:52:50.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.285+0000 7fc109239700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc10406de20 0x7fc1040cc510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c420 tx=0x7fc100001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:50.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.287+0000 7fc0f9ffb700 1 -- 172.21.15.118:0/1592077353 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000052d0 con 0x7fc10406de20 2023-07-13T13:52:50.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.287+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1040cbe10 con 0x7fc10406de20 2023-07-13T13:52:50.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.287+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1040cd400 con 0x7fc10406de20 2023-07-13T13:52:50.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.288+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1041e1d50 con 0x7fc10406de20 2023-07-13T13:52:50.484 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.512+0000 7fc0f9ffb700 1 -- 172.21.15.118:0/1592077353 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100007e60 con 0x7fc10406de20 2023-07-13T13:52:50.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.536+0000 7fc0f9ffb700 1 -- 172.21.15.118:0/1592077353 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100003680 con 0x7fc10406de20 2023-07-13T13:52:50.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.536+0000 7fc0f9ffb700 1 -- 172.21.15.118:0/1592077353 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc100003860 con 0x7fc10406de20 2023-07-13T13:52:50.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.536+0000 7fc0f9ffb700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fc0e806ace0 0x7fc0e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.537+0000 7fc108a38700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fc0e806ace0 0x7fc0e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.537+0000 7fc108a38700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fc0e806ace0 0x7fc0e806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc10414aae0 tx=0x7fc0f4008040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:50.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.540+0000 7fc0f9ffb700 1 -- 172.21.15.118:0/1592077353 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc100057bf0 con 0x7fc10406de20 2023-07-13T13:52:50.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.556+0000 7fc0f9ffb700 1 -- 172.21.15.118:0/1592077353 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc100053f30 con 0x7fc10406de20 2023-07-13T13:52:50.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.756+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc104159a30 con 0x7fc0e806ace0 2023-07-13T13:52:50.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.765+0000 7fc0f9ffb700 1 -- 172.21.15.118:0/1592077353 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367357 (secure 0 0 0) 0x7fc0f400c040 con 0x7fc0e806ace0 2023-07-13T13:52:50.742 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:50.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fc0e806ace0 msgr2=0x7fc0e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fc0e806ace0 0x7fc0e806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc10414aae0 tx=0x7fc0f4008040 comp rx=0 tx=0).stop 2023-07-13T13:52:50.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc10406de20 msgr2=0x7fc1040cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc10406de20 0x7fc1040cc510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c420 tx=0x7fc100001e70 comp rx=0 tx=0).stop 2023-07-13T13:52:50.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 shutdown_connections 2023-07-13T13:52:50.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fc0e806ace0 0x7fc0e806d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc10406de20 0x7fc1040cc510 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc104156160 0x7fc1041ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 --2- 172.21.15.118:0/1592077353 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc1040c7360 0x7fc10414f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 >> 172.21.15.118:0/1592077353 conn(0x7fc104069f30 msgr2=0x7fc1041e13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 shutdown_connections 2023-07-13T13:52:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.769+0000 7fc10b49d700 1 -- 172.21.15.118:0/1592077353 wait complete. 2023-07-13T13:52:50.745 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T13:52:50.753 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-13T13:52:48.925250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218748,"kb_used_data":2592,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755972,"statfs":{"total":773094113280,"available":772870115328,"internally_reserved":0,"allocated":2654208,"data_stored":2212488,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003047"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886498+0000","last_change":"2023-07-13T13:52:17.926057+0000","last_active":"2023-07-13T13:52:24.886498+0000","last_peered":"2023-07-13T13:52:24.886498+0000","last_clean":"2023-07-13T13:52:24.886498+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T13:52:24.886498+0000","last_undegraded":"2023-07-13T13:52:24.886498+0000","last_fullsized":"2023-07-13T13:52:24.886498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:32:31.730703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928026+0000","last_change":"2023-07-13T13:52:17.952706+0000","last_active":"2023-07-13T13:52:24.928026+0000","last_peered":"2023-07-13T13:52:24.928026+0000","last_clean":"2023-07-13T13:52:24.928026+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T13:52:24.928026+0000","last_undegraded":"2023-07-13T13:52:24.928026+0000","last_fullsized":"2023-07-13T13:52:24.928026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928336+0000","last_change":"2023-07-13T13:52:17.943505+0000","last_active":"2023-07-13T13:52:24.928336+0000","last_peered":"2023-07-13T13:52:24.928336+0000","last_clean":"2023-07-13T13:52:24.928336+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T13:52:24.928336+0000","last_undegraded":"2023-07-13T13:52:24.928336+0000","last_fullsized":"2023-07-13T13:52:24.928336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:42.655686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927626+0000","last_change":"2023-07-13T13:52:17.933893+0000","last_active":"2023-07-13T13:52:24.927626+0000","last_peered":"2023-07-13T13:52:24.927626+0000","last_clean":"2023-07-13T13:52:24.927626+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T13:52:24.927626+0000","last_undegraded":"2023-07-13T13:52:24.927626+0000","last_fullsized":"2023-07-13T13:52:24.927626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:13:20.456240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927809+0000","last_change":"2023-07-13T13:52:17.886730+0000","last_active":"2023-07-13T13:52:24.927809+0000","last_peered":"2023-07-13T13:52:24.927809+0000","last_clean":"2023-07-13T13:52:24.927809+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T13:52:24.927809+0000","last_undegraded":"2023-07-13T13:52:24.927809+0000","last_fullsized":"2023-07-13T13:52:24.927809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:35:09.042667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927978+0000","last_change":"2023-07-13T13:52:17.942599+0000","last_active":"2023-07-13T13:52:24.927978+0000","last_peered":"2023-07-13T13:52:24.927978+0000","last_clean":"2023-07-13T13:52:24.927978+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T13:52:24.927978+0000","last_undegraded":"2023-07-13T13:52:24.927978+0000","last_fullsized":"2023-07-13T13:52:24.927978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:32.256216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930041+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T13:52:24.930041+0000","last_peered":"2023-07-13T13:52:24.930041+0000","last_clean":"2023-07-13T13:52:24.930041+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T13:52:24.930041+0000","last_undegraded":"2023-07-13T13:52:24.930041+0000","last_fullsized":"2023-07-13T13:52:24.930041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:39:57.261271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927323+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T13:52:24.927323+0000","last_peered":"2023-07-13T13:52:24.927323+0000","last_clean":"2023-07-13T13:52:24.927323+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T13:52:24.927323+0000","last_undegraded":"2023-07-13T13:52:24.927323+0000","last_fullsized":"2023-07-13T13:52:24.927323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:15:51.471433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927391+0000","last_change":"2023-07-13T13:52:17.887431+0000","last_active":"2023-07-13T13:52:24.927391+0000","last_peered":"2023-07-13T13:52:24.927391+0000","last_clean":"2023-07-13T13:52:24.927391+0000","last_became_active":"2023-07-13T13:52:17.887217+0000","last_became_peered":"2023-07-13T13:52:17.887217+0000","last_unstale":"2023-07-13T13:52:24.927391+0000","last_undegraded":"2023-07-13T13:52:24.927391+0000","last_fullsized":"2023-07-13T13:52:24.927391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:42:21.528797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929243+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T13:52:24.929243+0000","last_peered":"2023-07-13T13:52:24.929243+0000","last_clean":"2023-07-13T13:52:24.929243+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T13:52:24.929243+0000","last_undegraded":"2023-07-13T13:52:24.929243+0000","last_fullsized":"2023-07-13T13:52:24.929243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:39:57.261271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928606+0000","last_change":"2023-07-13T13:52:17.951567+0000","last_active":"2023-07-13T13:52:24.928606+0000","last_peered":"2023-07-13T13:52:24.928606+0000","last_clean":"2023-07-13T13:52:24.928606+0000","last_became_active":"2023-07-13T13:52:17.951313+0000","last_became_peered":"2023-07-13T13:52:17.951313+0000","last_unstale":"2023-07-13T13:52:24.928606+0000","last_undegraded":"2023-07-13T13:52:24.928606+0000","last_fullsized":"2023-07-13T13:52:24.928606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:38:28.382470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886331+0000","last_change":"2023-07-13T13:52:17.943253+0000","last_active":"2023-07-13T13:52:24.886331+0000","last_peered":"2023-07-13T13:52:24.886331+0000","last_clean":"2023-07-13T13:52:24.886331+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T13:52:24.886331+0000","last_undegraded":"2023-07-13T13:52:24.886331+0000","last_fullsized":"2023-07-13T13:52:24.886331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:44.391054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886211+0000","last_change":"2023-07-13T13:52:17.925230+0000","last_active":"2023-07-13T13:52:24.886211+0000","last_peered":"2023-07-13T13:52:24.886211+0000","last_clean":"2023-07-13T13:52:24.886211+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T13:52:24.886211+0000","last_undegraded":"2023-07-13T13:52:24.886211+0000","last_fullsized":"2023-07-13T13:52:24.886211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:36:06.777414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927582+0000","last_change":"2023-07-13T13:52:17.925445+0000","last_active":"2023-07-13T13:52:24.927582+0000","last_peered":"2023-07-13T13:52:24.927582+0000","last_clean":"2023-07-13T13:52:24.927582+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T13:52:24.927582+0000","last_undegraded":"2023-07-13T13:52:24.927582+0000","last_fullsized":"2023-07-13T13:52:24.927582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:39:08.733896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929915+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T13:52:24.929915+0000","last_peered":"2023-07-13T13:52:24.929915+0000","last_clean":"2023-07-13T13:52:24.929915+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T13:52:24.929915+0000","last_undegraded":"2023-07-13T13:52:24.929915+0000","last_fullsized":"2023-07-13T13:52:24.929915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:24:28.814149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927178+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T13:52:24.927178+0000","last_peered":"2023-07-13T13:52:24.927178+0000","last_clean":"2023-07-13T13:52:24.927178+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T13:52:24.927178+0000","last_undegraded":"2023-07-13T13:52:24.927178+0000","last_fullsized":"2023-07-13T13:52:24.927178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:44:32.655763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927416+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T13:52:24.927416+0000","last_peered":"2023-07-13T13:52:24.927416+0000","last_clean":"2023-07-13T13:52:24.927416+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T13:52:24.927416+0000","last_undegraded":"2023-07-13T13:52:24.927416+0000","last_fullsized":"2023-07-13T13:52:24.927416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:56:45.107513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928765+0000","last_change":"2023-07-13T13:52:17.942704+0000","last_active":"2023-07-13T13:52:24.928765+0000","last_peered":"2023-07-13T13:52:24.928765+0000","last_clean":"2023-07-13T13:52:24.928765+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T13:52:24.928765+0000","last_undegraded":"2023-07-13T13:52:24.928765+0000","last_fullsized":"2023-07-13T13:52:24.928765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:12.764288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886100+0000","last_change":"2023-07-13T13:52:17.934990+0000","last_active":"2023-07-13T13:52:24.886100+0000","last_peered":"2023-07-13T13:52:24.886100+0000","last_clean":"2023-07-13T13:52:24.886100+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T13:52:24.886100+0000","last_undegraded":"2023-07-13T13:52:24.886100+0000","last_fullsized":"2023-07-13T13:52:24.886100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:46:44.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928683+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T13:52:24.928683+0000","last_peered":"2023-07-13T13:52:24.928683+0000","last_clean":"2023-07-13T13:52:24.928683+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T13:52:24.928683+0000","last_undegraded":"2023-07-13T13:52:24.928683+0000","last_fullsized":"2023-07-13T13:52:24.928683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:25:08.080128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930485+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T13:52:24.930485+0000","last_peered":"2023-07-13T13:52:24.930485+0000","last_clean":"2023-07-13T13:52:24.930485+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T13:52:24.930485+0000","last_undegraded":"2023-07-13T13:52:24.930485+0000","last_fullsized":"2023-07-13T13:52:24.930485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:16:21.931304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927206+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T13:52:24.927206+0000","last_peered":"2023-07-13T13:52:24.927206+0000","last_clean":"2023-07-13T13:52:24.927206+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T13:52:24.927206+0000","last_undegraded":"2023-07-13T13:52:24.927206+0000","last_fullsized":"2023-07-13T13:52:24.927206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:35:36.595395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879195+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T13:52:24.879195+0000","last_peered":"2023-07-13T13:52:24.879195+0000","last_clean":"2023-07-13T13:52:24.879195+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T13:52:24.879195+0000","last_undegraded":"2023-07-13T13:52:24.879195+0000","last_fullsized":"2023-07-13T13:52:24.879195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:05.503930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929402+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T13:52:24.929402+0000","last_peered":"2023-07-13T13:52:24.929402+0000","last_clean":"2023-07-13T13:52:24.929402+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T13:52:24.929402+0000","last_undegraded":"2023-07-13T13:52:24.929402+0000","last_fullsized":"2023-07-13T13:52:24.929402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:03:58.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892101+0000","last_change":"2023-07-13T13:52:17.951443+0000","last_active":"2023-07-13T13:52:24.892101+0000","last_peered":"2023-07-13T13:52:24.892101+0000","last_clean":"2023-07-13T13:52:24.892101+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T13:52:24.892101+0000","last_undegraded":"2023-07-13T13:52:24.892101+0000","last_fullsized":"2023-07-13T13:52:24.892101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:15:13.905216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892221+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T13:52:24.892221+0000","last_peered":"2023-07-13T13:52:24.892221+0000","last_clean":"2023-07-13T13:52:24.892221+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T13:52:24.892221+0000","last_undegraded":"2023-07-13T13:52:24.892221+0000","last_fullsized":"2023-07-13T13:52:24.892221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:25:07.338467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929170+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T13:52:24.929170+0000","last_peered":"2023-07-13T13:52:24.929170+0000","last_clean":"2023-07-13T13:52:24.929170+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T13:52:24.929170+0000","last_undegraded":"2023-07-13T13:52:24.929170+0000","last_fullsized":"2023-07-13T13:52:24.929170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:24:28.814149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928347+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T13:52:24.928347+0000","last_peered":"2023-07-13T13:52:24.928347+0000","last_clean":"2023-07-13T13:52:24.928347+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T13:52:24.928347+0000","last_undegraded":"2023-07-13T13:52:24.928347+0000","last_fullsized":"2023-07-13T13:52:24.928347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:27.502582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927905+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T13:52:24.927905+0000","last_peered":"2023-07-13T13:52:24.927905+0000","last_clean":"2023-07-13T13:52:24.927905+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T13:52:24.927905+0000","last_undegraded":"2023-07-13T13:52:24.927905+0000","last_fullsized":"2023-07-13T13:52:24.927905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.301671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879893+0000","last_change":"2023-07-13T13:52:17.948432+0000","last_active":"2023-07-13T13:52:24.879893+0000","last_peered":"2023-07-13T13:52:24.879893+0000","last_clean":"2023-07-13T13:52:24.879893+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T13:52:24.879893+0000","last_undegraded":"2023-07-13T13:52:24.879893+0000","last_fullsized":"2023-07-13T13:52:24.879893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:56:28.970102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927636+0000","last_change":"2023-07-13T13:52:23.984769+0000","last_active":"2023-07-13T13:52:24.927636+0000","last_peered":"2023-07-13T13:52:24.927636+0000","last_clean":"2023-07-13T13:52:24.927636+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T13:52:24.927636+0000","last_undegraded":"2023-07-13T13:52:24.927636+0000","last_fullsized":"2023-07-13T13:52:24.927636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:04:41.174657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891603+0000","last_change":"2023-07-13T13:52:16.667863+0000","last_active":"2023-07-13T13:52:24.891603+0000","last_peered":"2023-07-13T13:52:24.891603+0000","last_clean":"2023-07-13T13:52:24.891603+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T13:52:24.891603+0000","last_undegraded":"2023-07-13T13:52:24.891603+0000","last_fullsized":"2023-07-13T13:52:24.891603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:26:34.960591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927548+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T13:52:24.927548+0000","last_peered":"2023-07-13T13:52:24.927548+0000","last_clean":"2023-07-13T13:52:24.927548+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T13:52:24.927548+0000","last_undegraded":"2023-07-13T13:52:24.927548+0000","last_fullsized":"2023-07-13T13:52:24.927548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:34:06.937251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927832+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T13:52:24.927832+0000","last_peered":"2023-07-13T13:52:24.927832+0000","last_clean":"2023-07-13T13:52:24.927832+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T13:52:24.927832+0000","last_undegraded":"2023-07-13T13:52:24.927832+0000","last_fullsized":"2023-07-13T13:52:24.927832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:44:38.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879435+0000","last_change":"2023-07-13T13:52:16.607515+0000","last_active":"2023-07-13T13:52:24.879435+0000","last_peered":"2023-07-13T13:52:24.879435+0000","last_clean":"2023-07-13T13:52:24.879435+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T13:52:24.879435+0000","last_undegraded":"2023-07-13T13:52:24.879435+0000","last_fullsized":"2023-07-13T13:52:24.879435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:24:27.668099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927817+0000","last_change":"2023-07-13T13:52:17.934538+0000","last_active":"2023-07-13T13:52:24.927817+0000","last_peered":"2023-07-13T13:52:24.927817+0000","last_clean":"2023-07-13T13:52:24.927817+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T13:52:24.927817+0000","last_undegraded":"2023-07-13T13:52:24.927817+0000","last_fullsized":"2023-07-13T13:52:24.927817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:55:29.065632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927005+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T13:52:24.927005+0000","last_peered":"2023-07-13T13:52:24.927005+0000","last_clean":"2023-07-13T13:52:24.927005+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T13:52:24.927005+0000","last_undegraded":"2023-07-13T13:52:24.927005+0000","last_fullsized":"2023-07-13T13:52:24.927005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:54:23.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927512+0000","last_change":"2023-07-13T13:52:16.668908+0000","last_active":"2023-07-13T13:52:24.927512+0000","last_peered":"2023-07-13T13:52:24.927512+0000","last_clean":"2023-07-13T13:52:24.927512+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T13:52:24.927512+0000","last_undegraded":"2023-07-13T13:52:24.927512+0000","last_fullsized":"2023-07-13T13:52:24.927512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:15:12.759166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879407+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T13:52:24.879407+0000","last_peered":"2023-07-13T13:52:24.879407+0000","last_clean":"2023-07-13T13:52:24.879407+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T13:52:24.879407+0000","last_undegraded":"2023-07-13T13:52:24.879407+0000","last_fullsized":"2023-07-13T13:52:24.879407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:11:59.869006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929061+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T13:52:24.929061+0000","last_peered":"2023-07-13T13:52:24.929061+0000","last_clean":"2023-07-13T13:52:24.929061+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T13:52:24.929061+0000","last_undegraded":"2023-07-13T13:52:24.929061+0000","last_fullsized":"2023-07-13T13:52:24.929061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:11.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928227+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T13:52:24.928227+0000","last_peered":"2023-07-13T13:52:24.928227+0000","last_clean":"2023-07-13T13:52:24.928227+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T13:52:24.928227+0000","last_undegraded":"2023-07-13T13:52:24.928227+0000","last_fullsized":"2023-07-13T13:52:24.928227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:18.698131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879193+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T13:52:24.879193+0000","last_peered":"2023-07-13T13:52:24.879193+0000","last_clean":"2023-07-13T13:52:24.879193+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T13:52:24.879193+0000","last_undegraded":"2023-07-13T13:52:24.879193+0000","last_fullsized":"2023-07-13T13:52:24.879193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:11.920803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879638+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T13:52:24.879638+0000","last_peered":"2023-07-13T13:52:24.879638+0000","last_clean":"2023-07-13T13:52:24.879638+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T13:52:24.879638+0000","last_undegraded":"2023-07-13T13:52:24.879638+0000","last_fullsized":"2023-07-13T13:52:24.879638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:40:03.468109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929117+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T13:52:24.929117+0000","last_peered":"2023-07-13T13:52:24.929117+0000","last_clean":"2023-07-13T13:52:24.929117+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T13:52:24.929117+0000","last_undegraded":"2023-07-13T13:52:24.929117+0000","last_fullsized":"2023-07-13T13:52:24.929117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:34.746141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892115+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T13:52:24.892115+0000","last_peered":"2023-07-13T13:52:24.892115+0000","last_clean":"2023-07-13T13:52:24.892115+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T13:52:24.892115+0000","last_undegraded":"2023-07-13T13:52:24.892115+0000","last_fullsized":"2023-07-13T13:52:24.892115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:45:09.342439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891618+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T13:52:24.891618+0000","last_peered":"2023-07-13T13:52:24.891618+0000","last_clean":"2023-07-13T13:52:24.891618+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T13:52:24.891618+0000","last_undegraded":"2023-07-13T13:52:24.891618+0000","last_fullsized":"2023-07-13T13:52:24.891618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:54:40.996212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:33.640166+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T13:52:33.640166+0000","last_peered":"2023-07-13T13:52:33.640166+0000","last_clean":"2023-07-13T13:52:33.640166+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T13:52:33.640166+0000","last_undegraded":"2023-07-13T13:52:33.640166+0000","last_fullsized":"2023-07-13T13:52:33.640166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:47:20.741487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928282+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T13:52:24.928282+0000","last_peered":"2023-07-13T13:52:24.928282+0000","last_clean":"2023-07-13T13:52:24.928282+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T13:52:24.928282+0000","last_undegraded":"2023-07-13T13:52:24.928282+0000","last_fullsized":"2023-07-13T13:52:24.928282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:37:56.904122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928351+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T13:52:24.928351+0000","last_peered":"2023-07-13T13:52:24.928351+0000","last_clean":"2023-07-13T13:52:24.928351+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T13:52:24.928351+0000","last_undegraded":"2023-07-13T13:52:24.928351+0000","last_fullsized":"2023-07-13T13:52:24.928351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:08.398023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930607+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T13:52:24.930607+0000","last_peered":"2023-07-13T13:52:24.930607+0000","last_clean":"2023-07-13T13:52:24.930607+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T13:52:24.930607+0000","last_undegraded":"2023-07-13T13:52:24.930607+0000","last_fullsized":"2023-07-13T13:52:24.930607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:11:03.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879700+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T13:52:24.879700+0000","last_peered":"2023-07-13T13:52:24.879700+0000","last_clean":"2023-07-13T13:52:24.879700+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T13:52:24.879700+0000","last_undegraded":"2023-07-13T13:52:24.879700+0000","last_fullsized":"2023-07-13T13:52:24.879700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:11:25.930718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879777+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T13:52:24.879777+0000","last_peered":"2023-07-13T13:52:24.879777+0000","last_clean":"2023-07-13T13:52:24.879777+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T13:52:24.879777+0000","last_undegraded":"2023-07-13T13:52:24.879777+0000","last_fullsized":"2023-07-13T13:52:24.879777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:11:10.845693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927068+0000","last_change":"2023-07-13T13:52:16.663350+0000","last_active":"2023-07-13T13:52:24.927068+0000","last_peered":"2023-07-13T13:52:24.927068+0000","last_clean":"2023-07-13T13:52:24.927068+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T13:52:24.927068+0000","last_undegraded":"2023-07-13T13:52:24.927068+0000","last_fullsized":"2023-07-13T13:52:24.927068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:16:40.928511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929053+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T13:52:24.929053+0000","last_peered":"2023-07-13T13:52:24.929053+0000","last_clean":"2023-07-13T13:52:24.929053+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T13:52:24.929053+0000","last_undegraded":"2023-07-13T13:52:24.929053+0000","last_fullsized":"2023-07-13T13:52:24.929053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:09.969490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879939+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T13:52:24.879939+0000","last_peered":"2023-07-13T13:52:24.879939+0000","last_clean":"2023-07-13T13:52:24.879939+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T13:52:24.879939+0000","last_undegraded":"2023-07-13T13:52:24.879939+0000","last_fullsized":"2023-07-13T13:52:24.879939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:22:04.157829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929796+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T13:52:24.929796+0000","last_peered":"2023-07-13T13:52:24.929796+0000","last_clean":"2023-07-13T13:52:24.929796+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T13:52:24.929796+0000","last_undegraded":"2023-07-13T13:52:24.929796+0000","last_fullsized":"2023-07-13T13:52:24.929796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:08.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927667+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T13:52:24.927667+0000","last_peered":"2023-07-13T13:52:24.927667+0000","last_clean":"2023-07-13T13:52:24.927667+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T13:52:24.927667+0000","last_undegraded":"2023-07-13T13:52:24.927667+0000","last_fullsized":"2023-07-13T13:52:24.927667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:36:21.525254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927942+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T13:52:24.927942+0000","last_peered":"2023-07-13T13:52:24.927942+0000","last_clean":"2023-07-13T13:52:24.927942+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T13:52:24.927942+0000","last_undegraded":"2023-07-13T13:52:24.927942+0000","last_fullsized":"2023-07-13T13:52:24.927942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:48.589588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.926948+0000","last_change":"2023-07-13T13:52:16.692808+0000","last_active":"2023-07-13T13:52:24.926948+0000","last_peered":"2023-07-13T13:52:24.926948+0000","last_clean":"2023-07-13T13:52:24.926948+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T13:52:24.926948+0000","last_undegraded":"2023-07-13T13:52:24.926948+0000","last_fullsized":"2023-07-13T13:52:24.926948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:00:42.596139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879892+0000","last_change":"2023-07-13T13:52:17.838408+0000","last_active":"2023-07-13T13:52:24.879892+0000","last_peered":"2023-07-13T13:52:24.879892+0000","last_clean":"2023-07-13T13:52:24.879892+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T13:52:24.879892+0000","last_undegraded":"2023-07-13T13:52:24.879892+0000","last_fullsized":"2023-07-13T13:52:24.879892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:43:05.930281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930256+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T13:52:24.930256+0000","last_peered":"2023-07-13T13:52:24.930256+0000","last_clean":"2023-07-13T13:52:24.930256+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T13:52:24.930256+0000","last_undegraded":"2023-07-13T13:52:24.930256+0000","last_fullsized":"2023-07-13T13:52:24.930256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:05:12.912559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930302+0000","last_change":"2023-07-13T13:52:16.666097+0000","last_active":"2023-07-13T13:52:24.930302+0000","last_peered":"2023-07-13T13:52:24.930302+0000","last_clean":"2023-07-13T13:52:24.930302+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T13:52:24.930302+0000","last_undegraded":"2023-07-13T13:52:24.930302+0000","last_fullsized":"2023-07-13T13:52:24.930302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:11:24.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927205+0000","last_change":"2023-07-13T13:52:17.838908+0000","last_active":"2023-07-13T13:52:24.927205+0000","last_peered":"2023-07-13T13:52:24.927205+0000","last_clean":"2023-07-13T13:52:24.927205+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T13:52:24.927205+0000","last_undegraded":"2023-07-13T13:52:24.927205+0000","last_fullsized":"2023-07-13T13:52:24.927205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:24:00.106035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.885940+0000","last_change":"2023-07-13T13:52:23.993113+0000","last_active":"2023-07-13T13:52:24.885940+0000","last_peered":"2023-07-13T13:52:24.885940+0000","last_clean":"2023-07-13T13:52:24.885940+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T13:52:24.885940+0000","last_undegraded":"2023-07-13T13:52:24.885940+0000","last_fullsized":"2023-07-13T13:52:24.885940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:30:48.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930956+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T13:52:24.930956+0000","last_peered":"2023-07-13T13:52:24.930956+0000","last_clean":"2023-07-13T13:52:24.930956+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T13:52:24.930956+0000","last_undegraded":"2023-07-13T13:52:24.930956+0000","last_fullsized":"2023-07-13T13:52:24.930956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:21:56.804941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927753+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T13:52:24.927753+0000","last_peered":"2023-07-13T13:52:24.927753+0000","last_clean":"2023-07-13T13:52:24.927753+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T13:52:24.927753+0000","last_undegraded":"2023-07-13T13:52:24.927753+0000","last_fullsized":"2023-07-13T13:52:24.927753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:01:04.196253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886100+0000","last_change":"2023-07-13T13:52:23.992085+0000","last_active":"2023-07-13T13:52:24.886100+0000","last_peered":"2023-07-13T13:52:24.886100+0000","last_clean":"2023-07-13T13:52:24.886100+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T13:52:24.886100+0000","last_undegraded":"2023-07-13T13:52:24.886100+0000","last_fullsized":"2023-07-13T13:52:24.886100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:06:27.010221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929367+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T13:52:24.929367+0000","last_peered":"2023-07-13T13:52:24.929367+0000","last_clean":"2023-07-13T13:52:24.929367+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T13:52:24.929367+0000","last_undegraded":"2023-07-13T13:52:24.929367+0000","last_fullsized":"2023-07-13T13:52:24.929367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:01.045136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927219+0000","last_change":"2023-07-13T13:52:17.952164+0000","last_active":"2023-07-13T13:52:24.927219+0000","last_peered":"2023-07-13T13:52:24.927219+0000","last_clean":"2023-07-13T13:52:24.927219+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T13:52:24.927219+0000","last_undegraded":"2023-07-13T13:52:24.927219+0000","last_fullsized":"2023-07-13T13:52:24.927219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:19.822713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886204+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T13:52:24.886204+0000","last_peered":"2023-07-13T13:52:24.886204+0000","last_clean":"2023-07-13T13:52:24.886204+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T13:52:24.886204+0000","last_undegraded":"2023-07-13T13:52:24.886204+0000","last_fullsized":"2023-07-13T13:52:24.886204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:04:58.692798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928015+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T13:52:24.928015+0000","last_peered":"2023-07-13T13:52:24.928015+0000","last_clean":"2023-07-13T13:52:24.928015+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T13:52:24.928015+0000","last_undegraded":"2023-07-13T13:52:24.928015+0000","last_fullsized":"2023-07-13T13:52:24.928015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:04.357880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927647+0000","last_change":"2023-07-13T13:52:17.952349+0000","last_active":"2023-07-13T13:52:24.927647+0000","last_peered":"2023-07-13T13:52:24.927647+0000","last_clean":"2023-07-13T13:52:24.927647+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T13:52:24.927647+0000","last_undegraded":"2023-07-13T13:52:24.927647+0000","last_fullsized":"2023-07-13T13:52:24.927647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:25:07.338467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886269+0000","last_change":"2023-07-13T13:52:23.987269+0000","last_active":"2023-07-13T13:52:24.886269+0000","last_peered":"2023-07-13T13:52:24.886269+0000","last_clean":"2023-07-13T13:52:24.886269+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T13:52:24.886269+0000","last_undegraded":"2023-07-13T13:52:24.886269+0000","last_fullsized":"2023-07-13T13:52:24.886269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:31.468664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879419+0000","last_change":"2023-07-13T13:52:16.607455+0000","last_active":"2023-07-13T13:52:24.879419+0000","last_peered":"2023-07-13T13:52:24.879419+0000","last_clean":"2023-07-13T13:52:24.879419+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T13:52:24.879419+0000","last_undegraded":"2023-07-13T13:52:24.879419+0000","last_fullsized":"2023-07-13T13:52:24.879419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:08.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928550+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T13:52:24.928550+0000","last_peered":"2023-07-13T13:52:24.928550+0000","last_clean":"2023-07-13T13:52:24.928550+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T13:52:24.928550+0000","last_undegraded":"2023-07-13T13:52:24.928550+0000","last_fullsized":"2023-07-13T13:52:24.928550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:05:24.675504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891810+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T13:52:24.891810+0000","last_peered":"2023-07-13T13:52:24.891810+0000","last_clean":"2023-07-13T13:52:24.891810+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T13:52:24.891810+0000","last_undegraded":"2023-07-13T13:52:24.891810+0000","last_fullsized":"2023-07-13T13:52:24.891810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:16:48.281399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927299+0000","last_change":"2023-07-13T13:52:16.692899+0000","last_active":"2023-07-13T13:52:24.927299+0000","last_peered":"2023-07-13T13:52:24.927299+0000","last_clean":"2023-07-13T13:52:24.927299+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T13:52:24.927299+0000","last_undegraded":"2023-07-13T13:52:24.927299+0000","last_fullsized":"2023-07-13T13:52:24.927299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:32:47.704876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928496+0000","last_change":"2023-07-13T13:52:17.942165+0000","last_active":"2023-07-13T13:52:24.928496+0000","last_peered":"2023-07-13T13:52:24.928496+0000","last_clean":"2023-07-13T13:52:24.928496+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T13:52:24.928496+0000","last_undegraded":"2023-07-13T13:52:24.928496+0000","last_fullsized":"2023-07-13T13:52:24.928496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:12:48.876978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930289+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T13:52:24.930289+0000","last_peered":"2023-07-13T13:52:24.930289+0000","last_clean":"2023-07-13T13:52:24.930289+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T13:52:24.930289+0000","last_undegraded":"2023-07-13T13:52:24.930289+0000","last_fullsized":"2023-07-13T13:52:24.930289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:11:32.137556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927452+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T13:52:24.927452+0000","last_peered":"2023-07-13T13:52:24.927452+0000","last_clean":"2023-07-13T13:52:24.927452+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T13:52:24.927452+0000","last_undegraded":"2023-07-13T13:52:24.927452+0000","last_fullsized":"2023-07-13T13:52:24.927452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:03.894064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929645+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T13:52:24.929645+0000","last_peered":"2023-07-13T13:52:24.929645+0000","last_clean":"2023-07-13T13:52:24.929645+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T13:52:24.929645+0000","last_undegraded":"2023-07-13T13:52:24.929645+0000","last_fullsized":"2023-07-13T13:52:24.929645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:35:22.230584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929592+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T13:52:24.929592+0000","last_peered":"2023-07-13T13:52:24.929592+0000","last_clean":"2023-07-13T13:52:24.929592+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T13:52:24.929592+0000","last_undegraded":"2023-07-13T13:52:24.929592+0000","last_fullsized":"2023-07-13T13:52:24.929592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:00:18.335695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879297+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T13:52:24.879297+0000","last_peered":"2023-07-13T13:52:24.879297+0000","last_clean":"2023-07-13T13:52:24.879297+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T13:52:24.879297+0000","last_undegraded":"2023-07-13T13:52:24.879297+0000","last_fullsized":"2023-07-13T13:52:24.879297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:18.698131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892152+0000","last_change":"2023-07-13T13:52:17.949610+0000","last_active":"2023-07-13T13:52:24.892152+0000","last_peered":"2023-07-13T13:52:24.892152+0000","last_clean":"2023-07-13T13:52:24.892152+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T13:52:24.892152+0000","last_undegraded":"2023-07-13T13:52:24.892152+0000","last_fullsized":"2023-07-13T13:52:24.892152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:40.017246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927555+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T13:52:24.927555+0000","last_peered":"2023-07-13T13:52:24.927555+0000","last_clean":"2023-07-13T13:52:24.927555+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T13:52:24.927555+0000","last_undegraded":"2023-07-13T13:52:24.927555+0000","last_fullsized":"2023-07-13T13:52:24.927555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:45:15.549277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891895+0000","last_change":"2023-07-13T13:51:59.916015+0000","last_active":"2023-07-13T13:52:24.891895+0000","last_peered":"2023-07-13T13:52:24.891895+0000","last_clean":"2023-07-13T13:52:24.891895+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T13:52:24.891895+0000","last_undegraded":"2023-07-13T13:52:24.891895+0000","last_fullsized":"2023-07-13T13:52:24.891895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:58:56.377294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928791+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T13:52:24.928791+0000","last_peered":"2023-07-13T13:52:24.928791+0000","last_clean":"2023-07-13T13:52:24.928791+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T13:52:24.928791+0000","last_undegraded":"2023-07-13T13:52:24.928791+0000","last_fullsized":"2023-07-13T13:52:24.928791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:03:57.800032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891909+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T13:52:24.891909+0000","last_peered":"2023-07-13T13:52:24.891909+0000","last_clean":"2023-07-13T13:52:24.891909+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T13:52:24.891909+0000","last_undegraded":"2023-07-13T13:52:24.891909+0000","last_fullsized":"2023-07-13T13:52:24.891909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:42:21.528797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927325+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T13:52:24.927325+0000","last_peered":"2023-07-13T13:52:24.927325+0000","last_clean":"2023-07-13T13:52:24.927325+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T13:52:24.927325+0000","last_undegraded":"2023-07-13T13:52:24.927325+0000","last_fullsized":"2023-07-13T13:52:24.927325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:59:20.772189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927700+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T13:52:24.927700+0000","last_peered":"2023-07-13T13:52:24.927700+0000","last_clean":"2023-07-13T13:52:24.927700+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T13:52:24.927700+0000","last_undegraded":"2023-07-13T13:52:24.927700+0000","last_fullsized":"2023-07-13T13:52:24.927700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:01:43.426649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928641+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T13:52:24.928641+0000","last_peered":"2023-07-13T13:52:24.928641+0000","last_clean":"2023-07-13T13:52:24.928641+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T13:52:24.928641+0000","last_undegraded":"2023-07-13T13:52:24.928641+0000","last_fullsized":"2023-07-13T13:52:24.928641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:59.268490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891765+0000","last_change":"2023-07-13T13:52:17.947909+0000","last_active":"2023-07-13T13:52:24.891765+0000","last_peered":"2023-07-13T13:52:24.891765+0000","last_clean":"2023-07-13T13:52:24.891765+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T13:52:24.891765+0000","last_undegraded":"2023-07-13T13:52:24.891765+0000","last_fullsized":"2023-07-13T13:52:24.891765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:53:25.856736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886512+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T13:52:24.886512+0000","last_peered":"2023-07-13T13:52:24.886512+0000","last_clean":"2023-07-13T13:52:24.886512+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T13:52:24.886512+0000","last_undegraded":"2023-07-13T13:52:24.886512+0000","last_fullsized":"2023-07-13T13:52:24.886512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:27:42.531825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886027+0000","last_change":"2023-07-13T13:52:01.224691+0000","last_active":"2023-07-13T13:52:24.886027+0000","last_peered":"2023-07-13T13:52:24.886027+0000","last_clean":"2023-07-13T13:52:24.886027+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T13:52:24.886027+0000","last_undegraded":"2023-07-13T13:52:24.886027+0000","last_fullsized":"2023-07-13T13:52:24.886027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:51.173302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891536+0000","last_change":"2023-07-13T13:52:16.668065+0000","last_active":"2023-07-13T13:52:24.891536+0000","last_peered":"2023-07-13T13:52:24.891536+0000","last_clean":"2023-07-13T13:52:24.891536+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T13:52:24.891536+0000","last_undegraded":"2023-07-13T13:52:24.891536+0000","last_fullsized":"2023-07-13T13:52:24.891536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:24:28.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892038+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T13:52:24.892038+0000","last_peered":"2023-07-13T13:52:24.892038+0000","last_clean":"2023-07-13T13:52:24.892038+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T13:52:24.892038+0000","last_undegraded":"2023-07-13T13:52:24.892038+0000","last_fullsized":"2023-07-13T13:52:24.892038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:49:06.930579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928758+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T13:52:24.928758+0000","last_peered":"2023-07-13T13:52:24.928758+0000","last_clean":"2023-07-13T13:52:24.928758+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T13:52:24.928758+0000","last_undegraded":"2023-07-13T13:52:24.928758+0000","last_fullsized":"2023-07-13T13:52:24.928758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:18.127640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927999+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T13:52:24.927999+0000","last_peered":"2023-07-13T13:52:24.927999+0000","last_clean":"2023-07-13T13:52:24.927999+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T13:52:24.927999+0000","last_undegraded":"2023-07-13T13:52:24.927999+0000","last_fullsized":"2023-07-13T13:52:24.927999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:03:53.732745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929281+0000","last_change":"2023-07-13T13:51:57.962882+0000","last_active":"2023-07-13T13:52:24.929281+0000","last_peered":"2023-07-13T13:52:24.929281+0000","last_clean":"2023-07-13T13:52:24.929281+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T13:52:24.929281+0000","last_undegraded":"2023-07-13T13:52:24.929281+0000","last_fullsized":"2023-07-13T13:52:24.929281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_clean_scrub_stamp":"2023-07-13T13:51:55.598839+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:58.978619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879350+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T13:52:24.879350+0000","last_peered":"2023-07-13T13:52:24.879350+0000","last_clean":"2023-07-13T13:52:24.879350+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T13:52:24.879350+0000","last_undegraded":"2023-07-13T13:52:24.879350+0000","last_fullsized":"2023-07-13T13:52:24.879350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:03:57.800032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927892+0000","last_change":"2023-07-13T13:52:17.942525+0000","last_active":"2023-07-13T13:52:24.927892+0000","last_peered":"2023-07-13T13:52:24.927892+0000","last_clean":"2023-07-13T13:52:24.927892+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T13:52:24.927892+0000","last_undegraded":"2023-07-13T13:52:24.927892+0000","last_fullsized":"2023-07-13T13:52:24.927892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:00:29.156794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.930844+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T13:52:24.930844+0000","last_peered":"2023-07-13T13:52:24.930844+0000","last_clean":"2023-07-13T13:52:24.930844+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T13:52:24.930844+0000","last_undegraded":"2023-07-13T13:52:24.930844+0000","last_fullsized":"2023-07-13T13:52:24.930844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:05:12.912559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929506+0000","last_change":"2023-07-13T13:52:00.016430+0000","last_active":"2023-07-13T13:52:24.929506+0000","last_peered":"2023-07-13T13:52:24.929506+0000","last_clean":"2023-07-13T13:52:24.929506+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T13:52:24.929506+0000","last_undegraded":"2023-07-13T13:52:24.929506+0000","last_fullsized":"2023-07-13T13:52:24.929506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:11:41.680948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.926955+0000","last_change":"2023-07-13T13:52:16.630297+0000","last_active":"2023-07-13T13:52:24.926955+0000","last_peered":"2023-07-13T13:52:24.926955+0000","last_clean":"2023-07-13T13:52:24.926955+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T13:52:24.926955+0000","last_undegraded":"2023-07-13T13:52:24.926955+0000","last_fullsized":"2023-07-13T13:52:24.926955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:53:24.710686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927322+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T13:52:24.927322+0000","last_peered":"2023-07-13T13:52:24.927322+0000","last_clean":"2023-07-13T13:52:24.927322+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T13:52:24.927322+0000","last_undegraded":"2023-07-13T13:52:24.927322+0000","last_fullsized":"2023-07-13T13:52:24.927322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:23:18.465639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927124+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T13:52:24.927124+0000","last_peered":"2023-07-13T13:52:24.927124+0000","last_clean":"2023-07-13T13:52:24.927124+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T13:52:24.927124+0000","last_undegraded":"2023-07-13T13:52:24.927124+0000","last_fullsized":"2023-07-13T13:52:24.927124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:15:57.574963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929249+0000","last_change":"2023-07-13T13:52:00.019670+0000","last_active":"2023-07-13T13:52:24.929249+0000","last_peered":"2023-07-13T13:52:24.929249+0000","last_clean":"2023-07-13T13:52:24.929249+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T13:52:24.929249+0000","last_undegraded":"2023-07-13T13:52:24.929249+0000","last_fullsized":"2023-07-13T13:52:24.929249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:19.305122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892015+0000","last_change":"2023-07-13T13:52:16.668244+0000","last_active":"2023-07-13T13:52:24.892015+0000","last_peered":"2023-07-13T13:52:24.892015+0000","last_clean":"2023-07-13T13:52:24.892015+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T13:52:24.892015+0000","last_undegraded":"2023-07-13T13:52:24.892015+0000","last_fullsized":"2023-07-13T13:52:24.892015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:56:43.961463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927745+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T13:52:24.927745+0000","last_peered":"2023-07-13T13:52:24.927745+0000","last_clean":"2023-07-13T13:52:24.927745+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T13:52:24.927745+0000","last_undegraded":"2023-07-13T13:52:24.927745+0000","last_fullsized":"2023-07-13T13:52:24.927745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:12:41.254584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929834+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T13:52:24.929834+0000","last_peered":"2023-07-13T13:52:24.929834+0000","last_clean":"2023-07-13T13:52:24.929834+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T13:52:24.929834+0000","last_undegraded":"2023-07-13T13:52:24.929834+0000","last_fullsized":"2023-07-13T13:52:24.929834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:37:00.550738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.880010+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T13:52:24.880010+0000","last_peered":"2023-07-13T13:52:24.880010+0000","last_clean":"2023-07-13T13:52:24.880010+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T13:52:24.880010+0000","last_undegraded":"2023-07-13T13:52:24.880010+0000","last_fullsized":"2023-07-13T13:52:24.880010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:13:01.211759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891905+0000","last_change":"2023-07-13T13:51:59.757569+0000","last_active":"2023-07-13T13:52:24.891905+0000","last_peered":"2023-07-13T13:52:24.891905+0000","last_clean":"2023-07-13T13:52:24.891905+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T13:52:24.891905+0000","last_undegraded":"2023-07-13T13:52:24.891905+0000","last_fullsized":"2023-07-13T13:52:24.891905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:23:00.277581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879225+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T13:52:24.879225+0000","last_peered":"2023-07-13T13:52:24.879225+0000","last_clean":"2023-07-13T13:52:24.879225+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T13:52:24.879225+0000","last_undegraded":"2023-07-13T13:52:24.879225+0000","last_fullsized":"2023-07-13T13:52:24.879225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879206+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T13:52:24.879206+0000","last_peered":"2023-07-13T13:52:24.879206+0000","last_clean":"2023-07-13T13:52:24.879206+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T13:52:24.879206+0000","last_undegraded":"2023-07-13T13:52:24.879206+0000","last_fullsized":"2023-07-13T13:52:24.879206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:48.589588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927710+0000","last_change":"2023-07-13T13:52:00.015919+0000","last_active":"2023-07-13T13:52:24.927710+0000","last_peered":"2023-07-13T13:52:24.927710+0000","last_clean":"2023-07-13T13:52:24.927710+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T13:52:24.927710+0000","last_undegraded":"2023-07-13T13:52:24.927710+0000","last_fullsized":"2023-07-13T13:52:24.927710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:46:47.618201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927436+0000","last_change":"2023-07-13T13:52:16.665545+0000","last_active":"2023-07-13T13:52:24.927436+0000","last_peered":"2023-07-13T13:52:24.927436+0000","last_clean":"2023-07-13T13:52:24.927436+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T13:52:24.927436+0000","last_undegraded":"2023-07-13T13:52:24.927436+0000","last_fullsized":"2023-07-13T13:52:24.927436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:49:05.784529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927636+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T13:52:24.927636+0000","last_peered":"2023-07-13T13:52:24.927636+0000","last_clean":"2023-07-13T13:52:24.927636+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T13:52:24.927636+0000","last_undegraded":"2023-07-13T13:52:24.927636+0000","last_fullsized":"2023-07-13T13:52:24.927636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:16:16.297416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892883+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T13:52:24.892883+0000","last_peered":"2023-07-13T13:52:24.892883+0000","last_clean":"2023-07-13T13:52:24.892883+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T13:52:24.892883+0000","last_undegraded":"2023-07-13T13:52:24.892883+0000","last_fullsized":"2023-07-13T13:52:24.892883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:36:27.732091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927759+0000","last_change":"2023-07-13T13:52:16.631174+0000","last_active":"2023-07-13T13:52:24.927759+0000","last_peered":"2023-07-13T13:52:24.927759+0000","last_clean":"2023-07-13T13:52:24.927759+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T13:52:24.927759+0000","last_undegraded":"2023-07-13T13:52:24.927759+0000","last_fullsized":"2023-07-13T13:52:24.927759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:23:47.339702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.886111+0000","last_change":"2023-07-13T13:52:17.952450+0000","last_active":"2023-07-13T13:52:24.886111+0000","last_peered":"2023-07-13T13:52:24.886111+0000","last_clean":"2023-07-13T13:52:24.886111+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T13:52:24.886111+0000","last_undegraded":"2023-07-13T13:52:24.886111+0000","last_fullsized":"2023-07-13T13:52:24.886111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:54:12.474885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928304+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T13:52:24.928304+0000","last_peered":"2023-07-13T13:52:24.928304+0000","last_clean":"2023-07-13T13:52:24.928304+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T13:52:24.928304+0000","last_undegraded":"2023-07-13T13:52:24.928304+0000","last_fullsized":"2023-07-13T13:52:24.928304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:48.589588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928144+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T13:52:24.928144+0000","last_peered":"2023-07-13T13:52:24.928144+0000","last_clean":"2023-07-13T13:52:24.928144+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T13:52:24.928144+0000","last_undegraded":"2023-07-13T13:52:24.928144+0000","last_fullsized":"2023-07-13T13:52:24.928144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:36.347129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928459+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T13:52:24.928459+0000","last_peered":"2023-07-13T13:52:24.928459+0000","last_clean":"2023-07-13T13:52:24.928459+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T13:52:24.928459+0000","last_undegraded":"2023-07-13T13:52:24.928459+0000","last_fullsized":"2023-07-13T13:52:24.928459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:32:17.932880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927922+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T13:52:24.927922+0000","last_peered":"2023-07-13T13:52:24.927922+0000","last_clean":"2023-07-13T13:52:24.927922+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T13:52:24.927922+0000","last_undegraded":"2023-07-13T13:52:24.927922+0000","last_fullsized":"2023-07-13T13:52:24.927922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:50:50.731203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928843+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T13:52:24.928843+0000","last_peered":"2023-07-13T13:52:24.928843+0000","last_clean":"2023-07-13T13:52:24.928843+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T13:52:24.928843+0000","last_undegraded":"2023-07-13T13:52:24.928843+0000","last_fullsized":"2023-07-13T13:52:24.928843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:11:58.722955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927870+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T13:52:24.927870+0000","last_peered":"2023-07-13T13:52:24.927870+0000","last_clean":"2023-07-13T13:52:24.927870+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T13:52:24.927870+0000","last_undegraded":"2023-07-13T13:52:24.927870+0000","last_fullsized":"2023-07-13T13:52:24.927870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:04:57.309588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927014+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T13:52:24.927014+0000","last_peered":"2023-07-13T13:52:24.927014+0000","last_clean":"2023-07-13T13:52:24.927014+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T13:52:24.927014+0000","last_undegraded":"2023-07-13T13:52:24.927014+0000","last_fullsized":"2023-07-13T13:52:24.927014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:02.313280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879724+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T13:52:24.879724+0000","last_peered":"2023-07-13T13:52:24.879724+0000","last_clean":"2023-07-13T13:52:24.879724+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T13:52:24.879724+0000","last_undegraded":"2023-07-13T13:52:24.879724+0000","last_fullsized":"2023-07-13T13:52:24.879724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:16:20.785254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879350+0000","last_change":"2023-07-13T13:52:17.925281+0000","last_active":"2023-07-13T13:52:24.879350+0000","last_peered":"2023-07-13T13:52:24.879350+0000","last_clean":"2023-07-13T13:52:24.879350+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T13:52:24.879350+0000","last_undegraded":"2023-07-13T13:52:24.879350+0000","last_fullsized":"2023-07-13T13:52:24.879350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:02.191186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891831+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T13:52:24.891831+0000","last_peered":"2023-07-13T13:52:24.891831+0000","last_clean":"2023-07-13T13:52:24.891831+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T13:52:24.891831+0000","last_undegraded":"2023-07-13T13:52:24.891831+0000","last_fullsized":"2023-07-13T13:52:24.891831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:35:42.802232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927618+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T13:52:24.927618+0000","last_peered":"2023-07-13T13:52:24.927618+0000","last_clean":"2023-07-13T13:52:24.927618+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T13:52:24.927618+0000","last_undegraded":"2023-07-13T13:52:24.927618+0000","last_fullsized":"2023-07-13T13:52:24.927618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:38.871196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927419+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T13:52:24.927419+0000","last_peered":"2023-07-13T13:52:24.927419+0000","last_clean":"2023-07-13T13:52:24.927419+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T13:52:24.927419+0000","last_undegraded":"2023-07-13T13:52:24.927419+0000","last_fullsized":"2023-07-13T13:52:24.927419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:37:29.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927179+0000","last_change":"2023-07-13T13:52:17.933894+0000","last_active":"2023-07-13T13:52:24.927179+0000","last_peered":"2023-07-13T13:52:24.927179+0000","last_clean":"2023-07-13T13:52:24.927179+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T13:52:24.927179+0000","last_undegraded":"2023-07-13T13:52:24.927179+0000","last_fullsized":"2023-07-13T13:52:24.927179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:55:58.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879592+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T13:52:24.879592+0000","last_peered":"2023-07-13T13:52:24.879592+0000","last_clean":"2023-07-13T13:52:24.879592+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T13:52:24.879592+0000","last_undegraded":"2023-07-13T13:52:24.879592+0000","last_fullsized":"2023-07-13T13:52:24.879592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:05:06.705721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928085+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T13:52:24.928085+0000","last_peered":"2023-07-13T13:52:24.928085+0000","last_clean":"2023-07-13T13:52:24.928085+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T13:52:24.928085+0000","last_undegraded":"2023-07-13T13:52:24.928085+0000","last_fullsized":"2023-07-13T13:52:24.928085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:03:23.227917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879302+0000","last_change":"2023-07-13T13:52:17.838377+0000","last_active":"2023-07-13T13:52:24.879302+0000","last_peered":"2023-07-13T13:52:24.879302+0000","last_clean":"2023-07-13T13:52:24.879302+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T13:52:24.879302+0000","last_undegraded":"2023-07-13T13:52:24.879302+0000","last_fullsized":"2023-07-13T13:52:24.879302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:37.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892135+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T13:52:24.892135+0000","last_peered":"2023-07-13T13:52:24.892135+0000","last_clean":"2023-07-13T13:52:24.892135+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T13:52:24.892135+0000","last_undegraded":"2023-07-13T13:52:24.892135+0000","last_fullsized":"2023-07-13T13:52:24.892135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:34:06.937251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":722199,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":718771,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":127911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":131671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":128473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T13:52:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-13T13:52:50.761 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-13T13:52:50.762 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-13T13:52:50.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-13T13:52:50.763 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-13T13:52:50.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.941+0000 7f923d5f7700 1 Processor -- start 2023-07-13T13:52:50.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.942+0000 7f923d5f7700 1 -- start start 2023-07-13T13:52:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.942+0000 7f923d5f7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f92380c6f30 0x7f92380cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.942+0000 7f923d5f7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92380c9c20 0x7f92380c7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.942+0000 7f923d5f7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f923806e040 0x7f92381583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.942+0000 7f923d5f7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92380c8f50 con 0x7f92380c6f30 2023-07-13T13:52:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.942+0000 7f923d5f7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92380c7840 con 0x7f923806e040 2023-07-13T13:52:50.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.942+0000 7f923d5f7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92380c9790 con 0x7f92380c9c20 2023-07-13T13:52:50.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.943+0000 7f92367fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92380c9c20 0x7f92380c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.943+0000 7f92377fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f923806e040 0x7f92381583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.943+0000 7f92367fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92380c9c20 0x7f92380c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34358/0 (socket says 172.21.15.118:34358) 2023-07-13T13:52:50.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.943+0000 7f92377fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f923806e040 0x7f92381583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48076/0 (socket says 172.21.15.118:48076) 2023-07-13T13:52:50.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.943+0000 7f92367fc700 1 -- 172.21.15.118:0/2277488649 learned_addr learned my addr 172.21.15.118:0/2277488649 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:50.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.946+0000 7f9236ffd700 1 --2- 172.21.15.118:0/2277488649 >> v2:172.21.15.118:3300/0 conn(0x7f92380c6f30 0x7f92380cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.947+0000 7f92377fe700 1 -- 172.21.15.118:0/2277488649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92380c9c20 msgr2=0x7f92380c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.947+0000 7f92377fe700 1 --2- 172.21.15.118:0/2277488649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92380c9c20 0x7f92380c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.947+0000 7f92377fe700 1 -- 172.21.15.118:0/2277488649 >> v2:172.21.15.118:3300/0 conn(0x7f92380c6f30 msgr2=0x7f92380cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.947+0000 7f92377fe700 1 --2- 172.21.15.118:0/2277488649 >> v2:172.21.15.118:3300/0 conn(0x7f92380c6f30 0x7f92380cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.947+0000 7f92377fe700 1 -- 172.21.15.118:0/2277488649 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923806ec80 con 0x7f923806e040 2023-07-13T13:52:50.922 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.949+0000 7f92377fe700 1 --2- 172.21.15.118:0/2277488649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f923806e040 0x7f92381583e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92380b1a30 tx=0x7f923000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d71360fc963eab97 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:50.926 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f9235ffb700 1 -- 172.21.15.118:0/2277488649 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923000e070 con 0x7f923806e040 2023-07-13T13:52:50.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f9235ffb700 1 -- 172.21.15.118:0/2277488649 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923000bb20 con 0x7f923806e040 2023-07-13T13:52:50.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f9235ffb700 1 -- 172.21.15.118:0/2277488649 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230012430 con 0x7f923806e040 2023-07-13T13:52:50.927 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f923d5f7700 1 -- 172.21.15.118:0/2277488649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f923806e040 msgr2=0x7f92381583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f923d5f7700 1 --2- 172.21.15.118:0/2277488649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f923806e040 0x7f92381583e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92380b1a30 tx=0x7f923000b330 comp rx=0 tx=0).stop 2023-07-13T13:52:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f923d5f7700 1 -- 172.21.15.118:0/2277488649 shutdown_connections 2023-07-13T13:52:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f923d5f7700 1 --2- 172.21.15.118:0/2277488649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f923806e040 0x7f92381583e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f923d5f7700 1 --2- 172.21.15.118:0/2277488649 >> v2:172.21.15.118:3300/0 conn(0x7f92380c6f30 0x7f92380cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f923d5f7700 1 --2- 172.21.15.118:0/2277488649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f92380c9c20 0x7f92380c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.928 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.954+0000 7f923d5f7700 1 -- 172.21.15.118:0/2277488649 >> 172.21.15.118:0/2277488649 conn(0x7f9238069f30 msgr2=0x7f923806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:50.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.955+0000 7f923d5f7700 1 -- 172.21.15.118:0/2277488649 shutdown_connections 2023-07-13T13:52:50.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.955+0000 7f923d5f7700 1 -- 172.21.15.118:0/2277488649 wait complete. 2023-07-13T13:52:50.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.956+0000 7f923d5f7700 1 Processor -- start 2023-07-13T13:52:50.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.956+0000 7f923d5f7700 1 -- start start 2023-07-13T13:52:50.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.956+0000 7f923d5f7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f923806e040 0x7f92380cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.957+0000 7f923d5f7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92380c6f30 0x7f9238150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.957+0000 7f923d5f7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92380c9c20 0x7f9238156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.957+0000 7f923d5f7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92381f15f0 con 0x7f92380c9c20 2023-07-13T13:52:50.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.957+0000 7f923d5f7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92381f2170 con 0x7f92380c6f30 2023-07-13T13:52:50.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.957+0000 7f923d5f7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9238150f00 con 0x7f923806e040 2023-07-13T13:52:50.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.957+0000 7f92367fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92380c6f30 0x7f9238150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.957+0000 7f9236ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f923806e040 0x7f92380cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.957+0000 7f92377fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92380c9c20 0x7f9238156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.958+0000 7f92377fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92380c9c20 0x7f9238156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43098/0 (socket says 172.21.15.118:43098) 2023-07-13T13:52:50.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.958+0000 7f92377fe700 1 -- 172.21.15.118:0/1862131862 learned_addr learned my addr 172.21.15.118:0/1862131862 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:50.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.961+0000 7f92377fe700 1 -- 172.21.15.118:0/1862131862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f923806e040 msgr2=0x7f92380cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.961+0000 7f92377fe700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f923806e040 0x7f92380cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.961+0000 7f92377fe700 1 -- 172.21.15.118:0/1862131862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92380c6f30 msgr2=0x7f9238150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:50.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.961+0000 7f92377fe700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92380c6f30 0x7f9238150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:50.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.961+0000 7f92377fe700 1 -- 172.21.15.118:0/1862131862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230009a70 con 0x7f92380c9c20 2023-07-13T13:52:50.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.964+0000 7f92377fe700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92380c9c20 0x7f9238156010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92300042a0 tx=0x7f9230004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:50.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.968+0000 7f921f7fe700 1 -- 172.21.15.118:0/1862131862 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230004890 con 0x7f92380c9c20 2023-07-13T13:52:50.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.968+0000 7f921f7fe700 1 -- 172.21.15.118:0/1862131862 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230020070 con 0x7f92380c9c20 2023-07-13T13:52:50.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.968+0000 7f921f7fe700 1 -- 172.21.15.118:0/1862131862 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300276c0 con 0x7f92380c9c20 2023-07-13T13:52:50.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.968+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9238156930 con 0x7f92380c9c20 2023-07-13T13:52:50.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.968+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92381f1b20 con 0x7f92380c9c20 2023-07-13T13:52:50.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.969+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92381f2500 con 0x7f92380c9c20 2023-07-13T13:52:50.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.988+0000 7f921f7fe700 1 -- 172.21.15.118:0/1862131862 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9230012430 con 0x7f92380c9c20 2023-07-13T13:52:50.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.989+0000 7f921f7fe700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f922406ad30 0x7f922406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:50.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.989+0000 7f9236ffd700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f922406ad30 0x7f922406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:50.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:50.989+0000 7f9236ffd700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f922406ad30 0x7f922406d1e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9228006b20 tx=0x7f9228008040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:50.973 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:52:50.975 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:52:51.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.234+0000 7f921f7fe700 1 -- 172.21.15.118:0/1862131862 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9230022070 con 0x7f92380c9c20 2023-07-13T13:52:51.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.234+0000 7f921f7fe700 1 -- 172.21.15.118:0/1862131862 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9230056800 con 0x7f92380c9c20 2023-07-13T13:52:51.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.519+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f92380743c0 con 0x7f92380c9c20 2023-07-13T13:52:51.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.679+0000 7f921f7fe700 1 -- 172.21.15.118:0/1862131862 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v7) v1 ==== 74+0+170849 (secure 0 0 0) 0x7f9230059e20 con 0x7f92380c9c20 2023-07-13T13:52:51.654 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:51.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f922406ad30 msgr2=0x7f922406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:51.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f922406ad30 0x7f922406d1e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9228006b20 tx=0x7f9228008040 comp rx=0 tx=0).stop 2023-07-13T13:52:51.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92380c9c20 msgr2=0x7f9238156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:51.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92380c9c20 0x7f9238156010 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92300042a0 tx=0x7f9230004ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 shutdown_connections 2023-07-13T13:52:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f922406ad30 0x7f922406d1e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92380c9c20 0x7f9238156010 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f923806e040 0x7f92380cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 --2- 172.21.15.118:0/1862131862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92380c6f30 0x7f9238150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 >> 172.21.15.118:0/1862131862 conn(0x7f9238069f30 msgr2=0x7f923814e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 shutdown_connections 2023-07-13T13:52:51.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.682+0000 7f923d5f7700 1 -- 172.21.15.118:0/1862131862 wait complete. 2023-07-13T13:52:51.667 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":7,"active_gid":4192,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1448394653},{"type":"v1","addr":"172.21.15.118:6833","nonce":1448394653}]},"active_addr":"172.21.15.118:6833/1448394653","active_change":"2023-07-13T13:51:54.466084+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":14,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":3060157449}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":423463927}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":3396165357}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":3323211457}]}]} 2023-07-13T13:52:51.672 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-13T13:52:51.672 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-13T13:52:51.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:51.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.820+0000 7fcaf93b7700 1 Processor -- start 2023-07-13T13:52:51.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.820+0000 7fcaf93b7700 1 -- start start 2023-07-13T13:52:51.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.821+0000 7fcaf93b7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcaf40c90c0 0x7fcaf40c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:51.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.821+0000 7fcaf93b7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcaf4158390 0x7fcaf4162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:51.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.821+0000 7fcaf93b7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf40c8b40 con 0x7fcaf40c99c0 2023-07-13T13:52:51.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.821+0000 7fcaf93b7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf406c080 con 0x7fcaf40c90c0 2023-07-13T13:52:51.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.821+0000 7fcaf93b7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf40ca910 con 0x7fcaf4158390 2023-07-13T13:52:51.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.822+0000 7fcaf27fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcaf40c90c0 0x7fcaf40c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:51.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.822+0000 7fcaf37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcaf4158390 0x7fcaf4162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:51.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.822+0000 7fcaf37fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcaf4158390 0x7fcaf4162cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48104/0 (socket says 172.21.15.118:48104) 2023-07-13T13:52:51.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.822+0000 7fcaf37fe700 1 -- 172.21.15.118:0/603386440 learned_addr learned my addr 172.21.15.118:0/603386440 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:51.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.825+0000 7fcaf37fe700 1 -- 172.21.15.118:0/603386440 >> v2:172.21.15.118:3300/0 conn(0x7fcaf40c90c0 msgr2=0x7fcaf40c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:51.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.825+0000 7fcaf37fe700 1 --2- 172.21.15.118:0/603386440 >> v2:172.21.15.118:3300/0 conn(0x7fcaf40c90c0 0x7fcaf40c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.825+0000 7fcaf37fe700 1 -- 172.21.15.118:0/603386440 >> v1:172.21.15.118:6789/0 conn(0x7fcaf40c99c0 legacy=0x7fcaf40c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:51.798 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.825+0000 7fcaf37fe700 1 -- 172.21.15.118:0/603386440 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40ca2d0 con 0x7fcaf4158390 2023-07-13T13:52:51.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.827+0000 7fcaf37fe700 1 --2- 172.21.15.118:0/603386440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 0x7fcaf4162cd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcaf406aa90 tx=0x7fcaec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8551be835e482eb server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:51.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.831+0000 7fcaf1ffb700 1 -- 172.21.15.118:0/603386440 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00e070 con 0x7fcaf4158390 2023-07-13T13:52:51.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.831+0000 7fcaf1ffb700 1 -- 172.21.15.118:0/603386440 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec00b910 con 0x7fcaf4158390 2023-07-13T13:52:51.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.831+0000 7fcaf1ffb700 1 -- 172.21.15.118:0/603386440 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00bcc0 con 0x7fcaf4158390 2023-07-13T13:52:51.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.832+0000 7fcaf93b7700 1 -- 172.21.15.118:0/603386440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 msgr2=0x7fcaf4162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:51.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.832+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/603386440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 0x7fcaf4162cd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcaf406aa90 tx=0x7fcaec00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:51.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.832+0000 7fcaf93b7700 1 -- 172.21.15.118:0/603386440 shutdown_connections 2023-07-13T13:52:51.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.832+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/603386440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 0x7fcaf4162cd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.832+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/603386440 >> v2:172.21.15.118:3300/0 conn(0x7fcaf40c90c0 0x7fcaf40c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.832+0000 7fcaf93b7700 1 -- 172.21.15.118:0/603386440 >> 172.21.15.118:0/603386440 conn(0x7fcaf406c750 msgr2=0x7fcaf406cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:51.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.832+0000 7fcaf93b7700 1 -- 172.21.15.118:0/603386440 shutdown_connections 2023-07-13T13:52:51.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.832+0000 7fcaf93b7700 1 -- 172.21.15.118:0/603386440 wait complete. 2023-07-13T13:52:51.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.833+0000 7fcaf93b7700 1 Processor -- start 2023-07-13T13:52:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.833+0000 7fcaf93b7700 1 -- start start 2023-07-13T13:52:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf93b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaf40c90c0 0x7fcaf41e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf93b7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcaf40c99c0 0x7fcaf41e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf93b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 0x7fcaf4146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:51.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf93b7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4157b40 con 0x7fcaf40c90c0 2023-07-13T13:52:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf93b7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf41e0630 con 0x7fcaf4158390 2023-07-13T13:52:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf93b7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf4159510 con 0x7fcaf40c99c0 2023-07-13T13:52:51.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf2ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaf40c90c0 0x7fcaf41e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:51.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 0x7fcaf4146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:51.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.834+0000 7fcaf27fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcaf40c99c0 0x7fcaf41e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:51.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.835+0000 7fcaf2ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaf40c90c0 0x7fcaf41e0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43116/0 (socket says 172.21.15.118:43116) 2023-07-13T13:52:51.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.835+0000 7fcaf2ffd700 1 -- 172.21.15.118:0/4017259336 learned_addr learned my addr 172.21.15.118:0/4017259336 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:51.811 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.838+0000 7fcaf2ffd700 1 -- 172.21.15.118:0/4017259336 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcaf40c99c0 msgr2=0x7fcaf41e0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:51.811 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.838+0000 7fcaf2ffd700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcaf40c99c0 0x7fcaf41e0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.838+0000 7fcaf2ffd700 1 -- 172.21.15.118:0/4017259336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 msgr2=0x7fcaf4146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:51.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.838+0000 7fcaf2ffd700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 0x7fcaf4146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:51.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.838+0000 7fcaf2ffd700 1 -- 172.21.15.118:0/4017259336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec009b30 con 0x7fcaf40c90c0 2023-07-13T13:52:51.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.838+0000 7fcaf37fe700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 0x7fcaf4146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:51.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.841+0000 7fcaf2ffd700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaf40c90c0 0x7fcaf41e0a80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcae800c4e0 tx=0x7fcae800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:51.818 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.845+0000 7fcadb7fe700 1 -- 172.21.15.118:0/4017259336 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80052d0 con 0x7fcaf40c90c0 2023-07-13T13:52:51.818 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.845+0000 7fcadb7fe700 1 -- 172.21.15.118:0/4017259336 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae8005430 con 0x7fcaf40c90c0 2023-07-13T13:52:51.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.845+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf41ee890 con 0x7fcaf40c90c0 2023-07-13T13:52:51.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.845+0000 7fcadb7fe700 1 -- 172.21.15.118:0/4017259336 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80038c0 con 0x7fcaf40c90c0 2023-07-13T13:52:51.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.845+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf4157d20 con 0x7fcaf40c90c0 2023-07-13T13:52:51.819 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.846+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf40743c0 con 0x7fcaf40c90c0 2023-07-13T13:52:51.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.872+0000 7fcadb7fe700 1 -- 172.21.15.118:0/4017259336 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcae8003a20 con 0x7fcaf40c90c0 2023-07-13T13:52:51.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.872+0000 7fcadb7fe700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcae006ad30 0x7fcae006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:51.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.872+0000 7fcadb7fe700 1 -- 172.21.15.118:0/4017259336 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcae8088fc0 con 0x7fcaf40c90c0 2023-07-13T13:52:51.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.872+0000 7fcaf27fc700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcae006ad30 0x7fcae006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:51.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:51.872+0000 7fcaf27fc700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcae006ad30 0x7fcae006d1e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcaf41473d0 tx=0x7fcae4009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.107+0000 7fcadb7fe700 1 -- 172.21.15.118:0/4017259336 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcae8053d60 con 0x7fcaf40c90c0 2023-07-13T13:52:52.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.295+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaf40c97a0 con 0x7fcaf40c90c0 2023-07-13T13:52:52.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.345+0000 7fcadb7fe700 1 -- 172.21.15.118:0/4017259336 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fcae8057380 con 0x7fcaf40c90c0 2023-07-13T13:52:52.318 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:52.319 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:52.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcae006ad30 msgr2=0x7fcae006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcae006ad30 0x7fcae006d1e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcaf41473d0 tx=0x7fcae4009210 comp rx=0 tx=0).stop 2023-07-13T13:52:52.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaf40c90c0 msgr2=0x7fcaf41e0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaf40c90c0 0x7fcaf41e0a80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcae800c4e0 tx=0x7fcae800c7f0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 shutdown_connections 2023-07-13T13:52:52.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcae006ad30 0x7fcae006d1e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf4158390 0x7fcaf4146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcaf40c90c0 0x7fcaf41e0a80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 --2- 172.21.15.118:0/4017259336 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcaf40c99c0 0x7fcaf41e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 >> 172.21.15.118:0/4017259336 conn(0x7fcaf406c750 msgr2=0x7fcaf40cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:52.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 shutdown_connections 2023-07-13T13:52:52.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.347+0000 7fcaf93b7700 1 -- 172.21.15.118:0/4017259336 wait complete. 2023-07-13T13:52:52.333 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-13T13:52:52.334 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:52:52.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.484+0000 7fa9c1dff700 1 Processor -- start 2023-07-13T13:52:52.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.484+0000 7fa9c1dff700 1 -- start start 2023-07-13T13:52:52.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.484+0000 7fa9c1dff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9bc152a90 0x7fa9bc070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:52.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.484+0000 7fa9c1dff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc15bd70 con 0x7fa9bc0cb840 2023-07-13T13:52:52.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.484+0000 7fa9c1dff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc06f680 con 0x7fa9bc071d50 2023-07-13T13:52:52.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.484+0000 7fa9c1dff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9bc152e60 con 0x7fa9bc152a90 2023-07-13T13:52:52.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.485+0000 7fa9bb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9bc152a90 0x7fa9bc070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:52.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.485+0000 7fa9baffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa9bc071d50 0x7fa9bc15c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:42836/0 (socket says 172.21.15.118:42836) 2023-07-13T13:52:52.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.485+0000 7fa9baffd700 1 -- 172.21.15.118:0/1890675130 learned_addr learned my addr 172.21.15.118:0/1890675130 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:52.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.488+0000 7fa9ba7fc700 1 -- 172.21.15.118:0/1890675130 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237775806 0 0) 0x7fa9bc06f680 con 0x7fa9bc071d50 2023-07-13T13:52:52.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.488+0000 7fa9ba7fc700 1 -- 172.21.15.118:0/1890675130 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a40035b0 con 0x7fa9bc071d50 2023-07-13T13:52:52.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.490+0000 7fa9bb7fe700 1 -- 172.21.15.118:0/1890675130 >> v1:172.21.15.123:6789/0 conn(0x7fa9bc071d50 legacy=0x7fa9bc15c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.490+0000 7fa9bb7fe700 1 -- 172.21.15.118:0/1890675130 >> v1:172.21.15.118:6789/0 conn(0x7fa9bc0cb840 legacy=0x7fa9bc163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.490+0000 7fa9bb7fe700 1 -- 172.21.15.118:0/1890675130 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc159580 con 0x7fa9bc152a90 2023-07-13T13:52:52.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.492+0000 7fa9bb7fe700 1 --2- 172.21.15.118:0/1890675130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 0x7fa9bc070d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009840 tx=0x7fa9ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d987dc9767d4bf server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:52.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9ba7fc700 1 -- 172.21.15.118:0/1890675130 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac011830 con 0x7fa9bc152a90 2023-07-13T13:52:52.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9ba7fc700 1 -- 172.21.15.118:0/1890675130 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac011990 con 0x7fa9bc152a90 2023-07-13T13:52:52.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9ba7fc700 1 -- 172.21.15.118:0/1890675130 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac011d20 con 0x7fa9bc152a90 2023-07-13T13:52:52.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1890675130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 msgr2=0x7fa9bc070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9c1dff700 1 --2- 172.21.15.118:0/1890675130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 0x7fa9bc070d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009840 tx=0x7fa9ac009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:52.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1890675130 shutdown_connections 2023-07-13T13:52:52.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9c1dff700 1 --2- 172.21.15.118:0/1890675130 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 0x7fa9bc070d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1890675130 >> 172.21.15.118:0/1890675130 conn(0x7fa9bc06cf10 msgr2=0x7fa9bc06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:52.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1890675130 shutdown_connections 2023-07-13T13:52:52.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.498+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1890675130 wait complete. 2023-07-13T13:52:52.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.500+0000 7fa9c1dff700 1 Processor -- start 2023-07-13T13:52:52.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.500+0000 7fa9c1dff700 1 -- start start 2023-07-13T13:52:52.474 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.501+0000 7fa9c1dff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9bc071d50 0x7fa9bc14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:52.474 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.501+0000 7fa9c1dff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9bc0cb840 0x7fa9bc14bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:52.474 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.501+0000 7fa9c1dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 0x7fa9bc14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:52.474 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.501+0000 7fa9c1dff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc0c4420 con 0x7fa9bc152a90 2023-07-13T13:52:52.474 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.501+0000 7fa9c1dff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc1562e0 con 0x7fa9bc0cb840 2023-07-13T13:52:52.474 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.501+0000 7fa9c1dff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc1eeb20 con 0x7fa9bc071d50 2023-07-13T13:52:52.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.501+0000 7fa9bbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 0x7fa9bc14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:52.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.502+0000 7fa9baffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9bc0cb840 0x7fa9bc14bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:52.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.502+0000 7fa9bb7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9bc071d50 0x7fa9bc14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:52.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.502+0000 7fa9bbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 0x7fa9bc14c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43134/0 (socket says 172.21.15.118:43134) 2023-07-13T13:52:52.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.502+0000 7fa9bbfff700 1 -- 172.21.15.118:0/1080120649 learned_addr learned my addr 172.21.15.118:0/1080120649 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:52.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.506+0000 7fa9baffd700 1 -- 172.21.15.118:0/1080120649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9bc071d50 msgr2=0x7fa9bc14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.506+0000 7fa9baffd700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9bc071d50 0x7fa9bc14dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.506+0000 7fa9baffd700 1 -- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 msgr2=0x7fa9bc14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.506+0000 7fa9baffd700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 0x7fa9bc14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.506+0000 7fa9baffd700 1 -- 172.21.15.118:0/1080120649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ac0094a0 con 0x7fa9bc0cb840 2023-07-13T13:52:52.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.508+0000 7fa9baffd700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9bc0cb840 0x7fa9bc14bb00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000c490 tx=0x7fa9b000c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:52.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.510+0000 7fa9a3fff700 1 -- 172.21.15.118:0/1080120649 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0005d70 con 0x7fa9bc0cb840 2023-07-13T13:52:52.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.511+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc0c4650 con 0x7fa9bc0cb840 2023-07-13T13:52:52.484 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.511+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc1eedc0 con 0x7fa9bc0cb840 2023-07-13T13:52:52.484 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.511+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc0c2e40 con 0x7fa9bc0cb840 2023-07-13T13:52:52.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.533+0000 7fa9a3fff700 1 -- 172.21.15.118:0/1080120649 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b00070d0 con 0x7fa9bc0cb840 2023-07-13T13:52:52.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.533+0000 7fa9a3fff700 1 -- 172.21.15.118:0/1080120649 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0007440 con 0x7fa9bc0cb840 2023-07-13T13:52:52.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.533+0000 7fa9a3fff700 1 -- 172.21.15.118:0/1080120649 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9b0007620 con 0x7fa9bc0cb840 2023-07-13T13:52:52.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.534+0000 7fa9a3fff700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9a806ace0 0x7fa9a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.534+0000 7fa9bb7fe700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9a806ace0 0x7fa9a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.534+0000 7fa9bb7fe700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9a806ace0 0x7fa9a806d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac01c040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:52.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.537+0000 7fa9a3fff700 1 -- 172.21.15.118:0/1080120649 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9b0057ab0 con 0x7fa9bc0cb840 2023-07-13T13:52:52.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.782+0000 7fa9a3fff700 1 -- 172.21.15.118:0/1080120649 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9b0053df0 con 0x7fa9bc0cb840 2023-07-13T13:52:52.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:52.967+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9bc0743c0 con 0x7fa9bc0cb840 2023-07-13T13:52:52.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.017+0000 7fa9a3fff700 1 -- 172.21.15.118:0/1080120649 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fa9b0057410 con 0x7fa9bc0cb840 2023-07-13T13:52:52.990 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:52.990 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":29,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:24.680967+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:52:52.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9a806ace0 msgr2=0x7fa9a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9a806ace0 0x7fa9a806d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac01c040 comp rx=0 tx=0).stop 2023-07-13T13:52:52.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9bc0cb840 msgr2=0x7fa9bc14bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:52.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9bc0cb840 0x7fa9bc14bb00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000c490 tx=0x7fa9b000c7a0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 shutdown_connections 2023-07-13T13:52:52.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa9a806ace0 0x7fa9a806d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa9bc152a90 0x7fa9bc14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa9bc071d50 0x7fa9bc14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 --2- 172.21.15.118:0/1080120649 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9bc0cb840 0x7fa9bc14bb00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:52.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 >> 172.21.15.118:0/1080120649 conn(0x7fa9bc06cf10 msgr2=0x7fa9bc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:52.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 shutdown_connections 2023-07-13T13:52:52.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.018+0000 7fa9c1dff700 1 -- 172.21.15.118:0/1080120649 wait complete. 2023-07-13T13:52:53.004 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-13T13:52:53.004 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-13T13:52:53.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-13T13:52:53.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-13T13:52:53.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-13T13:52:53.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-13T13:52:53.007 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-13T13:52:53.007 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-13T13:52:53.221 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.249+0000 7fbe867fe700 1 Processor -- start 2023-07-13T13:52:53.222 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.249+0000 7fb1f0138700 1 Processor -- start 2023-07-13T13:52:53.222 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.249+0000 7fbe867fe700 1 -- start start 2023-07-13T13:52:53.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fbe867fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe800c7b30 0x7fbe8014ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fbe867fe700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe80071010 con 0x7fbe8006fc30 2023-07-13T13:52:53.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fbe867fe700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe800712d0 con 0x7fbe8006aa40 2023-07-13T13:52:53.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fbe867fe700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe800c5cc0 con 0x7fbe800c7b30 2023-07-13T13:52:53.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.249+0000 7fb1f0138700 1 -- start start 2023-07-13T13:52:53.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fb1f0138700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e806b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fb1f0138700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb1e806b580 0x7fb1e80c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fb1f0138700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e80c4720 con 0x7fb1e814f750 2023-07-13T13:52:53.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fb1f0138700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e80c2900 con 0x7fb1e806b580 2023-07-13T13:52:53.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fb1f0138700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8155e60 con 0x7fb1e806e4c0 2023-07-13T13:52:53.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.249+0000 7fed363f9700 1 Processor -- start 2023-07-13T13:52:53.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.249+0000 7fed363f9700 1 -- start start 2023-07-13T13:52:53.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fed363f9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed300c7790 0x7fed30160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fed363f9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed3006ff90 0x7fed301608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fed363f9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed300c4fc0 con 0x7fed30157060 2023-07-13T13:52:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fed363f9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed300c5360 con 0x7fed300c7790 2023-07-13T13:52:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.250+0000 7fed363f9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3006bdc0 con 0x7fed3006ff90 2023-07-13T13:52:53.226 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.251+0000 7fb1ed6d3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e806b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.227 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.251+0000 7f8c68833700 1 Processor -- start 2023-07-13T13:52:53.227 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.251+0000 7f8c68833700 1 -- start start 2023-07-13T13:52:53.227 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.252+0000 7fb1ed6d3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e806b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34420/0 (socket says 172.21.15.118:34420) 2023-07-13T13:52:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.252+0000 7fb1ed6d3700 1 -- 172.21.15.118:0/2291137319 learned_addr learned my addr 172.21.15.118:0/2291137319 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.252+0000 7fb362d43700 1 Processor -- start 2023-07-13T13:52:53.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.252+0000 7fbe7ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe800c7b30 0x7fbe8014ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7fbe7ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe800c7b30 0x7fbe8014ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48126/0 (socket says 172.21.15.118:48126) 2023-07-13T13:52:53.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7fbe7ffff700 1 -- 172.21.15.118:0/1919358027 learned_addr learned my addr 172.21.15.118:0/1919358027 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7f8c68833700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8c640c78a0 0x7f8c64159500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7f8c68833700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c640c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7f8c68833700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c640c7670 con 0x7f8c64152de0 2023-07-13T13:52:53.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7f8c68833700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6406ff90 con 0x7f8c640c78a0 2023-07-13T13:52:53.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7f8c68833700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640c53a0 con 0x7f8c640c6cb0 2023-07-13T13:52:53.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.252+0000 7fb362d43700 1 -- start start 2023-07-13T13:52:53.230 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7fb362d43700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb35c14eca0 0x7fb35c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7fb362d43700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c14f070 con 0x7fb35c0c7b30 2023-07-13T13:52:53.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7fb362d43700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c06d2e0 con 0x7fb35c06fc30 2023-07-13T13:52:53.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.253+0000 7fb362d43700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0c5cc0 con 0x7fb35c14eca0 2023-07-13T13:52:53.231 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.254+0000 7fed34996700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed3006ff90 0x7fed301608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.255+0000 7f8c62d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c640c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.255+0000 7fb1ed6d3700 1 -- 172.21.15.118:0/2291137319 >> v2:172.21.15.118:3300/0 conn(0x7fb1e806b580 msgr2=0x7fb1e80c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.255+0000 7fb1ed6d3700 1 --2- 172.21.15.118:0/2291137319 >> v2:172.21.15.118:3300/0 conn(0x7fb1e806b580 0x7fb1e80c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.255+0000 7fb1ed6d3700 1 -- 172.21.15.118:0/2291137319 >> v1:172.21.15.123:6789/0 conn(0x7fb1e814f750 legacy=0x7fb1e8155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.255+0000 7fb1ed6d3700 1 -- 172.21.15.118:0/2291137319 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e8156140 con 0x7fb1e806e4c0 2023-07-13T13:52:53.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.256+0000 7f525dec8700 1 Processor -- start 2023-07-13T13:52:53.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.256+0000 7f525dec8700 1 -- start start 2023-07-13T13:52:53.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.256+0000 7fbe7ffff700 1 -- 172.21.15.118:0/1919358027 >> v1:172.21.15.123:6789/0 conn(0x7fbe8006aa40 legacy=0x7fbe801548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.256+0000 7fbe7ffff700 1 -- 172.21.15.118:0/1919358027 >> v1:172.21.15.118:6789/0 conn(0x7fbe8006fc30 legacy=0x7fbe800703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.256+0000 7fbe7ffff700 1 -- 172.21.15.118:0/1919358027 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe800715b0 con 0x7fbe800c7b30 2023-07-13T13:52:53.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.257+0000 7f8c62d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c640c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34436/0 (socket says 172.21.15.118:34436) 2023-07-13T13:52:53.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.257+0000 7f8c62d9d700 1 -- 172.21.15.118:0/2787483558 learned_addr learned my addr 172.21.15.118:0/2787483558 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.256+0000 7fed34996700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed3006ff90 0x7fed301608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48138/0 (socket says 172.21.15.118:48138) 2023-07-13T13:52:53.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.256+0000 7fed34996700 1 -- 172.21.15.118:0/2246232593 learned_addr learned my addr 172.21.15.118:0/2246232593 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.257+0000 7f525dec8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5258071ab0 0x7f5258071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.257+0000 7f525dec8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f52580c7d80 0x7f5258156b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.257+0000 7f525dec8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52580c69f0 con 0x7f52581570a0 2023-07-13T13:52:53.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.257+0000 7f525dec8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52580714c0 con 0x7f5258071ab0 2023-07-13T13:52:53.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.257+0000 7f525dec8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52580723c0 con 0x7f52580c7d80 2023-07-13T13:52:53.236 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.258+0000 7fb1ed6d3700 1 --2- 172.21.15.118:0/2291137319 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e806b040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40098f0 tx=0x7fb1e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e75d9c28c7fb9caa server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.258+0000 7fed2f7fe700 1 --2- 172.21.15.118:0/2246232593 >> v2:172.21.15.118:3300/0 conn(0x7fed300c7790 0x7fed30160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.259+0000 7f79b832e700 1 Processor -- start 2023-07-13T13:52:53.237 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.259+0000 7f79b832e700 1 -- start start 2023-07-13T13:52:53.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.260+0000 7fd499118700 1 Processor -- start 2023-07-13T13:52:53.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.260+0000 7fd499118700 1 -- start start 2023-07-13T13:52:53.238 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.260+0000 7fbe7ffff700 1 --2- 172.21.15.118:0/1919358027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe800c7b30 0x7fbe8014ea30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbe740098f0 tx=0x7fbe74009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34553b4cbe39cfe server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7f79b832e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b014ee20 0x7f79b0155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7f79b832e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79b0065af0 0x7f79b0069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7f79b832e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79b006a470 0x7f79b0070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7f79b832e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00c56b0 con 0x7f79b006a470 2023-07-13T13:52:53.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7f79b832e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b0155aa0 con 0x7f79b0065af0 2023-07-13T13:52:53.239 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7f79b832e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00c73f0 con 0x7f79b014ee20 2023-07-13T13:52:53.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7fd499118700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd49406f380 0x7fd4940c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7fd499118700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4941590f0 0x7fd4940c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7fd499118700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4940c6c60 con 0x7fd494152850 2023-07-13T13:52:53.240 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7fd499118700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49406f1b0 con 0x7fd4941590f0 2023-07-13T13:52:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.261+0000 7fd499118700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940c66a0 con 0x7fd49406f380 2023-07-13T13:52:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.263+0000 7f8c62d9d700 1 -- 172.21.15.118:0/2787483558 >> v2:172.21.15.123:3300/0 conn(0x7f8c640c78a0 msgr2=0x7f8c64159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.263+0000 7f8c62d9d700 1 --2- 172.21.15.118:0/2787483558 >> v2:172.21.15.123:3300/0 conn(0x7f8c640c78a0 0x7f8c64159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.241 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.263+0000 7f8c62d9d700 1 -- 172.21.15.118:0/2787483558 >> v1:172.21.15.118:6789/0 conn(0x7f8c64152de0 legacy=0x7f8c640c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.263+0000 7f8c62d9d700 1 -- 172.21.15.118:0/2787483558 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640707a0 con 0x7f8c640c6cb0 2023-07-13T13:52:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.263+0000 7fed34996700 1 -- 172.21.15.118:0/2246232593 >> v2:172.21.15.118:3300/0 conn(0x7fed300c7790 msgr2=0x7fed30160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.263+0000 7fed34996700 1 --2- 172.21.15.118:0/2246232593 >> v2:172.21.15.118:3300/0 conn(0x7fed300c7790 0x7fed30160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.242 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.263+0000 7fed34996700 1 -- 172.21.15.118:0/2246232593 >> v1:172.21.15.123:6789/0 conn(0x7fed30157060 legacy=0x7fed300c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.263+0000 7fed34996700 1 -- 172.21.15.118:0/2246232593 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300c7cd0 con 0x7fed3006ff90 2023-07-13T13:52:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.266+0000 7fed34996700 1 --2- 172.21.15.118:0/2246232593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3006ff90 0x7fed301608a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fed300720f0 tx=0x7fed24009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676c976f76e38710 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.267+0000 7fb1eced2700 1 -- 172.21.15.118:0/2291137319 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4004230 con 0x7fb1e806e4c0 2023-07-13T13:52:53.243 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.267+0000 7fb1eced2700 1 -- 172.21.15.118:0/2291137319 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4004390 con 0x7fb1e806e4c0 2023-07-13T13:52:53.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.267+0000 7fb1eced2700 1 -- 172.21.15.118:0/2291137319 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40036a0 con 0x7fb1e806e4c0 2023-07-13T13:52:53.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.267+0000 7fb35bfff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb35c0c7b30 0x7fb35c0703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48080/0 (socket says 172.21.15.118:48080) 2023-07-13T13:52:53.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.267+0000 7fb35bfff700 1 -- 172.21.15.118:0/3560671910 learned_addr learned my addr 172.21.15.118:0/3560671910 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:53.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7fb1f0138700 1 -- 172.21.15.118:0/2291137319 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 msgr2=0x7fb1e806b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7fb1f0138700 1 --2- 172.21.15.118:0/2291137319 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e806b040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40098f0 tx=0x7fb1e4009c00 comp rx=0 tx=0).stop 2023-07-13T13:52:53.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7fb1f0138700 1 -- 172.21.15.118:0/2291137319 shutdown_connections 2023-07-13T13:52:53.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7fb1f0138700 1 --2- 172.21.15.118:0/2291137319 >> v2:172.21.15.118:3300/0 conn(0x7fb1e806b580 0x7fb1e80c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.245 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7fb1f0138700 1 --2- 172.21.15.118:0/2291137319 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e806b040 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7fb1f0138700 1 -- 172.21.15.118:0/2291137319 >> 172.21.15.118:0/2291137319 conn(0x7fb1e8070d40 msgr2=0x7fb1e8071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7fb1f0138700 1 -- 172.21.15.118:0/2291137319 shutdown_connections 2023-07-13T13:52:53.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7fb1f0138700 1 -- 172.21.15.118:0/2291137319 wait complete. 2023-07-13T13:52:53.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.268+0000 7f8c62d9d700 1 --2- 172.21.15.118:0/2787483558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c640c7130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009e50 tx=0x7f8c5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e421bb9f34c6551a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.269+0000 7f52577fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5258071ab0 0x7f5258071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.269+0000 7fb1f0138700 1 Processor -- start 2023-07-13T13:52:53.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.269+0000 7fb1f0138700 1 -- start start 2023-07-13T13:52:53.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.269+0000 7f79b68cb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79b006a470 0x7f79b0070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.270+0000 7fb1f0138700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e806b580 0x7fb1e814bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.270+0000 7fb1f0138700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e8152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.270+0000 7fb1f0138700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e814f750 0x7fb1e81f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.270+0000 7fb1f0138700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8156ec0 con 0x7fb1e814f750 2023-07-13T13:52:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.270+0000 7fb1f0138700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8151d00 con 0x7fb1e806b580 2023-07-13T13:52:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.270+0000 7fb1f0138700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e81526d0 con 0x7fb1e806e4c0 2023-07-13T13:52:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.272+0000 7f52577fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5258071ab0 0x7f5258071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43152/0 (socket says 172.21.15.118:43152) 2023-07-13T13:52:53.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.272+0000 7f52577fe700 1 -- 172.21.15.118:0/3142334519 learned_addr learned my addr 172.21.15.118:0/3142334519 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.272+0000 7f79b60ca700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b014ee20 0x7f79b0155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.273+0000 7f79b68cb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79b006a470 0x7f79b0070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43162/0 (socket says 172.21.15.118:43162) 2023-07-13T13:52:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.273+0000 7f79b68cb700 1 -- 172.21.15.118:0/82764591 learned_addr learned my addr 172.21.15.118:0/82764591 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.274+0000 7fd49259c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd49406f380 0x7fd4940c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.274+0000 7fd49259c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd49406f380 0x7fd4940c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34454/0 (socket says 172.21.15.118:34454) 2023-07-13T13:52:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.274+0000 7fd49259c700 1 -- 172.21.15.118:0/3699431415 learned_addr learned my addr 172.21.15.118:0/3699431415 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.275+0000 7fb360adf700 1 --2- 172.21.15.118:0/3560671910 >> v2:172.21.15.123:3300/0 conn(0x7fb35c14eca0 0x7fb35c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.275+0000 7f52577fe700 1 -- 172.21.15.118:0/3142334519 >> v2:172.21.15.123:3300/0 conn(0x7f52580c7d80 msgr2=0x7f5258156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.275+0000 7f52577fe700 1 --2- 172.21.15.118:0/3142334519 >> v2:172.21.15.123:3300/0 conn(0x7f52580c7d80 0x7f5258156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.275+0000 7f52577fe700 1 -- 172.21.15.118:0/3142334519 >> v1:172.21.15.123:6789/0 conn(0x7f52581570a0 legacy=0x7f52580c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.275+0000 7f52577fe700 1 -- 172.21.15.118:0/3142334519 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580c6cd0 con 0x7f5258071ab0 2023-07-13T13:52:53.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.277+0000 7fb35b7fe700 1 -- 172.21.15.118:0/3560671910 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977821496 0 0) 0x7fb35c14f070 con 0x7fb35c0c7b30 2023-07-13T13:52:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.277+0000 7fb35b7fe700 1 -- 172.21.15.118:0/3560671910 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3440035b0 con 0x7fb35c0c7b30 2023-07-13T13:52:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.278+0000 7f8c6159a700 1 -- 172.21.15.118:0/2787483558 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00e070 con 0x7f8c640c6cb0 2023-07-13T13:52:53.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.278+0000 7f8c6159a700 1 -- 172.21.15.118:0/2787483558 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c003a20 con 0x7f8c640c6cb0 2023-07-13T13:52:53.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.278+0000 7f8c6159a700 1 -- 172.21.15.118:0/2787483558 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c003dd0 con 0x7f8c640c6cb0 2023-07-13T13:52:53.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.279+0000 7f8c68833700 1 -- 172.21.15.118:0/2787483558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 msgr2=0x7f8c640c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.279+0000 7f8c68833700 1 --2- 172.21.15.118:0/2787483558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c640c7130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009e50 tx=0x7f8c5c00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:53.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.279+0000 7f8c68833700 1 -- 172.21.15.118:0/2787483558 shutdown_connections 2023-07-13T13:52:53.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7f8c68833700 1 --2- 172.21.15.118:0/2787483558 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c640c7130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7f8c68833700 1 --2- 172.21.15.118:0/2787483558 >> v2:172.21.15.123:3300/0 conn(0x7f8c640c78a0 0x7f8c64159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7f8c68833700 1 -- 172.21.15.118:0/2787483558 >> 172.21.15.118:0/2787483558 conn(0x7f8c64069f30 msgr2=0x7f8c6406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7f8c68833700 1 -- 172.21.15.118:0/2787483558 shutdown_connections 2023-07-13T13:52:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7f8c68833700 1 -- 172.21.15.118:0/2787483558 wait complete. 2023-07-13T13:52:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7fd49259c700 1 -- 172.21.15.118:0/3699431415 >> v2:172.21.15.123:3300/0 conn(0x7fd4941590f0 msgr2=0x7fd4940c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7fd49259c700 1 --2- 172.21.15.118:0/3699431415 >> v2:172.21.15.123:3300/0 conn(0x7fd4941590f0 0x7fd4940c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7fd49259c700 1 -- 172.21.15.118:0/3699431415 >> v1:172.21.15.123:6789/0 conn(0x7fd494152850 legacy=0x7fd49406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7fd49259c700 1 -- 172.21.15.118:0/3699431415 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940c6980 con 0x7fd49406f380 2023-07-13T13:52:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.280+0000 7f52577fe700 1 --2- 172.21.15.118:0/3142334519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5258071ab0 0x7f5258071e80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f525806fa30 tx=0x7f5248009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c03d3e70e8bdac1 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.281+0000 7fb360adf700 1 -- 172.21.15.118:0/3560671910 >> v1:172.21.15.123:6789/0 conn(0x7fb35c06fc30 legacy=0x7fb35c15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.281+0000 7fb360adf700 1 -- 172.21.15.118:0/3560671910 >> v1:172.21.15.118:6789/0 conn(0x7fb35c0c7b30 legacy=0x7fb35c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.281+0000 7fb360adf700 1 -- 172.21.15.118:0/3560671910 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c071010 con 0x7fb35c14eca0 2023-07-13T13:52:53.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.282+0000 7f8c68833700 1 Processor -- start 2023-07-13T13:52:53.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.282+0000 7f8c68833700 1 -- start start 2023-07-13T13:52:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.282+0000 7fbe7effd700 1 -- 172.21.15.118:0/1919358027 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74004230 con 0x7fbe800c7b30 2023-07-13T13:52:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7fbe7effd700 1 -- 172.21.15.118:0/1919358027 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74004390 con 0x7fbe800c7b30 2023-07-13T13:52:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7fbe7effd700 1 -- 172.21.15.118:0/1919358027 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740036a0 con 0x7fbe800c7b30 2023-07-13T13:52:53.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f8c68833700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c64157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f8c68833700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c640c78a0 0x7f8c64150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f8c68833700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c64152de0 0x7f8c641e1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f8c68833700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c64150120 con 0x7f8c64152de0 2023-07-13T13:52:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f8c68833700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c641582e0 con 0x7f8c640c78a0 2023-07-13T13:52:53.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f8c68833700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c64156b40 con 0x7f8c640c6cb0 2023-07-13T13:52:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f79b60ca700 1 -- 172.21.15.118:0/82764591 >> v2:172.21.15.123:3300/0 conn(0x7f79b0065af0 msgr2=0x7f79b0069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f79b60ca700 1 --2- 172.21.15.118:0/82764591 >> v2:172.21.15.123:3300/0 conn(0x7f79b0065af0 0x7f79b0069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f79b60ca700 1 -- 172.21.15.118:0/82764591 >> v2:172.21.15.118:3300/0 conn(0x7f79b006a470 msgr2=0x7f79b0070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f79b60ca700 1 --2- 172.21.15.118:0/82764591 >> v2:172.21.15.118:3300/0 conn(0x7f79b006a470 0x7f79b0070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7f79b60ca700 1 -- 172.21.15.118:0/82764591 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00c6070 con 0x7f79b014ee20 2023-07-13T13:52:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7fbe867fe700 1 -- 172.21.15.118:0/1919358027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe800c7b30 msgr2=0x7fbe8014ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.283+0000 7fbe867fe700 1 --2- 172.21.15.118:0/1919358027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe800c7b30 0x7fbe8014ea30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbe740098f0 tx=0x7fbe74009c00 comp rx=0 tx=0).stop 2023-07-13T13:52:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.284+0000 7fbe867fe700 1 -- 172.21.15.118:0/1919358027 shutdown_connections 2023-07-13T13:52:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.284+0000 7fbe867fe700 1 --2- 172.21.15.118:0/1919358027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe800c7b30 0x7fbe8014ea30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.284+0000 7fbe867fe700 1 -- 172.21.15.118:0/1919358027 >> 172.21.15.118:0/1919358027 conn(0x7fbe80069f30 msgr2=0x7fbe8006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.284+0000 7fbe867fe700 1 -- 172.21.15.118:0/1919358027 shutdown_connections 2023-07-13T13:52:53.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.284+0000 7fbe867fe700 1 -- 172.21.15.118:0/1919358027 wait complete. 2023-07-13T13:52:53.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.285+0000 7fd49259c700 1 --2- 172.21.15.118:0/3699431415 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd49406f380 0x7fd4940c5d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098f0 tx=0x7fd488009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b89676715a1d1bd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.285+0000 7fed2effd700 1 -- 172.21.15.118:0/2246232593 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24004230 con 0x7fed3006ff90 2023-07-13T13:52:53.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.285+0000 7fed2effd700 1 -- 172.21.15.118:0/2246232593 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24004390 con 0x7fed3006ff90 2023-07-13T13:52:53.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.285+0000 7fed2effd700 1 -- 172.21.15.118:0/2246232593 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240036a0 con 0x7fed3006ff90 2023-07-13T13:52:53.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.285+0000 7fed363f9700 1 -- 172.21.15.118:0/2246232593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3006ff90 msgr2=0x7fed301608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.285+0000 7fed363f9700 1 --2- 172.21.15.118:0/2246232593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3006ff90 0x7fed301608a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fed300720f0 tx=0x7fed24009bd0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fbe867fe700 1 Processor -- start 2023-07-13T13:52:53.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fbe867fe700 1 -- start start 2023-07-13T13:52:53.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fbe867fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe8006aa40 0x7fbe8014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fbe867fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe8006fc30 0x7fbe80146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fbe867fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe800c7b30 0x7fbe800bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fbe867fe700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe801666f0 con 0x7fbe800c7b30 2023-07-13T13:52:53.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.287+0000 7fbe867fe700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8014c9e0 con 0x7fbe8006aa40 2023-07-13T13:52:53.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.287+0000 7fbe867fe700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe80166170 con 0x7fbe8006fc30 2023-07-13T13:52:53.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.287+0000 7fb360adf700 1 --2- 172.21.15.118:0/3560671910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c14eca0 0x7fb35c1548d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb35c071200 tx=0x7fb350009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32092856a64aa320 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fed363f9700 1 -- 172.21.15.118:0/2246232593 shutdown_connections 2023-07-13T13:52:53.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fed363f9700 1 --2- 172.21.15.118:0/2246232593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3006ff90 0x7fed301608a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fed363f9700 1 --2- 172.21.15.118:0/2246232593 >> v2:172.21.15.118:3300/0 conn(0x7fed300c7790 0x7fed30160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fed363f9700 1 -- 172.21.15.118:0/2246232593 >> 172.21.15.118:0/2246232593 conn(0x7fed30069f30 msgr2=0x7fed3006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fed363f9700 1 -- 172.21.15.118:0/2246232593 shutdown_connections 2023-07-13T13:52:53.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.286+0000 7fed363f9700 1 -- 172.21.15.118:0/2246232593 wait complete. 2023-07-13T13:52:53.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.287+0000 7fb1eded4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e806b580 0x7fb1e814bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.287+0000 7f79b60ca700 1 --2- 172.21.15.118:0/82764591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b014ee20 0x7f79b0155560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79b0067390 tx=0x7f79ac009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32ad52695780bc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.287+0000 7fed363f9700 1 Processor -- start 2023-07-13T13:52:53.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.288+0000 7fed363f9700 1 -- start start 2023-07-13T13:52:53.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.288+0000 7fb1eded4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e806b580 0x7fb1e814bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48180/0 (socket says 172.21.15.118:48180) 2023-07-13T13:52:53.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.288+0000 7fb1eded4700 1 -- 172.21.15.118:0/4260704894 learned_addr learned my addr 172.21.15.118:0/4260704894 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.288+0000 7fed363f9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed3006ff90 0x7fed301ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.288+0000 7fed363f9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed300c7790 0x7fed301599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.288+0000 7fed363f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed30157060 0x7fed30157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.288+0000 7fed363f9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3015a7a0 con 0x7fed30157060 2023-07-13T13:52:53.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.288+0000 7fed363f9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed30157800 con 0x7fed300c7790 2023-07-13T13:52:53.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.289+0000 7fed363f9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3015a4c0 con 0x7fed3006ff90 2023-07-13T13:52:53.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.292+0000 7fb1ed6d3700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e8152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.294+0000 7f8c6259c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c64157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.295+0000 7fb1ee6d5700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e814f750 0x7fb1e81f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.295+0000 7fed2ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed3006ff90 0x7fed301ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.296+0000 7f8c6259c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c64157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34482/0 (socket says 172.21.15.118:34482) 2023-07-13T13:52:53.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.296+0000 7f8c6259c700 1 -- 172.21.15.118:0/4142930741 learned_addr learned my addr 172.21.15.118:0/4142930741 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.296+0000 7fed2ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed3006ff90 0x7fed301ed3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34510/0 (socket says 172.21.15.118:34510) 2023-07-13T13:52:53.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.296+0000 7fed2ffff700 1 -- 172.21.15.118:0/2112881928 learned_addr learned my addr 172.21.15.118:0/2112881928 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.297+0000 7f8c62d9d700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c64152de0 0x7f8c641e1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.297+0000 7fb1eded4700 1 -- 172.21.15.118:0/4260704894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 msgr2=0x7fb1e8152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.297+0000 7fb1eded4700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e806e4c0 0x7fb1e8152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.297+0000 7fb1eded4700 1 -- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e814f750 msgr2=0x7fb1e81f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.297+0000 7fb1eded4700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e814f750 0x7fb1e81f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.297+0000 7fb1eded4700 1 -- 172.21.15.118:0/4260704894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009550 con 0x7fb1e806b580 2023-07-13T13:52:53.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.297+0000 7fb1ee6d5700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1e814f750 0x7fb1e81f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-13T13:52:53.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.300+0000 7f52567fc700 1 -- 172.21.15.118:0/3142334519 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248004230 con 0x7f5258071ab0 2023-07-13T13:52:53.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.300+0000 7f52567fc700 1 -- 172.21.15.118:0/3142334519 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248004390 con 0x7f5258071ab0 2023-07-13T13:52:53.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.300+0000 7f52567fc700 1 -- 172.21.15.118:0/3142334519 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480036a0 con 0x7f5258071ab0 2023-07-13T13:52:53.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.301+0000 7f525dec8700 1 -- 172.21.15.118:0/3142334519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5258071ab0 msgr2=0x7f5258071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.301+0000 7f525dec8700 1 --2- 172.21.15.118:0/3142334519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5258071ab0 0x7f5258071e80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f525806fa30 tx=0x7f5248009c00 comp rx=0 tx=0).stop 2023-07-13T13:52:53.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.301+0000 7f525dec8700 1 -- 172.21.15.118:0/3142334519 shutdown_connections 2023-07-13T13:52:53.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.301+0000 7f525dec8700 1 --2- 172.21.15.118:0/3142334519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5258071ab0 0x7f5258071e80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.301+0000 7f525dec8700 1 --2- 172.21.15.118:0/3142334519 >> v2:172.21.15.123:3300/0 conn(0x7f52580c7d80 0x7f5258156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.301+0000 7f525dec8700 1 -- 172.21.15.118:0/3142334519 >> 172.21.15.118:0/3142334519 conn(0x7f52580cb880 msgr2=0x7f52580c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.301+0000 7f525dec8700 1 -- 172.21.15.118:0/3142334519 shutdown_connections 2023-07-13T13:52:53.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.301+0000 7f525dec8700 1 -- 172.21.15.118:0/3142334519 wait complete. 2023-07-13T13:52:53.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.302+0000 7fbe84d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe800c7b30 0x7fbe800bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.302+0000 7f525dec8700 1 Processor -- start 2023-07-13T13:52:53.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.303+0000 7f525dec8700 1 -- start start 2023-07-13T13:52:53.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.303+0000 7fbe84d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe800c7b30 0x7fbe800bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43190/0 (socket says 172.21.15.118:43190) 2023-07-13T13:52:53.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.303+0000 7fbe84d9b700 1 -- 172.21.15.118:0/691466827 learned_addr learned my addr 172.21.15.118:0/691466827 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.303+0000 7f525dec8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5258071ab0 0x7f52581574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.304+0000 7f525dec8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52580c7d80 0x7f5258145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.304+0000 7f525dec8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52581570a0 0x7f52581460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.304+0000 7f525dec8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5258147790 con 0x7f52580c7d80 2023-07-13T13:52:53.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.304+0000 7f525dec8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52581579f0 con 0x7f5258071ab0 2023-07-13T13:52:53.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.304+0000 7f525dec8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5258150160 con 0x7f52581570a0 2023-07-13T13:52:53.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.305+0000 7f8c6259c700 1 -- 172.21.15.118:0/4142930741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c640c78a0 msgr2=0x7f8c64150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.305+0000 7f8c6259c700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c640c78a0 0x7f8c64150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.305+0000 7f8c6259c700 1 -- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c64152de0 msgr2=0x7f8c641e1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.305+0000 7f8c6259c700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c64152de0 0x7f8c641e1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.305+0000 7f8c6259c700 1 -- 172.21.15.118:0/4142930741 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009b30 con 0x7f8c640c6cb0 2023-07-13T13:52:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.306+0000 7fb35b7fe700 1 -- 172.21.15.118:0/3560671910 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350004020 con 0x7fb35c14eca0 2023-07-13T13:52:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.306+0000 7fb35b7fe700 1 -- 172.21.15.118:0/3560671910 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb350004180 con 0x7fb35c14eca0 2023-07-13T13:52:53.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.306+0000 7fb35b7fe700 1 -- 172.21.15.118:0/3560671910 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350004530 con 0x7fb35c14eca0 2023-07-13T13:52:53.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.307+0000 7fb1eded4700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e806b580 0x7fb1e814bd10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800b470 tx=0x7fb1d800b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.307+0000 7fb362d43700 1 -- 172.21.15.118:0/3560671910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c14eca0 msgr2=0x7fb35c1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.307+0000 7fb362d43700 1 --2- 172.21.15.118:0/3560671910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c14eca0 0x7fb35c1548d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb35c071200 tx=0x7fb350009b20 comp rx=0 tx=0).stop 2023-07-13T13:52:53.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.307+0000 7fb362d43700 1 -- 172.21.15.118:0/3560671910 shutdown_connections 2023-07-13T13:52:53.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.307+0000 7fb362d43700 1 --2- 172.21.15.118:0/3560671910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c14eca0 0x7fb35c1548d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.307+0000 7fb362d43700 1 -- 172.21.15.118:0/3560671910 >> 172.21.15.118:0/3560671910 conn(0x7fb35c069f30 msgr2=0x7fb35c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.307+0000 7fb362d43700 1 -- 172.21.15.118:0/3560671910 shutdown_connections 2023-07-13T13:52:53.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.307+0000 7fb362d43700 1 -- 172.21.15.118:0/3560671910 wait complete. 2023-07-13T13:52:53.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.308+0000 7fed2f7fe700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed300c7790 0x7fed301599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.308+0000 7fb362d43700 1 Processor -- start 2023-07-13T13:52:53.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.308+0000 7fed2ffff700 1 -- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed300c7790 msgr2=0x7fed301599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.308+0000 7fed2ffff700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed300c7790 0x7fed301599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.308+0000 7fed2ffff700 1 -- 172.21.15.118:0/2112881928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed30157060 msgr2=0x7fed30157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.308+0000 7fed2ffff700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed30157060 0x7fed30157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.308+0000 7fed2ffff700 1 -- 172.21.15.118:0/2112881928 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed24009550 con 0x7fed3006ff90 2023-07-13T13:52:53.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.308+0000 7fb362d43700 1 -- start start 2023-07-13T13:52:53.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fb362d43700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c06fc30 0x7fb35c1f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fb362d43700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c0c7b30 0x7fb35c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fb362d43700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb35c14eca0 0x7fb35c0b8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fb362d43700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0b84e0 con 0x7fb35c0c7b30 2023-07-13T13:52:53.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fb362d43700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0baf80 con 0x7fb35c06fc30 2023-07-13T13:52:53.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fb362d43700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c154ab0 con 0x7fb35c14eca0 2023-07-13T13:52:53.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fd491d9b700 1 -- 172.21.15.118:0/3699431415 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488004230 con 0x7fd49406f380 2023-07-13T13:52:53.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fd491d9b700 1 -- 172.21.15.118:0/3699431415 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd488004390 con 0x7fd49406f380 2023-07-13T13:52:53.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.309+0000 7fd491d9b700 1 -- 172.21.15.118:0/3699431415 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880036a0 con 0x7fd49406f380 2023-07-13T13:52:53.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fd499118700 1 -- 172.21.15.118:0/3699431415 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd49406f380 msgr2=0x7fd4940c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fd499118700 1 --2- 172.21.15.118:0/3699431415 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd49406f380 0x7fd4940c5d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098f0 tx=0x7fd488009c00 comp rx=0 tx=0).stop 2023-07-13T13:52:53.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fd499118700 1 -- 172.21.15.118:0/3699431415 shutdown_connections 2023-07-13T13:52:53.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fd499118700 1 --2- 172.21.15.118:0/3699431415 >> v2:172.21.15.123:3300/0 conn(0x7fd4941590f0 0x7fd4940c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fd499118700 1 --2- 172.21.15.118:0/3699431415 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd49406f380 0x7fd4940c5d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fd499118700 1 -- 172.21.15.118:0/3699431415 >> 172.21.15.118:0/3699431415 conn(0x7fd494070d40 msgr2=0x7fd494071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fd499118700 1 -- 172.21.15.118:0/3699431415 shutdown_connections 2023-07-13T13:52:53.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fd499118700 1 -- 172.21.15.118:0/3699431415 wait complete. 2023-07-13T13:52:53.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.310+0000 7fbe7ffff700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe8006aa40 0x7fbe8014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.312+0000 7fd499118700 1 Processor -- start 2023-07-13T13:52:53.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.312+0000 7fd499118700 1 -- start start 2023-07-13T13:52:53.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.313+0000 7fd499118700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49406f380 0x7fd4940caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.313+0000 7fd499118700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494152850 0x7fd4941f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.313+0000 7fd499118700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4941590f0 0x7fd494159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.313+0000 7fd499118700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49415b950 con 0x7fd49406f380 2023-07-13T13:52:53.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.313+0000 7fd499118700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941f1a30 con 0x7fd494152850 2023-07-13T13:52:53.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.313+0000 7fd499118700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940cb0c0 con 0x7fd4941590f0 2023-07-13T13:52:53.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.313+0000 7f8c6259c700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c64157da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800b4a0 tx=0x7f8c5800b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.314+0000 7fed2ffff700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed3006ff90 0x7fed301ed3d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed2800ba50 tx=0x7fed2800be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.316+0000 7fbe7f7fe700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe8006fc30 0x7fbe80146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.316+0000 7fb1de7fc700 1 -- 172.21.15.118:0/4260704894 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011830 con 0x7fb1e806b580 2023-07-13T13:52:53.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.316+0000 7fb1de7fc700 1 -- 172.21.15.118:0/4260704894 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d80119b0 con 0x7fb1e806b580 2023-07-13T13:52:53.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.316+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e8152930 con 0x7fb1e806b580 2023-07-13T13:52:53.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.316+0000 7fb1de7fc700 1 -- 172.21.15.118:0/4260704894 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011d60 con 0x7fb1e806b580 2023-07-13T13:52:53.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.316+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e8152bf0 con 0x7fb1e806b580 2023-07-13T13:52:53.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.317+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1e80c43b0 con 0x7fb1e806b580 2023-07-13T13:52:53.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.320+0000 7fbe7ffff700 1 -- 172.21.15.118:0/691466827 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe8006fc30 msgr2=0x7fbe80146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.320+0000 7fbe7ffff700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbe8006fc30 0x7fbe80146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.320+0000 7fbe7ffff700 1 -- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe800c7b30 msgr2=0x7fbe800bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.320+0000 7fbe7ffff700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe800c7b30 0x7fbe800bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.320+0000 7fbe7ffff700 1 -- 172.21.15.118:0/691466827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74009550 con 0x7fbe8006aa40 2023-07-13T13:52:53.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.323+0000 7fbe7ffff700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe8006aa40 0x7fbe8014c4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe74015000 tx=0x7fbe74004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.339+0000 7fb360adf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c06fc30 0x7fb35c1f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.350+0000 7fb1de7fc700 1 -- 172.21.15.118:0/4260704894 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1d8023430 con 0x7fb1e806b580 2023-07-13T13:52:53.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.351+0000 7fb1de7fc700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb1cc06ad10 0x7fb1cc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.351+0000 7fb1ed6d3700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb1cc06ad10 0x7fb1cc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.351+0000 7fb1ed6d3700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb1cc06ad10 0x7fb1cc06d1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40098f0 tx=0x7fb1e4008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.356+0000 7fb1de7fc700 1 -- 172.21.15.118:0/4260704894 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb1d805c2a0 con 0x7fb1e806b580 2023-07-13T13:52:53.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.356+0000 7fb1de7fc700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7fb1cc074860 0x7fb1cc076c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.356+0000 7fb1de7fc700 1 -- 172.21.15.118:0/4260704894 --> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1cc077360 con 0x7fb1cc074860 2023-07-13T13:52:53.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.356+0000 7f52577fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5258071ab0 0x7f52581574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.356+0000 7fb1ee6d5700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7fb1cc074860 0x7fb1cc076c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fb1ee6d5700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7fb1cc074860 0x7fb1cc076c90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fbe7cff9700 1 -- 172.21.15.118:0/691466827 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74011630 con 0x7fbe8006aa40 2023-07-13T13:52:53.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fbe7cff9700 1 -- 172.21.15.118:0/691466827 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74011790 con 0x7fbe8006aa40 2023-07-13T13:52:53.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe80166410 con 0x7fbe8006aa40 2023-07-13T13:52:53.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fd49259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494152850 0x7fd4941f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fbe7cff9700 1 -- 172.21.15.118:0/691466827 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74011b40 con 0x7fbe8006aa40 2023-07-13T13:52:53.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe801f5ec0 con 0x7fbe8006aa40 2023-07-13T13:52:53.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7f52577fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5258071ab0 0x7f52581574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48234/0 (socket says 172.21.15.118:48234) 2023-07-13T13:52:53.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7f52577fe700 1 -- 172.21.15.118:0/3020980782 learned_addr learned my addr 172.21.15.118:0/3020980782 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fd49259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494152850 0x7fd4941f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48242/0 (socket says 172.21.15.118:48242) 2023-07-13T13:52:53.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fd49259c700 1 -- 172.21.15.118:0/1483971702 learned_addr learned my addr 172.21.15.118:0/1483971702 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.357+0000 7fb1de7fc700 1 -- 172.21.15.118:0/4260704894 <== osd.1 v2:172.21.15.118:6800/1775143218 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb1cc077360 con 0x7fb1cc074860 2023-07-13T13:52:53.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.358+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe801f5a60 con 0x7fbe8006aa40 2023-07-13T13:52:53.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.358+0000 7fb360adf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c06fc30 0x7fb35c1f1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48238/0 (socket says 172.21.15.118:48238) 2023-07-13T13:52:53.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.358+0000 7fb360adf700 1 -- 172.21.15.118:0/3630843145 learned_addr learned my addr 172.21.15.118:0/3630843145 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.363+0000 7fd49259c700 1 -- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4941590f0 msgr2=0x7fd494159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.363+0000 7fd49259c700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4941590f0 0x7fd494159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.364+0000 7fd49259c700 1 -- 172.21.15.118:0/1483971702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49406f380 msgr2=0x7fd4940caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.364+0000 7fd49259c700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd49406f380 0x7fd4940caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.364+0000 7fd49259c700 1 -- 172.21.15.118:0/1483971702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009550 con 0x7fd494152850 2023-07-13T13:52:53.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.367+0000 7f52577fe700 1 -- 172.21.15.118:0/3020980782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52581570a0 msgr2=0x7f52581460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.367+0000 7f52577fe700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52581570a0 0x7f52581460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.367+0000 7f52577fe700 1 -- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52580c7d80 msgr2=0x7f5258145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.367+0000 7f52577fe700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f52580c7d80 0x7f5258145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.367+0000 7f52577fe700 1 -- 172.21.15.118:0/3020980782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5248009550 con 0x7f5258071ab0 2023-07-13T13:52:53.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.370+0000 7fb360adf700 1 -- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb35c14eca0 msgr2=0x7fb35c0b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.370+0000 7fb360adf700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb35c14eca0 0x7fb35c0b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.370+0000 7fb360adf700 1 -- 172.21.15.118:0/3630843145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c0c7b30 msgr2=0x7fb35c0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.370+0000 7fb360adf700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb35c0c7b30 0x7fb35c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.370+0000 7fb360adf700 1 -- 172.21.15.118:0/3630843145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500094a0 con 0x7fb35c06fc30 2023-07-13T13:52:53.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.375+0000 7f52577fe700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5258071ab0 0x7f52581574b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5248009130 tx=0x7f5248004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.375+0000 7fb360adf700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c06fc30 0x7fb35c1f1830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb350009b60 tx=0x7fb350004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.376+0000 7f79b50c8700 1 -- 172.21.15.118:0/82764591 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac011830 con 0x7f79b014ee20 2023-07-13T13:52:53.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.376+0000 7fd49259c700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494152850 0x7fd4941f14f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4940c67e0 tx=0x7fd488004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.376+0000 7f79b50c8700 1 -- 172.21.15.118:0/82764591 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac011990 con 0x7f79b014ee20 2023-07-13T13:52:53.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.376+0000 7f79b50c8700 1 -- 172.21.15.118:0/82764591 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac011d20 con 0x7f79b014ee20 2023-07-13T13:52:53.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 -- 172.21.15.118:0/82764591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b014ee20 msgr2=0x7f79b0155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 --2- 172.21.15.118:0/82764591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b014ee20 0x7f79b0155560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79b0067390 tx=0x7f79ac009b20 comp rx=0 tx=0).stop 2023-07-13T13:52:53.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 -- 172.21.15.118:0/82764591 shutdown_connections 2023-07-13T13:52:53.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 --2- 172.21.15.118:0/82764591 >> v2:172.21.15.118:3300/0 conn(0x7f79b006a470 0x7f79b0070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 --2- 172.21.15.118:0/82764591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b014ee20 0x7f79b0155560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 --2- 172.21.15.118:0/82764591 >> v2:172.21.15.123:3300/0 conn(0x7f79b0065af0 0x7f79b0069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 -- 172.21.15.118:0/82764591 >> 172.21.15.118:0/82764591 conn(0x7f79b00cb880 msgr2=0x7f79b00c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 -- 172.21.15.118:0/82764591 shutdown_connections 2023-07-13T13:52:53.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.377+0000 7f79b832e700 1 -- 172.21.15.118:0/82764591 wait complete. 2023-07-13T13:52:53.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.378+0000 7f79b832e700 1 Processor -- start 2023-07-13T13:52:53.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.378+0000 7f79b832e700 1 -- start start 2023-07-13T13:52:53.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.379+0000 7f79b832e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b0065af0 0x7f79b014f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.379+0000 7f79b832e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b006a470 0x7f79b015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.379+0000 7f79b832e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79b014ee20 0x7f79b0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.379+0000 7f79b832e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01521d0 con 0x7f79b014ee20 2023-07-13T13:52:53.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.379+0000 7f79b832e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01ee950 con 0x7f79b0065af0 2023-07-13T13:52:53.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.379+0000 7f79b832e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b015c020 con 0x7f79b006a470 2023-07-13T13:52:53.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.379+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 --> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1e80c40d0 con 0x7fb1cc074860 2023-07-13T13:52:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1de7fc700 1 -- 172.21.15.118:0/4260704894 <== osd.1 v2:172.21.15.118:6800/1775143218 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb1e0007a00 con 0x7fb1cc074860 2023-07-13T13:52:53.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7fb1cc074860 msgr2=0x7fb1cc076c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1f0138700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7fb1cc074860 0x7fb1cc076c90 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb1cc06ad10 msgr2=0x7fb1cc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1f0138700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb1cc06ad10 0x7fb1cc06d1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40098f0 tx=0x7fb1e4008030 comp rx=0 tx=0).stop 2023-07-13T13:52:53.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e806b580 msgr2=0x7fb1e814bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1f0138700 1 --2- 172.21.15.118:0/4260704894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e806b580 0x7fb1e814bd10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800b470 tx=0x7fb1d800b780 comp rx=0 tx=0).stop 2023-07-13T13:52:53.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1ee6d5700 1 -- 172.21.15.118:0/4260704894 reap_dead start 2023-07-13T13:52:53.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 shutdown_connections 2023-07-13T13:52:53.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.380+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 >> 172.21.15.118:0/4260704894 conn(0x7fb1e8070d40 msgr2=0x7fb1e80c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.381+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 shutdown_connections 2023-07-13T13:52:53.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.381+0000 7fb1f0138700 1 -- 172.21.15.118:0/4260704894 wait complete. 2023-07-13T13:52:53.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.386+0000 7fd47b7fe700 1 -- 172.21.15.118:0/1483971702 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488003e30 con 0x7fd494152850 2023-07-13T13:52:53.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.387+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49415cb40 con 0x7fd494152850 2023-07-13T13:52:53.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.387+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49415c580 con 0x7fd494152850 2023-07-13T13:52:53.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.387+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd49406e580 con 0x7fd494152850 2023-07-13T13:52:53.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.390+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800cae0 con 0x7fed3006ff90 2023-07-13T13:52:53.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.390+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2800cc40 con 0x7fed3006ff90 2023-07-13T13:52:53.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.390+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed301fb7b0 con 0x7fed3006ff90 2023-07-13T13:52:53.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.390+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28014440 con 0x7fed3006ff90 2023-07-13T13:52:53.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.390+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed301fba90 con 0x7fed3006ff90 2023-07-13T13:52:53.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.391+0000 7f8c52ffd700 1 -- 172.21.15.118:0/4142930741 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58011830 con 0x7f8c640c6cb0 2023-07-13T13:52:53.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.391+0000 7f8c52ffd700 1 -- 172.21.15.118:0/4142930741 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c580119b0 con 0x7f8c640c6cb0 2023-07-13T13:52:53.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.391+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c641e2120 con 0x7f8c640c6cb0 2023-07-13T13:52:53.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.392+0000 7f523ffff700 1 -- 172.21.15.118:0/3020980782 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248003e30 con 0x7f5258071ab0 2023-07-13T13:52:53.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.391+0000 7f8c52ffd700 1 -- 172.21.15.118:0/4142930741 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58011d60 con 0x7f8c640c6cb0 2023-07-13T13:52:53.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.391+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c641e26e0 con 0x7f8c640c6cb0 2023-07-13T13:52:53.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.391+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c640701e0 con 0x7f8c640c6cb0 2023-07-13T13:52:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.392+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5258146b50 con 0x7f5258071ab0 2023-07-13T13:52:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.392+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52581470d0 con 0x7f5258071ab0 2023-07-13T13:52:53.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.391+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed30071380 con 0x7fed3006ff90 2023-07-13T13:52:53.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.393+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52580c7290 con 0x7f5258071ab0 2023-07-13T13:52:53.368 INFO:teuthology.orchestra.run.smithi118.stdout:55834574861 2023-07-13T13:52:53.368 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-13T13:52:53.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.398+0000 7f79b68cb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79b014ee20 0x7f79b0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.401+0000 7f79b68cb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79b014ee20 0x7f79b0154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43240/0 (socket says 172.21.15.118:43240) 2023-07-13T13:52:53.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.401+0000 7f79b68cb700 1 -- 172.21.15.118:0/2013662138 learned_addr learned my addr 172.21.15.118:0/2013662138 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.404+0000 7fbe7cff9700 1 -- 172.21.15.118:0/691466827 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe74022070 con 0x7fbe8006aa40 2023-07-13T13:52:53.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.404+0000 7fbe7cff9700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbe6c06ace0 0x7fbe6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.404+0000 7fbe7f7fe700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbe6c06ace0 0x7fbe6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.405+0000 7fbe7f7fe700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbe6c06ace0 0x7fbe6c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe800c2b10 tx=0x7fbe70008040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.406+0000 7f79b68cb700 1 -- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b006a470 msgr2=0x7f79b015b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.406+0000 7f79b68cb700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b006a470 0x7f79b015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.406+0000 7f79b68cb700 1 -- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b0065af0 msgr2=0x7f79b014f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.406+0000 7f79b68cb700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b0065af0 0x7f79b014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.406+0000 7f79b68cb700 1 -- 172.21.15.118:0/2013662138 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0094a0 con 0x7f79b014ee20 2023-07-13T13:52:53.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.408+0000 7f79b68cb700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79b014ee20 0x7f79b0154e50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f79a800efc0 tx=0x7f79a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.412+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8003c20 con 0x7f79b014ee20 2023-07-13T13:52:53.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.413+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800f040 con 0x7f79b014ee20 2023-07-13T13:52:53.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.413+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b015c300 con 0x7f79b014ee20 2023-07-13T13:52:53.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.413+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800c930 con 0x7f79b014ee20 2023-07-13T13:52:53.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.413+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b01eec30 con 0x7f79b014ee20 2023-07-13T13:52:53.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.413+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79b015b480 con 0x7f79b014ee20 2023-07-13T13:52:53.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.415+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed28006d50 con 0x7fed3006ff90 2023-07-13T13:52:53.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.416+0000 7fed2cff9700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed1c06ad60 0x7fed1c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.416+0000 7fed2f7fe700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed1c06ad60 0x7fed1c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.416+0000 7fed2f7fe700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed1c06ad60 0x7fed1c06d210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed300717a0 tx=0x7fed20008040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.420+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed2805bbb0 con 0x7fed3006ff90 2023-07-13T13:52:53.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.421+0000 7fed2cff9700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7fed1c074930 0x7fed1c076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.421+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 --> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed1c077430 con 0x7fed1c074930 2023-07-13T13:52:53.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.421+0000 7fed34996700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7fed1c074930 0x7fed1c076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.421+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed28053f30 con 0x7fed3006ff90 2023-07-13T13:52:53.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.421+0000 7fed34996700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7fed1c074930 0x7fed1c076d60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.422+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 <== osd.4 v2:172.21.15.123:6808/1567879638 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fed1c077430 con 0x7fed1c074930 2023-07-13T13:52:53.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.438+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 --> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fed300710a0 con 0x7fed1c074930 2023-07-13T13:52:53.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed2cff9700 1 -- 172.21.15.118:0/2112881928 <== osd.4 v2:172.21.15.123:6808/1567879638 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fed24004500 con 0x7fed1c074930 2023-07-13T13:52:53.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7fed1c074930 msgr2=0x7fed1c076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed363f9700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7fed1c074930 0x7fed1c076d60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed1c06ad60 msgr2=0x7fed1c06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed363f9700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed1c06ad60 0x7fed1c06d210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed300717a0 tx=0x7fed20008040 comp rx=0 tx=0).stop 2023-07-13T13:52:53.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed3006ff90 msgr2=0x7fed301ed3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed363f9700 1 --2- 172.21.15.118:0/2112881928 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed3006ff90 0x7fed301ed3d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed2800ba50 tx=0x7fed2800be10 comp rx=0 tx=0).stop 2023-07-13T13:52:53.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed34996700 1 -- 172.21.15.118:0/2112881928 reap_dead start 2023-07-13T13:52:53.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 shutdown_connections 2023-07-13T13:52:53.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.439+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 >> 172.21.15.118:0/2112881928 conn(0x7fed30069f30 msgr2=0x7fed3006bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.440+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 shutdown_connections 2023-07-13T13:52:53.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.440+0000 7fed363f9700 1 -- 172.21.15.118:0/2112881928 wait complete. 2023-07-13T13:52:53.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.441+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79a800ca90 con 0x7f79b014ee20 2023-07-13T13:52:53.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79a6ffd700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f799406ace0 0x7f799406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f79a808a910 con 0x7f79b014ee20 2023-07-13T13:52:53.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79b60ca700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f799406ace0 0x7f799406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79a6ffd700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7f7994074930 0x7f7994076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 --> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7994077430 con 0x7f7994074930 2023-07-13T13:52:53.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79a808ac80 con 0x7f79b014ee20 2023-07-13T13:52:53.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79b58c9700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7f7994074930 0x7f7994076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79b60ca700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f799406ace0 0x7f799406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0090b0 tx=0x7f79ac010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.442+0000 7f79b58c9700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7f7994074930 0x7f7994076d60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.443+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 <== osd.7 v2:172.21.15.123:6824/4183445338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7994077430 con 0x7f7994074930 2023-07-13T13:52:53.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.448+0000 7f523ffff700 1 -- 172.21.15.118:0/3020980782 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524801f070 con 0x7f5258071ab0 2023-07-13T13:52:53.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.448+0000 7f523ffff700 1 -- 172.21.15.118:0/3020980782 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248011830 con 0x7f5258071ab0 2023-07-13T13:52:53.425 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:53.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-13T13:52:53.432 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.460+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 --> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79b00c6630 con 0x7f7994074930 2023-07-13T13:52:53.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.460+0000 7f79a6ffd700 1 -- 172.21.15.118:0/2013662138 <== osd.7 v2:172.21.15.123:6824/4183445338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f79a0009820 con 0x7f7994074930 2023-07-13T13:52:53.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.460+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7f7994074930 msgr2=0x7f7994076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.460+0000 7f79b832e700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7f7994074930 0x7f7994076d60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f8c52ffd700 1 -- 172.21.15.118:0/4142930741 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c5801a400 con 0x7f8c640c6cb0 2023-07-13T13:52:53.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f8c52ffd700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c4406ad10 0x7f8c4406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f8c61d9b700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c4406ad10 0x7f8c4406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f799406ace0 msgr2=0x7f799406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b832e700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f799406ace0 0x7f799406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0090b0 tx=0x7f79ac010000 comp rx=0 tx=0).stop 2023-07-13T13:52:53.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79b014ee20 msgr2=0x7f79b0154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b832e700 1 --2- 172.21.15.118:0/2013662138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79b014ee20 0x7f79b0154e50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f79a800efc0 tx=0x7f79a800c3a0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b68cb700 1 -- 172.21.15.118:0/2013662138 reap_dead start 2023-07-13T13:52:53.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 shutdown_connections 2023-07-13T13:52:53.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 >> 172.21.15.118:0/2013662138 conn(0x7f79b00cb880 msgr2=0x7f79b006e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 shutdown_connections 2023-07-13T13:52:53.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f79b832e700 1 -- 172.21.15.118:0/2013662138 wait complete. 2023-07-13T13:52:53.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f8c52ffd700 1 -- 172.21.15.118:0/4142930741 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c5805c6f0 con 0x7f8c640c6cb0 2023-07-13T13:52:53.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f8c52ffd700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f8c440748e0 0x7f8c44076d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.461+0000 7f8c52ffd700 1 -- 172.21.15.118:0/4142930741 --> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c440773e0 con 0x7f8c440748e0 2023-07-13T13:52:53.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.462+0000 7f8c62d9d700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f8c440748e0 0x7f8c44076d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.462+0000 7f8c61d9b700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c4406ad10 0x7f8c4406d1c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c64159900 tx=0x7f8c54006d20 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.462+0000 7f8c62d9d700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f8c440748e0 0x7f8c44076d10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.463+0000 7f8c52ffd700 1 -- 172.21.15.118:0/4142930741 <== osd.2 v2:172.21.15.118:6808/3477414536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8c440773e0 con 0x7f8c440748e0 2023-07-13T13:52:53.448 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:53.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-13T13:52:53.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.483+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 --> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c641531b0 con 0x7f8c440748e0 2023-07-13T13:52:53.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c52ffd700 1 -- 172.21.15.118:0/4142930741 <== osd.2 v2:172.21.15.118:6808/3477414536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c5c003e30 con 0x7f8c440748e0 2023-07-13T13:52:53.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f8c440748e0 msgr2=0x7f8c44076d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f8c440748e0 0x7f8c44076d10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c4406ad10 msgr2=0x7f8c4406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8c4406ad10 0x7f8c4406d1c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c64159900 tx=0x7f8c54006d20 comp rx=0 tx=0).stop 2023-07-13T13:52:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 msgr2=0x7f8c64157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 --2- 172.21.15.118:0/4142930741 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8c640c6cb0 0x7f8c64157da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800b4a0 tx=0x7f8c5800b7b0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c62d9d700 1 -- 172.21.15.118:0/4142930741 reap_dead start 2023-07-13T13:52:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 shutdown_connections 2023-07-13T13:52:53.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 >> 172.21.15.118:0/4142930741 conn(0x7f8c64069f30 msgr2=0x7f8c640c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 shutdown_connections 2023-07-13T13:52:53.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.484+0000 7f8c68833700 1 -- 172.21.15.118:0/4142930741 wait complete. 2023-07-13T13:52:53.473 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:53.474 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-13T13:52:53.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.518+0000 7fd47b7fe700 1 -- 172.21.15.118:0/1483971702 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48801f070 con 0x7fd494152850 2023-07-13T13:52:53.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.518+0000 7fd47b7fe700 1 -- 172.21.15.118:0/1483971702 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800b860 con 0x7fd494152850 2023-07-13T13:52:53.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.523+0000 7fd47b7fe700 1 -- 172.21.15.118:0/1483971702 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd488021030 con 0x7fd494152850 2023-07-13T13:52:53.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.523+0000 7fd47b7fe700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd48006ace0 0x7fd48006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.523+0000 7fd492d9d700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd48006ace0 0x7fd48006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.524+0000 7fd492d9d700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd48006ace0 0x7fd48006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd484001600 tx=0x7fd484007a20 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.532+0000 7f523ffff700 1 -- 172.21.15.118:0/3020980782 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5248021030 con 0x7f5258071ab0 2023-07-13T13:52:53.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.532+0000 7f523ffff700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f524406ace0 0x7f524406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.532+0000 7f5256ffd700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f524406ace0 0x7f524406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.533+0000 7f5256ffd700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f524406ace0 0x7f524406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f525815a5a0 tx=0x7f524c006d20 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.537+0000 7f523ffff700 1 -- 172.21.15.118:0/3020980782 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f524805a1e0 con 0x7f5258071ab0 2023-07-13T13:52:53.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.537+0000 7f523ffff700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7f52440747b0 0x7f5244076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.537+0000 7f523ffff700 1 -- 172.21.15.118:0/3020980782 --> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52440772b0 con 0x7f52440747b0 2023-07-13T13:52:53.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.537+0000 7f5257fff700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7f52440747b0 0x7f5244076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.537+0000 7f2ebf97d700 1 Processor -- start 2023-07-13T13:52:53.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.537+0000 7f2ebf97d700 1 -- start start 2023-07-13T13:52:53.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.538+0000 7f5257fff700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7f52440747b0 0x7f5244076be0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.538+0000 7f2ebf97d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2eb806f380 0x7f2eb80c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.538+0000 7f2ebf97d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2eb81590f0 0x7f2eb80c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.538+0000 7f2ebf97d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb80c6c60 con 0x7f2eb8152850 2023-07-13T13:52:53.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.538+0000 7f2ebf97d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb806f1b0 con 0x7f2eb81590f0 2023-07-13T13:52:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.538+0000 7f2ebf97d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb81594f0 con 0x7f2eb806f380 2023-07-13T13:52:53.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.540+0000 7f523ffff700 1 -- 172.21.15.118:0/3020980782 <== osd.3 v2:172.21.15.118:6809/3059213709 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f52440772b0 con 0x7f52440747b0 2023-07-13T13:52:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.541+0000 7fd47b7fe700 1 -- 172.21.15.118:0/1483971702 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd488059ef0 con 0x7fd494152850 2023-07-13T13:52:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.541+0000 7fd47b7fe700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7fd480074830 0x7fd480076c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.541+0000 7fd47b7fe700 1 -- 172.21.15.118:0/1483971702 --> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd480077330 con 0x7fd480074830 2023-07-13T13:52:53.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.542+0000 7fd49359e700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7fd480074830 0x7fd480076c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.542+0000 7fd49359e700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7fd480074830 0x7fd480076c60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.543+0000 7fd47b7fe700 1 -- 172.21.15.118:0/1483971702 <== osd.6 v2:172.21.15.123:6800/381173612 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd480077330 con 0x7fd480074830 2023-07-13T13:52:53.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.542+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350011e90 con 0x7fb35c06fc30 2023-07-13T13:52:53.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.542+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3500036a0 con 0x7fb35c06fc30 2023-07-13T13:52:53.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.542+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350003a50 con 0x7fb35c06fc30 2023-07-13T13:52:53.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.542+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c0c12c0 con 0x7fb35c06fc30 2023-07-13T13:52:53.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.542+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c154fe0 con 0x7fb35c06fc30 2023-07-13T13:52:53.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.545+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb35c0715b0 con 0x7fb35c06fc30 2023-07-13T13:52:53.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.549+0000 7fbe7cff9700 1 -- 172.21.15.118:0/691466827 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe7405e4c0 con 0x7fbe8006aa40 2023-07-13T13:52:53.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.549+0000 7fbe7cff9700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7fbe6c074830 0x7fbe6c076c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.549+0000 7fbe7cff9700 1 -- 172.21.15.118:0/691466827 --> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe6c077330 con 0x7fbe6c074830 2023-07-13T13:52:53.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.556+0000 7fbe84d9b700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7fbe6c074830 0x7fbe6c076c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.561+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 --> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f52580c6fb0 con 0x7f52440747b0 2023-07-13T13:52:53.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.561+0000 7fbe84d9b700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7fbe6c074830 0x7fbe6c076c60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.562+0000 7f523ffff700 1 -- 172.21.15.118:0/3020980782 <== osd.3 v2:172.21.15.118:6809/3059213709 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f525000a720 con 0x7f52440747b0 2023-07-13T13:52:53.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.562+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7f52440747b0 msgr2=0x7f5244076be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.562+0000 7f525dec8700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7f52440747b0 0x7f5244076be0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.565+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f524406ace0 msgr2=0x7f524406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.565+0000 7f525dec8700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f524406ace0 0x7f524406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f525815a5a0 tx=0x7f524c006d20 comp rx=0 tx=0).stop 2023-07-13T13:52:53.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.565+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5258071ab0 msgr2=0x7f52581574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.565+0000 7f525dec8700 1 --2- 172.21.15.118:0/3020980782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5258071ab0 0x7f52581574b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5248009130 tx=0x7f5248004750 comp rx=0 tx=0).stop 2023-07-13T13:52:53.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.565+0000 7fbe7cff9700 1 -- 172.21.15.118:0/691466827 <== osd.0 v2:172.21.15.118:6816/724794801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbe6c077330 con 0x7fbe6c074830 2023-07-13T13:52:53.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.565+0000 7f5257fff700 1 -- 172.21.15.118:0/3020980782 reap_dead start 2023-07-13T13:52:53.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.567+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 shutdown_connections 2023-07-13T13:52:53.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.567+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 >> 172.21.15.118:0/3020980782 conn(0x7f52580cb880 msgr2=0x7f5258155670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.567+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 shutdown_connections 2023-07-13T13:52:53.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.567+0000 7f525dec8700 1 -- 172.21.15.118:0/3020980782 wait complete. 2023-07-13T13:52:53.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.578+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 --> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd49406e2a0 con 0x7fd480074830 2023-07-13T13:52:53.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.578+0000 7fd47b7fe700 1 -- 172.21.15.118:0/1483971702 <== osd.6 v2:172.21.15.123:6800/381173612 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd48c00a720 con 0x7fd480074830 2023-07-13T13:52:53.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.587+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7fd480074830 msgr2=0x7fd480076c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.587+0000 7fd499118700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7fd480074830 0x7fd480076c60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.587+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd48006ace0 msgr2=0x7fd48006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.587+0000 7fd499118700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd48006ace0 0x7fd48006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd484001600 tx=0x7fd484007a20 comp rx=0 tx=0).stop 2023-07-13T13:52:53.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.587+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494152850 msgr2=0x7fd4941f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.587+0000 7fd499118700 1 --2- 172.21.15.118:0/1483971702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494152850 0x7fd4941f14f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4940c67e0 tx=0x7fd488004750 comp rx=0 tx=0).stop 2023-07-13T13:52:53.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.587+0000 7fd49359e700 1 -- 172.21.15.118:0/1483971702 reap_dead start 2023-07-13T13:52:53.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.588+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 shutdown_connections 2023-07-13T13:52:53.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.588+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 >> 172.21.15.118:0/1483971702 conn(0x7fd494070d40 msgr2=0x7fd4940c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.588+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 shutdown_connections 2023-07-13T13:52:53.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.588+0000 7fd499118700 1 -- 172.21.15.118:0/1483971702 wait complete. 2023-07-13T13:52:53.563 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:53.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-13T13:52:53.563 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.590+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 --> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe800c58e0 con 0x7fbe6c074830 2023-07-13T13:52:53.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.591+0000 7fbe7cff9700 1 -- 172.21.15.118:0/691466827 <== osd.0 v2:172.21.15.118:6816/724794801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe78001c60 con 0x7fbe6c074830 2023-07-13T13:52:53.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.591+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7fbe6c074830 msgr2=0x7fbe6c076c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.591+0000 7fbe867fe700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7fbe6c074830 0x7fbe6c076c60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.592+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbe6c06ace0 msgr2=0x7fbe6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.592+0000 7fbe867fe700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbe6c06ace0 0x7fbe6c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe800c2b10 tx=0x7fbe70008040 comp rx=0 tx=0).stop 2023-07-13T13:52:53.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.592+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe8006aa40 msgr2=0x7fbe8014c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.592+0000 7fbe867fe700 1 --2- 172.21.15.118:0/691466827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe8006aa40 0x7fbe8014c4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe74015000 tx=0x7fbe74004750 comp rx=0 tx=0).stop 2023-07-13T13:52:53.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.592+0000 7fbe84d9b700 1 -- 172.21.15.118:0/691466827 reap_dead start 2023-07-13T13:52:53.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.596+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 shutdown_connections 2023-07-13T13:52:53.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.596+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 >> 172.21.15.118:0/691466827 conn(0x7fbe80069f30 msgr2=0x7fbe800c6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.596+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 shutdown_connections 2023-07-13T13:52:53.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.599+0000 7fbe867fe700 1 -- 172.21.15.118:0/691466827 wait complete. 2023-07-13T13:52:53.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.600+0000 7f2ebcf18700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2eb806f380 0x7f2eb80c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.600+0000 7f2ebcf18700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2eb806f380 0x7f2eb80c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48268/0 (socket says 172.21.15.118:48268) 2023-07-13T13:52:53.574 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.600+0000 7f2ebcf18700 1 -- 172.21.15.118:0/2544354003 learned_addr learned my addr 172.21.15.118:0/2544354003 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.578 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:53.578 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-13T13:52:53.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.606+0000 7f2ebdf1a700 1 --2- 172.21.15.118:0/2544354003 >> v2:172.21.15.118:3300/0 conn(0x7f2eb81590f0 0x7f2eb80c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.617+0000 7f2ebdf1a700 1 -- 172.21.15.118:0/2544354003 >> v2:172.21.15.123:3300/0 conn(0x7f2eb806f380 msgr2=0x7f2eb80c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.617+0000 7f2ebdf1a700 1 --2- 172.21.15.118:0/2544354003 >> v2:172.21.15.123:3300/0 conn(0x7f2eb806f380 0x7f2eb80c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.617+0000 7f2ebdf1a700 1 -- 172.21.15.118:0/2544354003 >> v1:172.21.15.123:6789/0 conn(0x7f2eb8152850 legacy=0x7f2eb806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.617+0000 7f2ebdf1a700 1 -- 172.21.15.118:0/2544354003 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80c66a0 con 0x7f2eb81590f0 2023-07-13T13:52:53.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.620+0000 7f2ebdf1a700 1 --2- 172.21.15.118:0/2544354003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb81590f0 0x7f2eb80c7d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80c2740 tx=0x7f2eac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886cff373651511 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.595 INFO:teuthology.orchestra.run.smithi118.stdout:60129542157 2023-07-13T13:52:53.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-13T13:52:53.596 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.621+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb350003bb0 con 0x7fb35c06fc30 2023-07-13T13:52:53.596 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.621+0000 7fb3597fa700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb34806ace0 0x7fb34806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.621+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb35008a9f0 con 0x7fb35c06fc30 2023-07-13T13:52:53.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.621+0000 7fb3597fa700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7fb348074740 0x7fb348076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.622+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 --> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb348077240 con 0x7fb348074740 2023-07-13T13:52:53.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.622+0000 7fb3612e0700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7fb348074740 0x7fb348076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.622+0000 7fb35bfff700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb34806ace0 0x7fb34806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.623+0000 7fb35bfff700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb34806ace0 0x7fb34806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0c3c90 tx=0x7fb34c0079c0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.623+0000 7fb3612e0700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7fb348074740 0x7fb348076b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.598 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.624+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 <== osd.5 v2:172.21.15.123:6816/3894697051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb348077240 con 0x7fb348074740 2023-07-13T13:52:53.598 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.625+0000 7f2eb7fff700 1 -- 172.21.15.118:0/2544354003 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac004230 con 0x7f2eb81590f0 2023-07-13T13:52:53.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.625+0000 7f2eb7fff700 1 -- 172.21.15.118:0/2544354003 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac004390 con 0x7f2eb81590f0 2023-07-13T13:52:53.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.625+0000 7f2eb7fff700 1 -- 172.21.15.118:0/2544354003 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0036a0 con 0x7f2eb81590f0 2023-07-13T13:52:53.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.626+0000 7f2ebf97d700 1 -- 172.21.15.118:0/2544354003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb81590f0 msgr2=0x7f2eb80c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.626+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/2544354003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb81590f0 0x7f2eb80c7d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80c2740 tx=0x7f2eac009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:53.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.632+0000 7f2ebf97d700 1 -- 172.21.15.118:0/2544354003 shutdown_connections 2023-07-13T13:52:53.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.632+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/2544354003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb81590f0 0x7f2eb80c7d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.632+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/2544354003 >> v2:172.21.15.123:3300/0 conn(0x7f2eb806f380 0x7f2eb80c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.632+0000 7f2ebf97d700 1 -- 172.21.15.118:0/2544354003 >> 172.21.15.118:0/2544354003 conn(0x7f2eb8070d40 msgr2=0x7f2eb8071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.636+0000 7f2ebf97d700 1 -- 172.21.15.118:0/2544354003 shutdown_connections 2023-07-13T13:52:53.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.636+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb350055860 con 0x7fb35c06fc30 2023-07-13T13:52:53.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.636+0000 7f2ebf97d700 1 -- 172.21.15.118:0/2544354003 wait complete. 2023-07-13T13:52:53.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.637+0000 7f2ebf97d700 1 Processor -- start 2023-07-13T13:52:53.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.638+0000 7f2ebf97d700 1 -- start start 2023-07-13T13:52:53.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.639+0000 7f2ebf97d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb806f380 0x7f2eb815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.639+0000 7f2ebf97d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb8152850 0x7f2eb81f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.639+0000 7f2ebf97d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eb81590f0 0x7f2eb81f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.639+0000 7f2ebf97d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb815a900 con 0x7f2eb806f380 2023-07-13T13:52:53.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.639+0000 7f2ebf97d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81f6390 con 0x7f2eb8152850 2023-07-13T13:52:53.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.639+0000 7f2ebf97d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81f6670 con 0x7f2eb81590f0 2023-07-13T13:52:53.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.640+0000 7f2ebcf18700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb8152850 0x7f2eb81f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.640+0000 7f2ebcf18700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb8152850 0x7f2eb81f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48278/0 (socket says 172.21.15.118:48278) 2023-07-13T13:52:53.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.640+0000 7f2ebcf18700 1 -- 172.21.15.118:0/4087475271 learned_addr learned my addr 172.21.15.118:0/4087475271 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.640+0000 7f2ebd719700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb806f380 0x7f2eb815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.643+0000 7f5c48ea0700 1 Processor -- start 2023-07-13T13:52:53.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.644+0000 7f5c48ea0700 1 -- start start 2023-07-13T13:52:53.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.644+0000 7f2ebcf18700 1 -- 172.21.15.118:0/4087475271 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eb81590f0 msgr2=0x7f2eb81f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.644+0000 7f2ebcf18700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eb81590f0 0x7f2eb81f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.644+0000 7f2ebcf18700 1 -- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb806f380 msgr2=0x7f2eb815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.644+0000 7f2ebcf18700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb806f380 0x7f2eb815b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.644+0000 7f2ebcf18700 1 -- 172.21.15.118:0/4087475271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0094a0 con 0x7f2eb8152850 2023-07-13T13:52:53.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.645+0000 7f5c48ea0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c44071ab0 0x7f5c44071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.645+0000 7f5c48ea0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5c440c7d80 0x7f5c44156b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.645+0000 7f5c48ea0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c440c69f0 con 0x7f5c441570a0 2023-07-13T13:52:53.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.645+0000 7f5c48ea0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c440714c0 con 0x7f5c440c7d80 2023-07-13T13:52:53.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.645+0000 7f5c48ea0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440723c0 con 0x7f5c44071ab0 2023-07-13T13:52:53.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.647+0000 7f2ebcf18700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb8152850 0x7f2eb81f3760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8007ba0 tx=0x7f2ea8007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.651+0000 7f2eb5ffb700 1 -- 172.21.15.118:0/4087475271 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8003e30 con 0x7f2eb8152850 2023-07-13T13:52:53.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.651+0000 7f2eb5ffb700 1 -- 172.21.15.118:0/4087475271 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800f040 con 0x7f2eb8152850 2023-07-13T13:52:53.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.652+0000 7f2eb5ffb700 1 -- 172.21.15.118:0/4087475271 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800d890 con 0x7f2eb8152850 2023-07-13T13:52:53.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.652+0000 7f5c42d9d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5c441570a0 0x7f5c440c5570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48086/0 (socket says 172.21.15.118:48086) 2023-07-13T13:52:53.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.652+0000 7f5c42d9d700 1 -- 172.21.15.118:0/1844153700 learned_addr learned my addr 172.21.15.118:0/1844153700 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:53.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.652+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb8159830 con 0x7f2eb8152850 2023-07-13T13:52:53.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.653+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb815ab50 con 0x7f2eb8152850 2023-07-13T13:52:53.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.654+0000 7f5c41d9b700 1 --2- 172.21.15.118:0/1844153700 >> v2:172.21.15.118:3300/0 conn(0x7f5c440c7d80 0x7f5c44156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.654+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb804e280 con 0x7f2eb8152850 2023-07-13T13:52:53.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.654+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 --> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb35c0712d0 con 0x7fb348074740 2023-07-13T13:52:53.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.655+0000 7fb3597fa700 1 -- 172.21.15.118:0/3630843145 <== osd.5 v2:172.21.15.123:6816/3894697051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb354001d30 con 0x7fb348074740 2023-07-13T13:52:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.661+0000 7f5c4159a700 1 -- 172.21.15.118:0/1844153700 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115227162 0 0) 0x7f5c440c69f0 con 0x7f5c441570a0 2023-07-13T13:52:53.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.661+0000 7f5c4159a700 1 -- 172.21.15.118:0/1844153700 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c2c0035b0 con 0x7f5c441570a0 2023-07-13T13:52:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7fb348074740 msgr2=0x7fb348076b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb362d43700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7fb348074740 0x7fb348076b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb34806ace0 msgr2=0x7fb34806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb362d43700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb34806ace0 0x7fb34806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0c3c90 tx=0x7fb34c0079c0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c06fc30 msgr2=0x7fb35c1f1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb362d43700 1 --2- 172.21.15.118:0/3630843145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb35c06fc30 0x7fb35c1f1830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb350009b60 tx=0x7fb350004750 comp rx=0 tx=0).stop 2023-07-13T13:52:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb3612e0700 1 -- 172.21.15.118:0/3630843145 reap_dead start 2023-07-13T13:52:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 shutdown_connections 2023-07-13T13:52:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.660+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 >> 172.21.15.118:0/3630843145 conn(0x7fb35c069f30 msgr2=0x7fb35c0c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.664+0000 7f5c4259c700 1 --2- 172.21.15.118:0/1844153700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c44071ab0 0x7f5c44071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.664+0000 7f5c41d9b700 1 -- 172.21.15.118:0/1844153700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c44071ab0 msgr2=0x7f5c44071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.664+0000 7f5c41d9b700 1 --2- 172.21.15.118:0/1844153700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c44071ab0 0x7f5c44071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.664+0000 7f5c41d9b700 1 -- 172.21.15.118:0/1844153700 >> v1:172.21.15.118:6789/0 conn(0x7f5c441570a0 legacy=0x7f5c440c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.664+0000 7f5c41d9b700 1 -- 172.21.15.118:0/1844153700 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c440c6cd0 con 0x7f5c440c7d80 2023-07-13T13:52:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.668+0000 7f5c41d9b700 1 --2- 172.21.15.118:0/1844153700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c440c7d80 0x7f5c44156b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009870 tx=0x7f5c34009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0c39469cd8a46b server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.669+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 shutdown_connections 2023-07-13T13:52:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.670+0000 7fb362d43700 1 -- 172.21.15.118:0/3630843145 wait complete. 2023-07-13T13:52:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.675+0000 7f5c4159a700 1 -- 172.21.15.118:0/1844153700 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34011830 con 0x7f5c440c7d80 2023-07-13T13:52:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.675+0000 7f5c4159a700 1 -- 172.21.15.118:0/1844153700 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34011990 con 0x7f5c440c7d80 2023-07-13T13:52:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.675+0000 7f5c4159a700 1 -- 172.21.15.118:0/1844153700 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34011d20 con 0x7f5c440c7d80 2023-07-13T13:52:53.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.676+0000 7fd309ed4700 1 Processor -- start 2023-07-13T13:52:53.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.676+0000 7fd309ed4700 1 -- start start 2023-07-13T13:52:53.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.676+0000 7fd309ed4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd30415ce50 0x7fd30415d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.677+0000 7fd309ed4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3040b1fc0 con 0x7fd304157010 2023-07-13T13:52:53.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.677+0000 7fd309ed4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3040b41d0 con 0x7fd3040b45e0 2023-07-13T13:52:53.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.677+0000 7fd309ed4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3040c5360 con 0x7fd30415ce50 2023-07-13T13:52:53.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.679+0000 7f5c48ea0700 1 -- 172.21.15.118:0/1844153700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c440c7d80 msgr2=0x7f5c44156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.679+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/1844153700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c440c7d80 0x7f5c44156b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009870 tx=0x7f5c34009b80 comp rx=0 tx=0).stop 2023-07-13T13:52:53.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.680+0000 7f5c48ea0700 1 -- 172.21.15.118:0/1844153700 shutdown_connections 2023-07-13T13:52:53.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.680+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/1844153700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c44071ab0 0x7f5c44071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.680+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/1844153700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c440c7d80 0x7f5c44156b60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.680+0000 7f5c48ea0700 1 -- 172.21.15.118:0/1844153700 >> 172.21.15.118:0/1844153700 conn(0x7f5c440cb880 msgr2=0x7f5c440c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.680+0000 7f5c48ea0700 1 -- 172.21.15.118:0/1844153700 shutdown_connections 2023-07-13T13:52:53.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.680+0000 7f5c48ea0700 1 -- 172.21.15.118:0/1844153700 wait complete. 2023-07-13T13:52:53.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.681+0000 7f2eb5ffb700 1 -- 172.21.15.118:0/4087475271 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ea800d9f0 con 0x7f2eb8152850 2023-07-13T13:52:53.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.681+0000 7f2eb5ffb700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2ea406ad30 0x7f2ea406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.682+0000 7f5c48ea0700 1 Processor -- start 2023-07-13T13:52:53.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.682+0000 7f5c48ea0700 1 -- start start 2023-07-13T13:52:53.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.684+0000 7f5c48ea0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c44071ab0 0x7f5c440ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.684+0000 7f5c48ea0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c440c7d80 0x7f5c44157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.684+0000 7f5c48ea0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c441570a0 0x7f5c44157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.684+0000 7f5c48ea0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c44159f30 con 0x7f5c440c7d80 2023-07-13T13:52:53.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.684+0000 7f5c48ea0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c44159970 con 0x7f5c44071ab0 2023-07-13T13:52:53.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.684+0000 7f5c48ea0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c44159c50 con 0x7f5c441570a0 2023-07-13T13:52:53.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.684+0000 7f5c42d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c441570a0 0x7f5c44157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.685+0000 7f2ebd719700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2ea406ad30 0x7f2ea406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.685+0000 7f5c42d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c441570a0 0x7f5c44157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34580/0 (socket says 172.21.15.118:34580) 2023-07-13T13:52:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.685+0000 7f5c42d9d700 1 -- 172.21.15.118:0/2688629529 learned_addr learned my addr 172.21.15.118:0/2688629529 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.685+0000 7f2ebd719700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2ea406ad30 0x7f2ea406d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0007fd0 tx=0x7f2eb0009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.689+0000 7f5c42d9d700 1 -- 172.21.15.118:0/2688629529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c44071ab0 msgr2=0x7f5c440ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.689+0000 7f5c42d9d700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c44071ab0 0x7f5c440ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.689+0000 7f5c42d9d700 1 -- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c440c7d80 msgr2=0x7f5c44157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.689+0000 7f5c42d9d700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c440c7d80 0x7f5c44157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.689+0000 7f5c42d9d700 1 -- 172.21.15.118:0/2688629529 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340094a0 con 0x7f5c441570a0 2023-07-13T13:52:53.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.689+0000 7f2eb5ffb700 1 -- 172.21.15.118:0/4087475271 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ea805c100 con 0x7f2eb8152850 2023-07-13T13:52:53.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.692+0000 7f5c42d9d700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c441570a0 0x7f5c44157c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00cbb0 tx=0x7f5c3c00cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.666 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:53.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-13T13:52:53.668 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.695+0000 7fd303fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd30415ce50 0x7fd30415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.697+0000 7f5c32ffd700 1 -- 172.21.15.118:0/2688629529 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00ab50 con 0x7f5c441570a0 2023-07-13T13:52:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.697+0000 7f5c32ffd700 1 -- 172.21.15.118:0/2688629529 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c00acb0 con 0x7f5c441570a0 2023-07-13T13:52:53.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.697+0000 7f5c32ffd700 1 -- 172.21.15.118:0/2688629529 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c012600 con 0x7f5c441570a0 2023-07-13T13:52:53.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.697+0000 7fd303fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd30415ce50 0x7fd30415d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43276/0 (socket says 172.21.15.118:43276) 2023-07-13T13:52:53.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.697+0000 7fd303fff700 1 -- 172.21.15.118:0/1570094056 learned_addr learned my addr 172.21.15.118:0/1570094056 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.698+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4414b3e0 con 0x7f5c441570a0 2023-07-13T13:52:53.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.698+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4414b9a0 con 0x7f5c441570a0 2023-07-13T13:52:53.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.701+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4404e280 con 0x7f5c441570a0 2023-07-13T13:52:53.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.709+0000 7fd303fff700 1 -- 172.21.15.118:0/1570094056 >> v1:172.21.15.123:6789/0 conn(0x7fd3040b45e0 legacy=0x7fd3040ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.709+0000 7fd303fff700 1 -- 172.21.15.118:0/1570094056 >> v1:172.21.15.118:6789/0 conn(0x7fd304157010 legacy=0x7fd3040ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.709+0000 7fd303fff700 1 -- 172.21.15.118:0/1570094056 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3040c58e0 con 0x7fd30415ce50 2023-07-13T13:52:53.686 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.714+0000 7fd303fff700 1 --2- 172.21.15.118:0/1570094056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd30415ce50 0x7fd30415d240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009e50 tx=0x7fd2fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce50ff3f162d499 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.715+0000 7f765c387700 1 Processor -- start 2023-07-13T13:52:53.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.715+0000 7f765c387700 1 -- start start 2023-07-13T13:52:53.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.716+0000 7f765c387700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765406ab40 0x7f7654154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.716+0000 7f765c387700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7654071980 0x7f76540c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.716+0000 7f765c387700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76541554d0 con 0x7f765414e3a0 2023-07-13T13:52:53.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.716+0000 7f765c387700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76540c7060 con 0x7f7654071980 2023-07-13T13:52:53.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.716+0000 7f765c387700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c5230 con 0x7f765406ab40 2023-07-13T13:52:53.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.733+0000 7f7659922700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765406ab40 0x7f7654154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.734+0000 7f7659922700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765406ab40 0x7f7654154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34594/0 (socket says 172.21.15.118:34594) 2023-07-13T13:52:53.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.734+0000 7f7659922700 1 -- 172.21.15.118:0/3228183498 learned_addr learned my addr 172.21.15.118:0/3228183498 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.734+0000 7f5c32ffd700 1 -- 172.21.15.118:0/2688629529 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5c3c01b3b0 con 0x7f5c441570a0 2023-07-13T13:52:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.734+0000 7f5c32ffd700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5c2406ad60 0x7f5c2406d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.735+0000 7f5c32ffd700 1 -- 172.21.15.118:0/2688629529 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5c3c089880 con 0x7f5c441570a0 2023-07-13T13:52:53.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.736+0000 7f5c4259c700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5c2406ad60 0x7f5c2406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.737+0000 7f5c4259c700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5c2406ad60 0x7f5c2406d210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800a890 tx=0x7f5c38008040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.737+0000 7f7659922700 1 -- 172.21.15.118:0/3228183498 >> v2:172.21.15.118:3300/0 conn(0x7f7654071980 msgr2=0x7f76540c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.737+0000 7f7659922700 1 --2- 172.21.15.118:0/3228183498 >> v2:172.21.15.118:3300/0 conn(0x7f7654071980 0x7f76540c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.737+0000 7f7659922700 1 -- 172.21.15.118:0/3228183498 >> v1:172.21.15.123:6789/0 conn(0x7f765414e3a0 legacy=0x7f7654071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.737+0000 7f7659922700 1 -- 172.21.15.118:0/3228183498 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540c5510 con 0x7f765406ab40 2023-07-13T13:52:53.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.744+0000 7f7659922700 1 --2- 172.21.15.118:0/3228183498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765406ab40 0x7f7654154f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f76440092e0 tx=0x7f76440095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71da43bb19c20215 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.775+0000 7f085e525700 1 Processor -- start 2023-07-13T13:52:53.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.775+0000 7f085e525700 1 -- start start 2023-07-13T13:52:53.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.776+0000 7f085e525700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f085814f520 0x7f08580c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.776+0000 7f085e525700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08581593d0 con 0x7f08580c8340 2023-07-13T13:52:53.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.776+0000 7f085e525700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0858071dd0 con 0x7f085806b040 2023-07-13T13:52:53.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.776+0000 7f085e525700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08580c2770 con 0x7f085814f520 2023-07-13T13:52:53.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.791+0000 7fb19adb8700 1 Processor -- start 2023-07-13T13:52:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.792+0000 7fb19adb8700 1 -- start start 2023-07-13T13:52:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.792+0000 7fb19adb8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941583c0 0x7fb19415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.792+0000 7fb19adb8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19415a920 con 0x7fb1940afcd0 2023-07-13T13:52:53.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.792+0000 7fb19adb8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19406f4e0 con 0x7fb19406f040 2023-07-13T13:52:53.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.792+0000 7fb19adb8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b2500 con 0x7fb1941583c0 2023-07-13T13:52:53.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.797+0000 7f7bb27b1700 1 Processor -- start 2023-07-13T13:52:53.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.797+0000 7f7bb27b1700 1 -- start start 2023-07-13T13:52:53.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.798+0000 7f7bb27b1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7bac0c8340 0x7f7bac1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.798+0000 7f7bb27b1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bac06b040 0x7f7bac158de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.798+0000 7f7bb27b1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bac1593d0 con 0x7f7bac14f520 2023-07-13T13:52:53.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.798+0000 7f7bb27b1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bac0c2770 con 0x7f7bac0c8340 2023-07-13T13:52:53.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.798+0000 7f7bb27b1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0c1cf0 con 0x7f7bac06b040 2023-07-13T13:52:53.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.801+0000 7f084f7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f08580c8340 0x7f08581588a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48106/0 (socket says 172.21.15.118:48106) 2023-07-13T13:52:53.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.801+0000 7f084f7fe700 1 -- 172.21.15.118:0/341667406 learned_addr learned my addr 172.21.15.118:0/341667406 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:53.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.803+0000 7fb198b54700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb1940afcd0 0x7fb1940b17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48120/0 (socket says 172.21.15.118:48120) 2023-07-13T13:52:53.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.803+0000 7fb198b54700 1 -- 172.21.15.118:0/1605702245 learned_addr learned my addr 172.21.15.118:0/1605702245 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:53.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.806+0000 7fd3027fc700 1 -- 172.21.15.118:0/1570094056 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc00e070 con 0x7fd30415ce50 2023-07-13T13:52:53.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.806+0000 7fd3027fc700 1 -- 172.21.15.118:0/1570094056 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc003a20 con 0x7fd30415ce50 2023-07-13T13:52:53.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.806+0000 7fd3027fc700 1 -- 172.21.15.118:0/1570094056 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc003dd0 con 0x7fd30415ce50 2023-07-13T13:52:53.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.807+0000 7fd309ed4700 1 -- 172.21.15.118:0/1570094056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd30415ce50 msgr2=0x7fd30415d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.807+0000 7fd309ed4700 1 --2- 172.21.15.118:0/1570094056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd30415ce50 0x7fd30415d240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009e50 tx=0x7fd2fc00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:53.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.807+0000 7fd309ed4700 1 -- 172.21.15.118:0/1570094056 shutdown_connections 2023-07-13T13:52:53.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.807+0000 7fd309ed4700 1 --2- 172.21.15.118:0/1570094056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd30415ce50 0x7fd30415d240 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.807+0000 7fd309ed4700 1 -- 172.21.15.118:0/1570094056 >> 172.21.15.118:0/1570094056 conn(0x7fd30406ad60 msgr2=0x7fd30406b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.807+0000 7fd309ed4700 1 -- 172.21.15.118:0/1570094056 shutdown_connections 2023-07-13T13:52:53.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.807+0000 7fd309ed4700 1 -- 172.21.15.118:0/1570094056 wait complete. 2023-07-13T13:52:53.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.809+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252565776 0 0) 0x7f08581593d0 con 0x7f08580c8340 2023-07-13T13:52:53.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.809+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08440035b0 con 0x7f08580c8340 2023-07-13T13:52:53.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.809+0000 7fd309ed4700 1 Processor -- start 2023-07-13T13:52:53.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.809+0000 7fd309ed4700 1 -- start start 2023-07-13T13:52:53.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.810+0000 7fd309ed4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3040b45e0 0x7fd3040c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.810+0000 7fd309ed4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304157010 0x7fd304153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.810+0000 7fd309ed4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd30415ce50 0x7fd3041f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.810+0000 7fd309ed4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3041f2820 con 0x7fd304157010 2023-07-13T13:52:53.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.810+0000 7fd309ed4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040c7790 con 0x7fd30415ce50 2023-07-13T13:52:53.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.810+0000 7fd309ed4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040c8280 con 0x7fd3040b45e0 2023-07-13T13:52:53.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.811+0000 7f7bab7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7bac0c8340 0x7f7bac1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.819+0000 7f7bab7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7bac0c8340 0x7f7bac1588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43288/0 (socket says 172.21.15.118:43288) 2023-07-13T13:52:53.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.819+0000 7f7bab7fe700 1 -- 172.21.15.118:0/460816727 learned_addr learned my addr 172.21.15.118:0/460816727 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.820+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304157010 0x7fd304153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.821+0000 7fd302ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304157010 0x7fd304153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43290/0 (socket says 172.21.15.118:43290) 2023-07-13T13:52:53.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.821+0000 7fd302ffd700 1 -- 172.21.15.118:0/3707215440 learned_addr learned my addr 172.21.15.118:0/3707215440 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.821+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240656251 0 0) 0x7fb19415a920 con 0x7fb1940afcd0 2023-07-13T13:52:53.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.821+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1840035b0 con 0x7fb1940afcd0 2023-07-13T13:52:53.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.824+0000 7f7bab7fe700 1 -- 172.21.15.118:0/460816727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bac06b040 msgr2=0x7f7bac158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.824+0000 7f7bab7fe700 1 --2- 172.21.15.118:0/460816727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bac06b040 0x7f7bac158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.824+0000 7f7bab7fe700 1 -- 172.21.15.118:0/460816727 >> v1:172.21.15.118:6789/0 conn(0x7f7bac14f520 legacy=0x7f7bac0c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.824+0000 7f7bab7fe700 1 -- 172.21.15.118:0/460816727 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac071dd0 con 0x7f7bac0c8340 2023-07-13T13:52:53.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.833+0000 7fd302ffd700 1 -- 172.21.15.118:0/3707215440 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3040b45e0 msgr2=0x7fd3040c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.833+0000 7fd302ffd700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3040b45e0 0x7fd3040c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.833+0000 7fd302ffd700 1 -- 172.21.15.118:0/3707215440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd30415ce50 msgr2=0x7fd3041f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.833+0000 7fd302ffd700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd30415ce50 0x7fd3041f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.833+0000 7fd302ffd700 1 -- 172.21.15.118:0/3707215440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc009b30 con 0x7fd304157010 2023-07-13T13:52:53.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2153127988 0 0) 0x7fb1840035b0 con 0x7fb1940afcd0 2023-07-13T13:52:53.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941583c0 msgr2=0x7fb19415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.808 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941583c0 0x7fb19415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 >> v1:172.21.15.123:6789/0 conn(0x7fb19406f040 legacy=0x7fb194157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194156580 con 0x7fb1940afcd0 2023-07-13T13:52:53.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402946124 0 0) 0x7fb188001670 con 0x7fb1940afcd0 2023-07-13T13:52:53.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 >> v1:172.21.15.118:6789/0 conn(0x7fb1940afcd0 legacy=0x7fb1940b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb184003a30 0x7fb184003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb184004850 0x7fb184004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941583c0 0x7fb18400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b2500 con 0x7fb184004850 2023-07-13T13:52:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1840055d0 con 0x7fb184003a30 2023-07-13T13:52:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400bf50 con 0x7fb1941583c0 2023-07-13T13:52:53.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.835+0000 7f7bab7fe700 1 --2- 172.21.15.118:0/460816727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bac0c8340 0x7f7bac1588a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009920 tx=0x7f7ba0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679696fb80cc09b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.812 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7fd302ffd700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304157010 0x7fd304153e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c4a0 tx=0x7fd2f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3857393878 0 0) 0x7f08440035b0 con 0x7f08580c8340 2023-07-13T13:52:53.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 >> v2:172.21.15.123:3300/0 conn(0x7f085814f520 msgr2=0x7f08580c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 --2- 172.21.15.118:0/341667406 >> v2:172.21.15.123:3300/0 conn(0x7f085814f520 0x7f08580c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 >> v1:172.21.15.123:6789/0 conn(0x7f085806b040 legacy=0x7f085815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858159600 con 0x7f08580c8340 2023-07-13T13:52:53.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402946124 0 0) 0x7f0840001670 con 0x7f08580c8340 2023-07-13T13:52:53.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 >> v1:172.21.15.118:6789/0 conn(0x7f08580c8340 legacy=0x7f08581588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0844003a00 0x7f0844003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0844004850 0x7f0844004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0844005320 0x7f084400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084400c1b0 con 0x7f0844004850 2023-07-13T13:52:53.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084400c320 con 0x7f0844005320 2023-07-13T13:52:53.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084400c4e0 con 0x7f0844003a00 2023-07-13T13:52:53.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.840+0000 7fb193fff700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb184004850 0x7fb184004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.850+0000 7f7baaffd700 1 -- 172.21.15.118:0/460816727 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0004230 con 0x7f7bac0c8340 2023-07-13T13:52:53.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.850+0000 7f7baaffd700 1 -- 172.21.15.118:0/460816727 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0004390 con 0x7f7bac0c8340 2023-07-13T13:52:53.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.850+0000 7f7baaffd700 1 -- 172.21.15.118:0/460816727 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0009e70 con 0x7f7bac0c8340 2023-07-13T13:52:53.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.851+0000 7f7bb27b1700 1 -- 172.21.15.118:0/460816727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bac0c8340 msgr2=0x7f7bac1588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.851+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/460816727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bac0c8340 0x7f7bac1588a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009920 tx=0x7f7ba0009c30 comp rx=0 tx=0).stop 2023-07-13T13:52:53.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.851+0000 7f7bb27b1700 1 -- 172.21.15.118:0/460816727 shutdown_connections 2023-07-13T13:52:53.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.851+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/460816727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bac06b040 0x7f7bac158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.851+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/460816727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bac0c8340 0x7f7bac1588a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.851+0000 7f7bb27b1700 1 -- 172.21.15.118:0/460816727 >> 172.21.15.118:0/460816727 conn(0x7f7bac0cb880 msgr2=0x7f7bac0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:53.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.851+0000 7f7bb27b1700 1 -- 172.21.15.118:0/460816727 shutdown_connections 2023-07-13T13:52:53.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.851+0000 7f7bb27b1700 1 -- 172.21.15.118:0/460816727 wait complete. 2023-07-13T13:52:53.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.852+0000 7f7bb27b1700 1 Processor -- start 2023-07-13T13:52:53.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.853+0000 7f7bb27b1700 1 -- start start 2023-07-13T13:52:53.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.853+0000 7f7bb27b1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bac06b040 0x7f7bac157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.853+0000 7f7bb27b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bac0c8340 0x7f7bac1505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.853+0000 7f7bb27b1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bac14f520 0x7f7bac1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.853+0000 7f7bb27b1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac151220 con 0x7f7bac14f520 2023-07-13T13:52:53.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.853+0000 7f7bb27b1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac14fb10 con 0x7f7bac0c8340 2023-07-13T13:52:53.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.853+0000 7f7bb27b1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0c6c90 con 0x7f7bac06b040 2023-07-13T13:52:53.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.854+0000 7fb193fff700 1 -- 172.21.15.118:0/1605702245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941583c0 msgr2=0x7fb18400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.854+0000 7fb193fff700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941583c0 0x7fb18400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.854+0000 7fb193fff700 1 -- 172.21.15.118:0/1605702245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb184003a30 msgr2=0x7fb184003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:53.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.854+0000 7fb193fff700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb184003a30 0x7fb184003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.854+0000 7fb193fff700 1 -- 172.21.15.118:0/1605702245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840035b0 con 0x7fb184004850 2023-07-13T13:52:53.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.854+0000 7f97fc0b5700 1 Processor -- start 2023-07-13T13:52:53.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.854+0000 7f97fc0b5700 1 -- start start 2023-07-13T13:52:53.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.855+0000 7f97fc0b5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f97f406f380 0x7f97f40c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.855+0000 7f97fc0b5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f97f41590f0 0x7f97f40c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.855+0000 7f97fc0b5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f40c6c60 con 0x7f97f4152850 2023-07-13T13:52:53.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.855+0000 7f97fc0b5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f406f1b0 con 0x7f97f41590f0 2023-07-13T13:52:53.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.855+0000 7f97fc0b5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f41594f0 con 0x7f97f406f380 2023-07-13T13:52:53.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.856+0000 7fd2ebfff700 1 -- 172.21.15.118:0/3707215440 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f80054e0 con 0x7fd304157010 2023-07-13T13:52:53.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.856+0000 7fd2ebfff700 1 -- 172.21.15.118:0/3707215440 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8003680 con 0x7fd304157010 2023-07-13T13:52:53.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.856+0000 7fd2ebfff700 1 -- 172.21.15.118:0/3707215440 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8003a30 con 0x7fd304157010 2023-07-13T13:52:53.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.856+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3041f5f50 con 0x7fd304157010 2023-07-13T13:52:53.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.856+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3040c79e0 con 0x7fd304157010 2023-07-13T13:52:53.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.857+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd304154390 con 0x7fd304157010 2023-07-13T13:52:53.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.858+0000 7fb193fff700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb184004850 0x7fb184004cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1800016c0 tx=0x7fb184005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792524538654ff25 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.958+0000 7f2eb5ffb700 1 -- 172.21.15.118:0/4087475271 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2ea8054530 con 0x7f2eb8152850 2023-07-13T13:52:53.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.958+0000 7fd2ebfff700 1 -- 172.21.15.118:0/3707215440 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2f8003b90 con 0x7fd304157010 2023-07-13T13:52:53.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.958+0000 7fd2ebfff700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd2f006ace0 0x7fd2f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:53.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.959+0000 7fd2ebfff700 1 -- 172.21.15.118:0/3707215440 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd2f8088900 con 0x7fd304157010 2023-07-13T13:52:53.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.959+0000 7fd3037fe700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd2f006ace0 0x7fd2f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.959+0000 7fd3037fe700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd2f006ace0 0x7fd2f006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4000f60 tx=0x7fd2f4007a60 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:53.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.966+0000 7f7bab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bac0c8340 0x7f7bac1505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.967+0000 7f7bab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bac0c8340 0x7f7bac1505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48318/0 (socket says 172.21.15.118:48318) 2023-07-13T13:52:53.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.967+0000 7f7bab7fe700 1 -- 172.21.15.118:0/3698160862 learned_addr learned my addr 172.21.15.118:0/3698160862 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:53.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:53.967+0000 7f085cac2700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0844005320 0x7f084400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.025+0000 7f7bab7fe700 1 -- 172.21.15.118:0/3698160862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bac06b040 msgr2=0x7f7bac157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.025+0000 7f7bab7fe700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bac06b040 0x7f7bac157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.025+0000 7f7bab7fe700 1 -- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bac14f520 msgr2=0x7f7bac1557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:53.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.025+0000 7f7bab7fe700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bac14f520 0x7f7bac1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:53.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.025+0000 7f7bab7fe700 1 -- 172.21.15.118:0/3698160862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba0009550 con 0x7f7bac0c8340 2023-07-13T13:52:54.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.030+0000 7f085cac2700 1 -- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0844003a00 msgr2=0x7f0844003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:54.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.030+0000 7f085cac2700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0844003a00 0x7f0844003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.030+0000 7f085cac2700 1 -- 172.21.15.118:0/341667406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0844004850 msgr2=0x7f0844004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:54.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.030+0000 7f085cac2700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0844004850 0x7f0844004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.030+0000 7f085cac2700 1 -- 172.21.15.118:0/341667406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440035b0 con 0x7f0844005320 2023-07-13T13:52:54.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.030+0000 7f085cac2700 1 -- 172.21.15.118:0/341667406 reap_dead start 2023-07-13T13:52:54.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.031+0000 7f7bab7fe700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bac0c8340 0x7f7bac1505d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009870 tx=0x7f7ba0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.034+0000 7f085cac2700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0844005320 0x7f084400ba10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0850001de0 tx=0x7f0844005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd83bc60717d491a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.038+0000 7f97f9650700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f97f406f380 0x7f97f40c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.039+0000 7f97f9650700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f97f406f380 0x7f97f40c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48322/0 (socket says 172.21.15.118:48322) 2023-07-13T13:52:54.012 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.039+0000 7f97f9650700 1 -- 172.21.15.118:0/1077889068 learned_addr learned my addr 172.21.15.118:0/1077889068 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:54.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.043+0000 7f7ba8ff9700 1 -- 172.21.15.118:0/3698160862 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000bd50 con 0x7f7bac0c8340 2023-07-13T13:52:54.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.043+0000 7f7ba8ff9700 1 -- 172.21.15.118:0/3698160862 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba001f070 con 0x7f7bac0c8340 2023-07-13T13:52:54.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.043+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac1515a0 con 0x7f7bac0c8340 2023-07-13T13:52:54.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.043+0000 7f7ba8ff9700 1 -- 172.21.15.118:0/3698160862 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba00038e0 con 0x7f7bac0c8340 2023-07-13T13:52:54.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.043+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac151b60 con 0x7f7bac0c8340 2023-07-13T13:52:54.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.044+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac04e280 con 0x7f7bac0c8340 2023-07-13T13:52:54.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.070+0000 7f5c32ffd700 1 -- 172.21.15.118:0/2688629529 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5c3c0547d0 con 0x7f5c441570a0 2023-07-13T13:52:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.076+0000 7f97f9650700 1 -- 172.21.15.118:0/1077889068 >> v2:172.21.15.118:3300/0 conn(0x7f97f41590f0 msgr2=0x7f97f40c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.076+0000 7f97f9650700 1 --2- 172.21.15.118:0/1077889068 >> v2:172.21.15.118:3300/0 conn(0x7f97f41590f0 0x7f97f40c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.076+0000 7f97f9650700 1 -- 172.21.15.118:0/1077889068 >> v1:172.21.15.123:6789/0 conn(0x7f97f4152850 legacy=0x7f97f406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.076+0000 7f97f9650700 1 -- 172.21.15.118:0/1077889068 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40c66a0 con 0x7f97f406f380 2023-07-13T13:52:54.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.077+0000 7f7659121700 1 -- 172.21.15.118:0/3228183498 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644004230 con 0x7f765406ab40 2023-07-13T13:52:54.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.077+0000 7f7659121700 1 -- 172.21.15.118:0/3228183498 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644004390 con 0x7f765406ab40 2023-07-13T13:52:54.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.077+0000 7f7659121700 1 -- 172.21.15.118:0/3228183498 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400c770 con 0x7f765406ab40 2023-07-13T13:52:54.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.078+0000 7f765c387700 1 -- 172.21.15.118:0/3228183498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765406ab40 msgr2=0x7f7654154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.078+0000 7f765c387700 1 --2- 172.21.15.118:0/3228183498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765406ab40 0x7f7654154f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f76440092e0 tx=0x7f76440095f0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.078+0000 7f765c387700 1 -- 172.21.15.118:0/3228183498 shutdown_connections 2023-07-13T13:52:54.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.078+0000 7f765c387700 1 --2- 172.21.15.118:0/3228183498 >> v2:172.21.15.118:3300/0 conn(0x7f7654071980 0x7f76540c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.078+0000 7f765c387700 1 --2- 172.21.15.118:0/3228183498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765406ab40 0x7f7654154f90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.078+0000 7f765c387700 1 -- 172.21.15.118:0/3228183498 >> 172.21.15.118:0/3228183498 conn(0x7f7654069f30 msgr2=0x7f765406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.078+0000 7f765c387700 1 -- 172.21.15.118:0/3228183498 shutdown_connections 2023-07-13T13:52:54.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.078+0000 7f765c387700 1 -- 172.21.15.118:0/3228183498 wait complete. 2023-07-13T13:52:54.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.080+0000 7f765c387700 1 Processor -- start 2023-07-13T13:52:54.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.080+0000 7f765c387700 1 -- start start 2023-07-13T13:52:54.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.081+0000 7f765c387700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765406ab40 0x7f7654149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.081+0000 7f765c387700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7654071980 0x7f76540c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.081+0000 7f765c387700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765414e3a0 0x7f76541ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.081+0000 7f765c387700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76541ea6a0 con 0x7f765406ab40 2023-07-13T13:52:54.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.081+0000 7f765c387700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765414a470 con 0x7f7654071980 2023-07-13T13:52:54.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.081+0000 7f765c387700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765414a710 con 0x7f765414e3a0 2023-07-13T13:52:54.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.081+0000 7f765a924700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765414e3a0 0x7f76541ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.082+0000 7f765a924700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765414e3a0 0x7f76541ed2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34658/0 (socket says 172.21.15.118:34658) 2023-07-13T13:52:54.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.082+0000 7f765a924700 1 -- 172.21.15.118:0/1668379121 learned_addr learned my addr 172.21.15.118:0/1668379121 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:54.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.086+0000 7f765a924700 1 -- 172.21.15.118:0/1668379121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7654071980 msgr2=0x7f76540c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.086+0000 7f765a924700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7654071980 0x7f76540c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.086+0000 7f765a924700 1 -- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765406ab40 msgr2=0x7f7654149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.086+0000 7f765a924700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765406ab40 0x7f7654149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.060 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.086+0000 7f765a924700 1 -- 172.21.15.118:0/1668379121 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009de0 con 0x7f765414e3a0 2023-07-13T13:52:54.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.088+0000 7f765a924700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765414e3a0 0x7f76541ed2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b9e0 tx=0x7f764c00bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.092+0000 7f764affd700 1 -- 172.21.15.118:0/1668379121 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00c9b0 con 0x7f765414e3a0 2023-07-13T13:52:54.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.092+0000 7f764affd700 1 -- 172.21.15.118:0/1668379121 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c00cb10 con 0x7f765414e3a0 2023-07-13T13:52:54.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.092+0000 7f764affd700 1 -- 172.21.15.118:0/1668379121 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c014440 con 0x7f765414e3a0 2023-07-13T13:52:54.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.092+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765414a9f0 con 0x7f765414e3a0 2023-07-13T13:52:54.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.092+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76541ea330 con 0x7f765414e3a0 2023-07-13T13:52:54.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.093+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765404e280 con 0x7f765414e3a0 2023-07-13T13:52:54.086 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.113+0000 7f764affd700 1 -- 172.21.15.118:0/1668379121 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f764c01c360 con 0x7f765414e3a0 2023-07-13T13:52:54.086 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.113+0000 7f764affd700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f763806ad30 0x7f763806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.114+0000 7f765a123700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f763806ad30 0x7f763806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.114+0000 7f765a123700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f763806ad30 0x7f763806d1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76500096d0 tx=0x7f7650006c30 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.117+0000 7f764affd700 1 -- 172.21.15.118:0/1668379121 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f764c006e40 con 0x7f765414e3a0 2023-07-13T13:52:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.132+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1800052d0 con 0x7fb184004850 2023-07-13T13:52:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.132+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb180005430 con 0x7fb184004850 2023-07-13T13:52:54.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.132+0000 7fb1937fe700 1 -- 172.21.15.118:0/1605702245 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1800038e0 con 0x7fb184004850 2023-07-13T13:52:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.133+0000 7fb19adb8700 1 -- 172.21.15.118:0/1605702245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb184004850 msgr2=0x7fb184004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.133+0000 7fb19adb8700 1 --2- 172.21.15.118:0/1605702245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb184004850 0x7fb184004cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1800016c0 tx=0x7fb184005880 comp rx=0 tx=0).stop 2023-07-13T13:52:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.133+0000 7fb199355700 1 -- 172.21.15.118:0/1605702245 reap_dead start 2023-07-13T13:52:54.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.133+0000 7fb19adb8700 1 -- 172.21.15.118:0/1605702245 shutdown_connections 2023-07-13T13:52:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.133+0000 7fb19adb8700 1 -- 172.21.15.118:0/1605702245 >> 172.21.15.118:0/1605702245 conn(0x7fb19406fa20 msgr2=0x7fb19406fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.133+0000 7fb19adb8700 1 -- 172.21.15.118:0/1605702245 shutdown_connections 2023-07-13T13:52:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.133+0000 7fb19adb8700 1 -- 172.21.15.118:0/1605702245 wait complete. 2023-07-13T13:52:54.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.134+0000 7fb19adb8700 1 Processor -- start 2023-07-13T13:52:54.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.134+0000 7fb19adb8700 1 -- start start 2023-07-13T13:52:54.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.135+0000 7fb19adb8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb184004850 0x7fb1940c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.135+0000 7fb19adb8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941dfe70 0x7fb1940c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.135+0000 7fb19adb8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb19414d1a0 0x7fb19414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.135+0000 7fb19adb8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19414db80 con 0x7fb19414d1a0 2023-07-13T13:52:54.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.135+0000 7fb19adb8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941ec920 con 0x7fb184004850 2023-07-13T13:52:54.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.135+0000 7fb19adb8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941ecbc0 con 0x7fb1941dfe70 2023-07-13T13:52:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.149+0000 7fd2ebfff700 1 -- 172.21.15.118:0/3707215440 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd2f80537b0 con 0x7fd304157010 2023-07-13T13:52:54.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.161+0000 7fb199355700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb19414d1a0 0x7fb19414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.163+0000 7fb199355700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb19414d1a0 0x7fb19414d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43332/0 (socket says 172.21.15.118:43332) 2023-07-13T13:52:54.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.163+0000 7fb199355700 1 -- 172.21.15.118:0/3969480402 learned_addr learned my addr 172.21.15.118:0/3969480402 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:54.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.167+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2eb80c6300 con 0x7f2eb8152850 2023-07-13T13:52:54.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.168+0000 7fb199355700 1 -- 172.21.15.118:0/3969480402 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941dfe70 msgr2=0x7fb1940c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.168+0000 7fb199355700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941dfe70 0x7fb1940c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.168+0000 7fb199355700 1 -- 172.21.15.118:0/3969480402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb184004850 msgr2=0x7fb1940c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.168+0000 7fb199355700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb184004850 0x7fb1940c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.168+0000 7fb199355700 1 -- 172.21.15.118:0/3969480402 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940c2920 con 0x7fb19414d1a0 2023-07-13T13:52:54.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.171+0000 7fb199355700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb19414d1a0 0x7fb19414d640 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb194071b50 tx=0x7fb18c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.176+0000 7fb1917fa700 1 -- 172.21.15.118:0/3969480402 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0074e0 con 0x7fb19414d1a0 2023-07-13T13:52:54.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.176+0000 7fb1917fa700 1 -- 172.21.15.118:0/3969480402 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c007660 con 0x7fb19414d1a0 2023-07-13T13:52:54.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.176+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1940c2c00 con 0x7fb19414d1a0 2023-07-13T13:52:54.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.176+0000 7fb1917fa700 1 -- 172.21.15.118:0/3969480402 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c007a10 con 0x7fb19414d1a0 2023-07-13T13:52:54.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.176+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1941de930 con 0x7fb19414d1a0 2023-07-13T13:52:54.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.177+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1940c2780 con 0x7fb19414d1a0 2023-07-13T13:52:54.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.280+0000 7f7ba8ff9700 1 -- 172.21.15.118:0/3698160862 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ba0021030 con 0x7f7bac0c8340 2023-07-13T13:52:54.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.281+0000 7f7ba8ff9700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7b9806ad30 0x7f7b9806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.281+0000 7f7babfff700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7b9806ad30 0x7f7b9806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.281+0000 7f7babfff700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7b9806ad30 0x7f7b9806d1e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0096d0 tx=0x7f7b9c006c30 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.286+0000 7f7ba8ff9700 1 -- 172.21.15.118:0/3698160862 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ba00193c0 con 0x7f7bac0c8340 2023-07-13T13:52:54.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.302+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5c440c5020 con 0x7f5c441570a0 2023-07-13T13:52:54.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.313+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850001850 con 0x7f0844005320 2023-07-13T13:52:54.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.313+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850003c00 con 0x7f0844005320 2023-07-13T13:52:54.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.313+0000 7f08577fe700 1 -- 172.21.15.118:0/341667406 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000c650 con 0x7f0844005320 2023-07-13T13:52:54.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.314+0000 7f085e525700 1 -- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0844005320 msgr2=0x7f084400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.314+0000 7f085e525700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0844005320 0x7f084400ba10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0850001de0 tx=0x7f0844005880 comp rx=0 tx=0).stop 2023-07-13T13:52:54.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.314+0000 7f085e525700 1 -- 172.21.15.118:0/341667406 shutdown_connections 2023-07-13T13:52:54.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.314+0000 7f085e525700 1 --2- 172.21.15.118:0/341667406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0844005320 0x7f084400ba10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.314+0000 7f085e525700 1 -- 172.21.15.118:0/341667406 >> 172.21.15.118:0/341667406 conn(0x7f08580cb880 msgr2=0x7f08580c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.314+0000 7f97f9650700 1 --2- 172.21.15.118:0/1077889068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f406f380 0x7f97f40c5d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f97f40c2740 tx=0x7f97e4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df9727497acf6d95 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.315+0000 7f085e525700 1 -- 172.21.15.118:0/341667406 shutdown_connections 2023-07-13T13:52:54.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.315+0000 7f085e525700 1 -- 172.21.15.118:0/341667406 wait complete. 2023-07-13T13:52:54.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.316+0000 7f085e525700 1 Processor -- start 2023-07-13T13:52:54.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.316+0000 7f085e525700 1 -- start start 2023-07-13T13:52:54.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.317+0000 7f085e525700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0844005320 0x7f0858150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.317+0000 7f085e525700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08580c98f0 0x7f0858150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.317+0000 7f085e525700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08581450a0 0x7f08581ee730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.317+0000 7f085e525700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858151360 con 0x7f08580c98f0 2023-07-13T13:52:54.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.317+0000 7f085e525700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858151f90 con 0x7f08581450a0 2023-07-13T13:52:54.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.317+0000 7f085e525700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085814eec0 con 0x7f0844005320 2023-07-13T13:52:54.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.331+0000 7f7ba8ff9700 1 -- 172.21.15.118:0/3698160862 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ba0056070 con 0x7f7bac0c8340 2023-07-13T13:52:54.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.354+0000 7f0857fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0844005320 0x7f0858150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.358+0000 7f085cac2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08581450a0 0x7f08581ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.358+0000 7f085cac2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08581450a0 0x7f08581ee730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48350/0 (socket says 172.21.15.118:48350) 2023-07-13T13:52:54.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.358+0000 7f085cac2700 1 -- 172.21.15.118:0/3947328367 learned_addr learned my addr 172.21.15.118:0/3947328367 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:54.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.362+0000 7f2eb5ffb700 1 -- 172.21.15.118:0/4087475271 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ea8018020 con 0x7f2eb8152850 2023-07-13T13:52:54.335 INFO:teuthology.orchestra.run.smithi118.stdout:55834574860 2023-07-13T13:52:54.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd30404e280 con 0x7fd304157010 2023-07-13T13:52:54.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2ea406ad30 msgr2=0x7f2ea406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2ea406ad30 0x7f2ea406d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0007fd0 tx=0x7f2eb0009040 comp rx=0 tx=0).stop 2023-07-13T13:52:54.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb8152850 msgr2=0x7f2eb81f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb8152850 0x7f2eb81f3760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8007ba0 tx=0x7f2ea8007eb0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f97f8e4f700 1 -- 172.21.15.118:0/1077889068 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e400b870 con 0x7f97f406f380 2023-07-13T13:52:54.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f97f8e4f700 1 -- 172.21.15.118:0/1077889068 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e400b9d0 con 0x7f97f406f380 2023-07-13T13:52:54.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 shutdown_connections 2023-07-13T13:52:54.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f2ea406ad30 0x7f2ea406d1e0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0007fd0 tx=0x7f2eb0009040 comp rx=0 tx=0).stop 2023-07-13T13:52:54.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eb81590f0 0x7f2eb81f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2eb806f380 0x7f2eb815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 --2- 172.21.15.118:0/4087475271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eb8152850 0x7f2eb81f3760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 >> 172.21.15.118:0/4087475271 conn(0x7f2eb8070d40 msgr2=0x7f2eb80c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 shutdown_connections 2023-07-13T13:52:54.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f2ebf97d700 1 -- 172.21.15.118:0/4087475271 wait complete. 2023-07-13T13:52:54.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.364+0000 7f97f8e4f700 1 -- 172.21.15.118:0/1077889068 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e400bd60 con 0x7f97f406f380 2023-07-13T13:52:54.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.365+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1077889068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f406f380 msgr2=0x7f97f40c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.365+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1077889068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f406f380 0x7f97f40c5d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f97f40c2740 tx=0x7f97e4009bd0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.366+0000 7f764affd700 1 -- 172.21.15.118:0/1668379121 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f764c054720 con 0x7f765414e3a0 2023-07-13T13:52:54.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.366+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1077889068 shutdown_connections 2023-07-13T13:52:54.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.366+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1077889068 >> v2:172.21.15.118:3300/0 conn(0x7f97f41590f0 0x7f97f40c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.366+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1077889068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f406f380 0x7f97f40c5d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.366+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1077889068 >> 172.21.15.118:0/1077889068 conn(0x7f97f4070d40 msgr2=0x7f97f4071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.368+0000 7f085cac2700 1 -- 172.21.15.118:0/3947328367 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0844005320 msgr2=0x7f0858150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.368+0000 7f085cac2700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0844005320 0x7f0858150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.368+0000 7f085cac2700 1 -- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08580c98f0 msgr2=0x7f0858150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.368+0000 7f085cac2700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08580c98f0 0x7f0858150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.368+0000 7f085cac2700 1 -- 172.21.15.118:0/3947328367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858155410 con 0x7f08581450a0 2023-07-13T13:52:54.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.372+0000 7f085cac2700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08581450a0 0x7f08581ee730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0858152f60 tx=0x7f0850001330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.372+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1077889068 shutdown_connections 2023-07-13T13:52:54.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.373+0000 7fb1917fa700 1 -- 172.21.15.118:0/3969480402 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb18c01b3b0 con 0x7fb19414d1a0 2023-07-13T13:52:54.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.373+0000 7fb1917fa700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb17806ad10 0x7fb17806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.373+0000 7fb1917fa700 1 -- 172.21.15.118:0/3969480402 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb18c088f90 con 0x7fb19414d1a0 2023-07-13T13:52:54.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.374+0000 7fb198b54700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb17806ad10 0x7fb17806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.374+0000 7fb198b54700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb17806ad10 0x7fb17806d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb188007a40 tx=0x7fb1880015c0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.375+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1077889068 wait complete. 2023-07-13T13:52:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.376+0000 7f97fc0b5700 1 Processor -- start 2023-07-13T13:52:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.376+0000 7f97fc0b5700 1 -- start start 2023-07-13T13:52:54.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.377+0000 7f97fc0b5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97f406f380 0x7f97f41e5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.377+0000 7f97fc0b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97f4152850 0x7f97f414c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f97fc0b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f41590f0 0x7f97f414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f97fc0b5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41565f0 con 0x7f97f4152850 2023-07-13T13:52:54.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f97fc0b5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4156890 con 0x7f97f41590f0 2023-07-13T13:52:54.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f97fc0b5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4156b70 con 0x7f97f406f380 2023-07-13T13:52:54.351 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f08557fa700 1 -- 172.21.15.118:0/3947328367 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850006dc0 con 0x7f08581450a0 2023-07-13T13:52:54.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f08557fa700 1 -- 172.21.15.118:0/3947328367 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850017070 con 0x7f08581450a0 2023-07-13T13:52:54.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f08557fa700 1 -- 172.21.15.118:0/3947328367 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850005430 con 0x7f08581450a0 2023-07-13T13:52:54.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08581556f0 con 0x7f08581450a0 2023-07-13T13:52:54.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.1 2023-07-13T13:52:54.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.378+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0858155cb0 con 0x7f08581450a0 2023-07-13T13:52:54.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.380+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085804e280 con 0x7f08581450a0 2023-07-13T13:52:54.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.381+0000 7f97fa652700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f41590f0 0x7f97f414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.384+0000 7f5c32ffd700 1 -- 172.21.15.118:0/2688629529 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c3c057df0 con 0x7f5c441570a0 2023-07-13T13:52:54.356 INFO:teuthology.orchestra.run.smithi118.stdout:64424509452 2023-07-13T13:52:54.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.384+0000 7f97f9e51700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97f406f380 0x7f97f41e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5c2406ad60 msgr2=0x7f5c2406d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5c2406ad60 0x7f5c2406d210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800a890 tx=0x7f5c38008040 comp rx=0 tx=0).stop 2023-07-13T13:52:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c441570a0 msgr2=0x7f5c44157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c441570a0 0x7f5c44157c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00cbb0 tx=0x7f5c3c00cf70 comp rx=0 tx=0).stop 2023-07-13T13:52:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 shutdown_connections 2023-07-13T13:52:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5c2406ad60 0x7f5c2406d210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c44071ab0 0x7f5c440ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5c441570a0 0x7f5c44157c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 --2- 172.21.15.118:0/2688629529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c440c7d80 0x7f5c44157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 >> 172.21.15.118:0/2688629529 conn(0x7f5c440cb880 msgr2=0x7f5c44155110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 shutdown_connections 2023-07-13T13:52:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.386+0000 7f5c48ea0700 1 -- 172.21.15.118:0/2688629529 wait complete. 2023-07-13T13:52:54.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.387+0000 7f97f9e51700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97f406f380 0x7f97f41e5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34688/0 (socket says 172.21.15.118:34688) 2023-07-13T13:52:54.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.387+0000 7f97f9e51700 1 -- 172.21.15.118:0/1586168937 learned_addr learned my addr 172.21.15.118:0/1586168937 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:54.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.394+0000 7f97f9e51700 1 -- 172.21.15.118:0/1586168937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f41590f0 msgr2=0x7f97f414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.394+0000 7f97f9e51700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f41590f0 0x7f97f414ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.394+0000 7f97f9e51700 1 -- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97f4152850 msgr2=0x7f97f414c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.394+0000 7f97f9e51700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97f4152850 0x7f97f414c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.394+0000 7f97f9e51700 1 -- 172.21.15.118:0/1586168937 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009550 con 0x7f97f406f380 2023-07-13T13:52:54.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.397+0000 7f97f9e51700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97f406f380 0x7f97f41e5050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97f000c4e0 tx=0x7f97f000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.4 2023-07-13T13:52:54.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.403+0000 7f97ea7fc700 1 -- 172.21.15.118:0/1586168937 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00052d0 con 0x7f97f406f380 2023-07-13T13:52:54.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.403+0000 7f97ea7fc700 1 -- 172.21.15.118:0/1586168937 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f0005430 con 0x7f97f406f380 2023-07-13T13:52:54.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.403+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f415b850 con 0x7f97f406f380 2023-07-13T13:52:54.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.403+0000 7f97ea7fc700 1 -- 172.21.15.118:0/1586168937 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f00038c0 con 0x7f97f406f380 2023-07-13T13:52:54.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.403+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f41e5590 con 0x7f97f406f380 2023-07-13T13:52:54.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.404+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f4156d30 con 0x7f97f406f380 2023-07-13T13:52:54.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.493+0000 7f08557fa700 1 -- 172.21.15.118:0/3947328367 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0850005590 con 0x7f08581450a0 2023-07-13T13:52:54.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.493+0000 7f08557fa700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f083806ad30 0x7f083806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.494+0000 7f0857fff700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f083806ad30 0x7f083806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.494+0000 7f0857fff700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f083806ad30 0x7f083806d1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0848006fd0 tx=0x7f0848008040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.498+0000 7fb1917fa700 1 -- 172.21.15.118:0/3969480402 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb18c053e40 con 0x7fb19414d1a0 2023-07-13T13:52:54.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.498+0000 7f08557fa700 1 -- 172.21.15.118:0/3947328367 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0850024310 con 0x7f08581450a0 2023-07-13T13:52:54.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.521+0000 7fd2ebfff700 1 -- 172.21.15.118:0/3707215440 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2f8056dd0 con 0x7fd304157010 2023-07-13T13:52:54.494 INFO:teuthology.orchestra.run.smithi118.stdout:64424509452 2023-07-13T13:52:54.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd2f006ace0 msgr2=0x7fd2f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd2f006ace0 0x7fd2f006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4000f60 tx=0x7fd2f4007a60 comp rx=0 tx=0).stop 2023-07-13T13:52:54.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304157010 msgr2=0x7fd304153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304157010 0x7fd304153e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800c4a0 tx=0x7fd2f800c860 comp rx=0 tx=0).stop 2023-07-13T13:52:54.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 shutdown_connections 2023-07-13T13:52:54.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd2f006ace0 0x7fd2f006d190 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4000f60 tx=0x7fd2f4007a60 comp rx=0 tx=0).stop 2023-07-13T13:52:54.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd30415ce50 0x7fd3041f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3040b45e0 0x7fd3040c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 --2- 172.21.15.118:0/3707215440 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304157010 0x7fd304153e50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 >> 172.21.15.118:0/3707215440 conn(0x7fd30406ad60 msgr2=0x7fd304154780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.524+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 shutdown_connections 2023-07-13T13:52:54.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.525+0000 7fd309ed4700 1 -- 172.21.15.118:0/3707215440 wait complete. 2023-07-13T13:52:54.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.7 2023-07-13T13:52:54.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.548+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7bac04e280 con 0x7f7bac0c8340 2023-07-13T13:52:54.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.584+0000 7f97ea7fc700 1 -- 172.21.15.118:0/1586168937 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97f0003a20 con 0x7f97f406f380 2023-07-13T13:52:54.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.584+0000 7f97ea7fc700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97d806ad60 0x7f97d806d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:54.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.584+0000 7f97f9650700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97d806ad60 0x7f97d806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:54.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.585+0000 7f97f9650700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97d806ad60 0x7f97d806d210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f97f4144f80 tx=0x7f97e4010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:54.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.593+0000 7f97ea7fc700 1 -- 172.21.15.118:0/1586168937 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f97f005bb50 con 0x7f97f406f380 2023-07-13T13:52:54.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.593+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f765414ab80 con 0x7f765414e3a0 2023-07-13T13:52:54.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.677+0000 7f08557fa700 1 -- 172.21.15.118:0/3947328367 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0850055570 con 0x7f08581450a0 2023-07-13T13:52:54.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.685+0000 7f7ba8ff9700 1 -- 172.21.15.118:0/3698160862 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ba0059690 con 0x7f7bac0c8340 2023-07-13T13:52:54.658 INFO:teuthology.orchestra.run.smithi118.stdout:64424509452 2023-07-13T13:52:54.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7b9806ad30 msgr2=0x7f7b9806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7b9806ad30 0x7f7b9806d1e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0096d0 tx=0x7f7b9c006c30 comp rx=0 tx=0).stop 2023-07-13T13:52:54.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bac0c8340 msgr2=0x7f7bac1505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bac0c8340 0x7f7bac1505d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009870 tx=0x7f7ba0004750 comp rx=0 tx=0).stop 2023-07-13T13:52:54.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 shutdown_connections 2023-07-13T13:52:54.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f7b9806ad30 0x7f7b9806d1e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bac14f520 0x7f7bac1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bac06b040 0x7f7bac157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 --2- 172.21.15.118:0/3698160862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bac0c8340 0x7f7bac1505d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 >> 172.21.15.118:0/3698160862 conn(0x7f7bac0cb880 msgr2=0x7f7bac0711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 shutdown_connections 2023-07-13T13:52:54.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.688+0000 7f7bb27b1700 1 -- 172.21.15.118:0/3698160862 wait complete. 2023-07-13T13:52:54.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.693+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1940c2780 con 0x7fb19414d1a0 2023-07-13T13:52:54.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.699+0000 7fb1917fa700 1 -- 172.21.15.118:0/3969480402 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1940c2780 con 0x7fb19414d1a0 2023-07-13T13:52:54.673 INFO:teuthology.orchestra.run.smithi118.stdout:60129542156 2023-07-13T13:52:54.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.701+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb17806ad10 msgr2=0x7fb17806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.701+0000 7fb19adb8700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb17806ad10 0x7fb17806d1c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb188007a40 tx=0x7fb1880015c0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.701+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb19414d1a0 msgr2=0x7fb19414d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.701+0000 7fb19adb8700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb19414d1a0 0x7fb19414d640 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb194071b50 tx=0x7fb18c00ca90 comp rx=0 tx=0).stop 2023-07-13T13:52:54.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.702+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 shutdown_connections 2023-07-13T13:52:54.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.702+0000 7fb19adb8700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb17806ad10 0x7fb17806d1c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.702+0000 7fb19adb8700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb184004850 0x7fb1940c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.702+0000 7fb19adb8700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb19414d1a0 0x7fb19414d640 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.702+0000 7fb19adb8700 1 --2- 172.21.15.118:0/3969480402 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1941dfe70 0x7fb1940c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.702+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 >> 172.21.15.118:0/3969480402 conn(0x7fb19406fa20 msgr2=0x7fb1940b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.702+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 shutdown_connections 2023-07-13T13:52:54.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.702+0000 7fb19adb8700 1 -- 172.21.15.118:0/3969480402 wait complete. 2023-07-13T13:52:54.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.6 2023-07-13T13:52:54.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.708+0000 7f97ea7fc700 1 -- 172.21.15.118:0/1586168937 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97f0053ed0 con 0x7f97f406f380 2023-07-13T13:52:54.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.0 2023-07-13T13:52:54.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.721+0000 7f764affd700 1 -- 172.21.15.118:0/1668379121 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f764c057d40 con 0x7f765414e3a0 2023-07-13T13:52:54.695 INFO:teuthology.orchestra.run.smithi118.stdout:64424509452 2023-07-13T13:52:54.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.724+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f763806ad30 msgr2=0x7f763806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.724+0000 7f765c387700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f763806ad30 0x7f763806d1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76500096d0 tx=0x7f7650006c30 comp rx=0 tx=0).stop 2023-07-13T13:52:54.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.725+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765414e3a0 msgr2=0x7f76541ed2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.725+0000 7f765c387700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765414e3a0 0x7f76541ed2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b9e0 tx=0x7f764c00bda0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.725+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 shutdown_connections 2023-07-13T13:52:54.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.725+0000 7f765c387700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f763806ad30 0x7f763806d1e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.725+0000 7f765c387700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f765414e3a0 0x7f76541ed2b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.725+0000 7f765c387700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f765406ab40 0x7f7654149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.725+0000 7f765c387700 1 --2- 172.21.15.118:0/1668379121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7654071980 0x7f76540c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.725+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 >> 172.21.15.118:0/1668379121 conn(0x7f7654069f30 msgr2=0x7f76540c2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.726+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 shutdown_connections 2023-07-13T13:52:54.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.726+0000 7f765c387700 1 -- 172.21.15.118:0/1668379121 wait complete. 2023-07-13T13:52:54.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.2 2023-07-13T13:52:54.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.906+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f08580c1cd0 con 0x7f08581450a0 2023-07-13T13:52:54.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.910+0000 7f08557fa700 1 -- 172.21.15.118:0/3947328367 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08580c1cd0 con 0x7f08581450a0 2023-07-13T13:52:54.883 INFO:teuthology.orchestra.run.smithi118.stdout:64424509452 2023-07-13T13:52:54.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f083806ad30 msgr2=0x7f083806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f083806ad30 0x7f083806d1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0848006fd0 tx=0x7f0848008040 comp rx=0 tx=0).stop 2023-07-13T13:52:54.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08581450a0 msgr2=0x7f08581ee730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08581450a0 0x7f08581ee730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0858152f60 tx=0x7f0850001330 comp rx=0 tx=0).stop 2023-07-13T13:52:54.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 shutdown_connections 2023-07-13T13:52:54.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f083806ad30 0x7f083806d1e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08581450a0 0x7f08581ee730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0844005320 0x7f0858150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 --2- 172.21.15.118:0/3947328367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f08580c98f0 0x7f0858150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 >> 172.21.15.118:0/3947328367 conn(0x7f08580cb880 msgr2=0x7f08580c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 shutdown_connections 2023-07-13T13:52:54.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.912+0000 7f085e525700 1 -- 172.21.15.118:0/3947328367 wait complete. 2023-07-13T13:52:54.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.915+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f97f415bd70 con 0x7f97f406f380 2023-07-13T13:52:54.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.919+0000 7f97ea7fc700 1 -- 172.21.15.118:0/1586168937 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97f415bd70 con 0x7f97f406f380 2023-07-13T13:52:54.892 INFO:teuthology.orchestra.run.smithi118.stdout:64424509452 2023-07-13T13:52:54.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97d806ad60 msgr2=0x7f97d806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97d806ad60 0x7f97d806d210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f97f4144f80 tx=0x7f97e4010000 comp rx=0 tx=0).stop 2023-07-13T13:52:54.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97f406f380 msgr2=0x7f97f41e5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:54.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97f406f380 0x7f97f41e5050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97f000c4e0 tx=0x7f97f000c8a0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 shutdown_connections 2023-07-13T13:52:54.895 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97d806ad60 0x7f97d806d210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97f41590f0 0x7f97f414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f97f406f380 0x7f97f41e5050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 --2- 172.21.15.118:0/1586168937 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97f4152850 0x7f97f414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:54.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 >> 172.21.15.118:0/1586168937 conn(0x7f97f4070d40 msgr2=0x7f97f40c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:54.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 shutdown_connections 2023-07-13T13:52:54.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:54.922+0000 7f97fc0b5700 1 -- 172.21.15.118:0/1586168937 wait complete. 2023-07-13T13:52:54.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.3 2023-07-13T13:52:54.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.5 2023-07-13T13:52:55.354 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-13T13:52:55.372 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-13T13:52:55.482 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.510+0000 7f18750fb700 1 Processor -- start 2023-07-13T13:52:55.482 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.510+0000 7f18750fb700 1 -- start start 2023-07-13T13:52:55.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.510+0000 7f18750fb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f187014f750 0x7f1870155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.510+0000 7f18750fb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f187006e4c0 0x7f18700c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.510+0000 7f18750fb700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18700c4720 con 0x7f1870155960 2023-07-13T13:52:55.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.511+0000 7f18750fb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18700c2900 con 0x7f187014f750 2023-07-13T13:52:55.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.511+0000 7f18750fb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1870155e60 con 0x7f187006e4c0 2023-07-13T13:52:55.483 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.511+0000 7f186f59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f187006e4c0 0x7f18700c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.484 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.511+0000 7f186e59c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1870155960 0x7f187006b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48138/0 (socket says 172.21.15.118:48138) 2023-07-13T13:52:55.484 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.511+0000 7f186e59c700 1 -- 172.21.15.118:0/972035962 learned_addr learned my addr 172.21.15.118:0/972035962 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:55.484 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.511+0000 7f186ed9d700 1 --2- 172.21.15.118:0/972035962 >> v2:172.21.15.123:3300/0 conn(0x7f187014f750 0x7f1870155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.514+0000 7f186dd9b700 1 -- 172.21.15.118:0/972035962 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497651967 0 0) 0x7f18700c4720 con 0x7f1870155960 2023-07-13T13:52:55.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.514+0000 7f186dd9b700 1 -- 172.21.15.118:0/972035962 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18580035b0 con 0x7f1870155960 2023-07-13T13:52:55.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.515+0000 7f186ed9d700 1 -- 172.21.15.118:0/972035962 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f187006e4c0 msgr2=0x7f18700c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.515+0000 7f186ed9d700 1 --2- 172.21.15.118:0/972035962 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f187006e4c0 0x7f18700c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.515+0000 7f186ed9d700 1 -- 172.21.15.118:0/972035962 >> v1:172.21.15.118:6789/0 conn(0x7f1870155960 legacy=0x7f187006b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.487 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.515+0000 7f186ed9d700 1 -- 172.21.15.118:0/972035962 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870156140 con 0x7f187014f750 2023-07-13T13:52:55.489 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.517+0000 7f186ed9d700 1 --2- 172.21.15.118:0/972035962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187014f750 0x7f1870155420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1860009840 tx=0x7f1860009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d9366cc7a36bc9a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.521+0000 7f186dd9b700 1 -- 172.21.15.118:0/972035962 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186000f8a0 con 0x7f187014f750 2023-07-13T13:52:55.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.521+0000 7f186dd9b700 1 -- 172.21.15.118:0/972035962 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186000fa00 con 0x7f187014f750 2023-07-13T13:52:55.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.521+0000 7f186dd9b700 1 -- 172.21.15.118:0/972035962 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186000fd90 con 0x7f187014f750 2023-07-13T13:52:55.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.522+0000 7f18750fb700 1 -- 172.21.15.118:0/972035962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187014f750 msgr2=0x7f1870155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.522+0000 7f18750fb700 1 --2- 172.21.15.118:0/972035962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187014f750 0x7f1870155420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1860009840 tx=0x7f1860009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:55.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.522+0000 7f18750fb700 1 -- 172.21.15.118:0/972035962 shutdown_connections 2023-07-13T13:52:55.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.522+0000 7f18750fb700 1 --2- 172.21.15.118:0/972035962 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f187006e4c0 0x7f18700c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.522+0000 7f18750fb700 1 --2- 172.21.15.118:0/972035962 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187014f750 0x7f1870155420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.522+0000 7f18750fb700 1 -- 172.21.15.118:0/972035962 >> 172.21.15.118:0/972035962 conn(0x7f1870070d40 msgr2=0x7f1870071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:55.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.522+0000 7f18750fb700 1 -- 172.21.15.118:0/972035962 shutdown_connections 2023-07-13T13:52:55.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.522+0000 7f18750fb700 1 -- 172.21.15.118:0/972035962 wait complete. 2023-07-13T13:52:55.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.524+0000 7f18750fb700 1 Processor -- start 2023-07-13T13:52:55.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.524+0000 7f18750fb700 1 -- start start 2023-07-13T13:52:55.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.524+0000 7f18750fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187006e4c0 0x7f18701590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.524+0000 7f18750fb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f187014f750 0x7f18701e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.524+0000 7f18750fb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1870155960 0x7f18701ea590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.524+0000 7f18750fb700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1870157cb0 con 0x7f187014f750 2023-07-13T13:52:55.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.524+0000 7f18750fb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18701597c0 con 0x7f187006e4c0 2023-07-13T13:52:55.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.524+0000 7f18750fb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18701ea100 con 0x7f1870155960 2023-07-13T13:52:55.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.525+0000 7f186ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187006e4c0 0x7f18701590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.525+0000 7f186f59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1870155960 0x7f18701ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.525+0000 7f186e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f187014f750 0x7f18701e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.525+0000 7f186ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187006e4c0 0x7f18701590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48376/0 (socket says 172.21.15.118:48376) 2023-07-13T13:52:55.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.525+0000 7f186ed9d700 1 -- 172.21.15.118:0/970063838 learned_addr learned my addr 172.21.15.118:0/970063838 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.529+0000 7f186ed9d700 1 -- 172.21.15.118:0/970063838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1870155960 msgr2=0x7f18701ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.529+0000 7f186ed9d700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1870155960 0x7f18701ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.530+0000 7f186ed9d700 1 -- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f187014f750 msgr2=0x7f18701e0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.530+0000 7f186ed9d700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f187014f750 0x7f18701e0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.530+0000 7f186ed9d700 1 -- 172.21.15.118:0/970063838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18600094a0 con 0x7f187006e4c0 2023-07-13T13:52:55.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.533+0000 7f186ed9d700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187006e4c0 0x7f18701590f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1860000c00 tx=0x7f1860004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.538+0000 7f18577fe700 1 -- 172.21.15.118:0/970063838 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186001d040 con 0x7f187006e4c0 2023-07-13T13:52:55.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.538+0000 7f18577fe700 1 -- 172.21.15.118:0/970063838 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18600038c0 con 0x7f187006e4c0 2023-07-13T13:52:55.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.538+0000 7f18577fe700 1 -- 172.21.15.118:0/970063838 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860003c70 con 0x7f187006e4c0 2023-07-13T13:52:55.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.538+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1870153520 con 0x7f187006e4c0 2023-07-13T13:52:55.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.538+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1870153ae0 con 0x7f187006e4c0 2023-07-13T13:52:55.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.539+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187006f7a0 con 0x7f187006e4c0 2023-07-13T13:52:55.513 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-13T13:52:55.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.555+0000 7fcf4ca5b700 1 Processor -- start 2023-07-13T13:52:55.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.555+0000 7fcf4ca5b700 1 -- start start 2023-07-13T13:52:55.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.556+0000 7fcf4ca5b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf480afcd0 0x7fcf4806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.556+0000 7fcf4ca5b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcf4815a3e0 0x7fcf480b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.556+0000 7fcf4ca5b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4815a880 con 0x7fcf480b1cf0 2023-07-13T13:52:55.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.556+0000 7fcf4ca5b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4806f580 con 0x7fcf480afcd0 2023-07-13T13:52:55.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.556+0000 7fcf4ca5b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf480b20f0 con 0x7fcf4815a3e0 2023-07-13T13:52:55.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.556+0000 7fcf4659c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf480afcd0 0x7fcf4806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.557+0000 7fcf4659c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf480afcd0 0x7fcf4806f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43370/0 (socket says 172.21.15.118:43370) 2023-07-13T13:52:55.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.557+0000 7fcf4659c700 1 -- 172.21.15.118:0/1213880915 learned_addr learned my addr 172.21.15.118:0/1213880915 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.559+0000 7fcf4659c700 1 -- 172.21.15.118:0/1213880915 >> v2:172.21.15.123:3300/0 conn(0x7fcf4815a3e0 msgr2=0x7fcf480b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.559+0000 7fcf4659c700 1 --2- 172.21.15.118:0/1213880915 >> v2:172.21.15.123:3300/0 conn(0x7fcf4815a3e0 0x7fcf480b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.559+0000 7fcf4659c700 1 -- 172.21.15.118:0/1213880915 >> v1:172.21.15.123:6789/0 conn(0x7fcf480b1cf0 legacy=0x7fcf48157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.559+0000 7fcf4659c700 1 -- 172.21.15.118:0/1213880915 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf480b2500 con 0x7fcf480afcd0 2023-07-13T13:52:55.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.561+0000 7f18577fe700 1 -- 172.21.15.118:0/970063838 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f186002c410 con 0x7f187006e4c0 2023-07-13T13:52:55.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.561+0000 7f18577fe700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f185c06ad10 0x7f185c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.561+0000 7fcf4659c700 1 --2- 172.21.15.118:0/1213880915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 0x7fcf4806f040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf480ca460 tx=0x7fcf38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b07263178c1265 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.561+0000 7f186e59c700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f185c06ad10 0x7f185c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.562+0000 7f186e59c700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f185c06ad10 0x7f185c06d1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1870156b00 tx=0x7f1864009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.565+0000 7fcf4559a700 1 -- 172.21.15.118:0/1213880915 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38004230 con 0x7fcf480afcd0 2023-07-13T13:52:55.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.565+0000 7fcf4559a700 1 -- 172.21.15.118:0/1213880915 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38004390 con 0x7fcf480afcd0 2023-07-13T13:52:55.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.565+0000 7fcf4559a700 1 -- 172.21.15.118:0/1213880915 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380036a0 con 0x7fcf480afcd0 2023-07-13T13:52:55.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7f18577fe700 1 -- 172.21.15.118:0/970063838 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1860060420 con 0x7f187006e4c0 2023-07-13T13:52:55.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1213880915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 msgr2=0x7fcf4806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1213880915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 0x7fcf4806f040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf480ca460 tx=0x7fcf38009bd0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1213880915 shutdown_connections 2023-07-13T13:52:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1213880915 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 0x7fcf4806f040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1213880915 >> v2:172.21.15.123:3300/0 conn(0x7fcf4815a3e0 0x7fcf480b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1213880915 >> 172.21.15.118:0/1213880915 conn(0x7fcf4806fa20 msgr2=0x7fcf4806fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1213880915 shutdown_connections 2023-07-13T13:52:55.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.566+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1213880915 wait complete. 2023-07-13T13:52:55.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.568+0000 7fcf4ca5b700 1 Processor -- start 2023-07-13T13:52:55.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.568+0000 7fcf4ca5b700 1 -- start start 2023-07-13T13:52:55.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.569+0000 7fcf4ca5b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 0x7fcf480c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.569+0000 7fcf4ca5b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf480b1cf0 0x7fcf480cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.569+0000 7fcf4ca5b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf4815a3e0 0x7fcf480cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.569+0000 7fcf4ca5b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf480cb9b0 con 0x7fcf480afcd0 2023-07-13T13:52:55.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.569+0000 7fcf4ca5b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf481ecbf0 con 0x7fcf480b1cf0 2023-07-13T13:52:55.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.569+0000 7fcf4ca5b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf480c8af0 con 0x7fcf4815a3e0 2023-07-13T13:52:55.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.569+0000 7fcf4659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 0x7fcf480c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.570+0000 7fcf46d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf4815a3e0 0x7fcf480cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.570+0000 7fcf46d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf4815a3e0 0x7fcf480cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34714/0 (socket says 172.21.15.118:34714) 2023-07-13T13:52:55.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.570+0000 7fcf46d9d700 1 -- 172.21.15.118:0/1231191462 learned_addr learned my addr 172.21.15.118:0/1231191462 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.574+0000 7fcf4659c700 1 -- 172.21.15.118:0/1231191462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf4815a3e0 msgr2=0x7fcf480cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.574+0000 7fcf4659c700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf4815a3e0 0x7fcf480cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.574+0000 7fcf4659c700 1 -- 172.21.15.118:0/1231191462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf480b1cf0 msgr2=0x7fcf480cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.574+0000 7fcf4659c700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf480b1cf0 0x7fcf480cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.574+0000 7fcf4659c700 1 -- 172.21.15.118:0/1231191462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38009550 con 0x7fcf480afcd0 2023-07-13T13:52:55.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.576+0000 7fcf4659c700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 0x7fcf480c7ed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf38015000 tx=0x7fcf38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.579+0000 7fcf36ffd700 1 -- 172.21.15.118:0/1231191462 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38003d10 con 0x7fcf480afcd0 2023-07-13T13:52:55.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.580+0000 7fcf36ffd700 1 -- 172.21.15.118:0/1231191462 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3801f070 con 0x7fcf480afcd0 2023-07-13T13:52:55.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.580+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf481e2080 con 0x7fcf480afcd0 2023-07-13T13:52:55.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.580+0000 7fcf36ffd700 1 -- 172.21.15.118:0/1231191462 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38011870 con 0x7fcf480afcd0 2023-07-13T13:52:55.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.580+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf481e2340 con 0x7fcf480afcd0 2023-07-13T13:52:55.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.580+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4804e280 con 0x7fcf480afcd0 2023-07-13T13:52:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.667+0000 7f0ffde20700 1 Processor -- start 2023-07-13T13:52:55.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.667+0000 7f0ffde20700 1 -- start start 2023-07-13T13:52:55.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.668+0000 7f0ffde20700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff80afcd0 0x7f0ff806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.668+0000 7f0ffde20700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80b2500 con 0x7f0ff815a3e0 2023-07-13T13:52:55.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.668+0000 7f0ffde20700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8156580 con 0x7f0ff8157cb0 2023-07-13T13:52:55.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.668+0000 7f0ffde20700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff806f580 con 0x7f0ff80afcd0 2023-07-13T13:52:55.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.669+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff80afcd0 0x7f0ff806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.669+0000 7f0ff77fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff80afcd0 0x7f0ff806f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34716/0 (socket says 172.21.15.118:34716) 2023-07-13T13:52:55.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.669+0000 7f0ff77fe700 1 -- 172.21.15.118:0/2807147370 learned_addr learned my addr 172.21.15.118:0/2807147370 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.672+0000 7f0ff77fe700 1 -- 172.21.15.118:0/2807147370 >> v1:172.21.15.123:6789/0 conn(0x7f0ff8157cb0 legacy=0x7f0ff8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.672+0000 7f0ff77fe700 1 -- 172.21.15.118:0/2807147370 >> v1:172.21.15.118:6789/0 conn(0x7f0ff815a3e0 legacy=0x7f0ff80b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.672+0000 7f0ff77fe700 1 -- 172.21.15.118:0/2807147370 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8156860 con 0x7f0ff80afcd0 2023-07-13T13:52:55.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.674+0000 7f0ff77fe700 1 --2- 172.21.15.118:0/2807147370 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff80afcd0 0x7f0ff806f040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009920 tx=0x7f0fe8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1569579f184a0893 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ff67fc700 1 -- 172.21.15.118:0/2807147370 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8004230 con 0x7f0ff80afcd0 2023-07-13T13:52:55.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ff67fc700 1 -- 172.21.15.118:0/2807147370 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8004390 con 0x7f0ff80afcd0 2023-07-13T13:52:55.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ff67fc700 1 -- 172.21.15.118:0/2807147370 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8009e70 con 0x7f0ff80afcd0 2023-07-13T13:52:55.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ffde20700 1 -- 172.21.15.118:0/2807147370 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff80afcd0 msgr2=0x7f0ff806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ffde20700 1 --2- 172.21.15.118:0/2807147370 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff80afcd0 0x7f0ff806f040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009920 tx=0x7f0fe8009c30 comp rx=0 tx=0).stop 2023-07-13T13:52:55.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ffde20700 1 -- 172.21.15.118:0/2807147370 shutdown_connections 2023-07-13T13:52:55.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ffde20700 1 --2- 172.21.15.118:0/2807147370 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff80afcd0 0x7f0ff806f040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ffde20700 1 -- 172.21.15.118:0/2807147370 >> 172.21.15.118:0/2807147370 conn(0x7f0ff806fa20 msgr2=0x7f0ff806fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:55.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.678+0000 7f0ffde20700 1 -- 172.21.15.118:0/2807147370 shutdown_connections 2023-07-13T13:52:55.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.679+0000 7f0ffde20700 1 -- 172.21.15.118:0/2807147370 wait complete. 2023-07-13T13:52:55.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.680+0000 7f0ffde20700 1 Processor -- start 2023-07-13T13:52:55.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.681+0000 7f0ffde20700 1 -- start start 2023-07-13T13:52:55.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.681+0000 7f0ffde20700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ff80afcd0 0x7f0ff80c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.681+0000 7f0ffde20700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff8157cb0 0x7f0ff80cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.681+0000 7f0ffde20700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ff815a3e0 0x7f0ff80c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.681+0000 7f0ffde20700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80ca4f0 con 0x7f0ff815a3e0 2023-07-13T13:52:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.681+0000 7f0ffde20700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80caf00 con 0x7f0ff80afcd0 2023-07-13T13:52:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.681+0000 7f0ffde20700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80c5670 con 0x7f0ff8157cb0 2023-07-13T13:52:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.682+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff8157cb0 0x7f0ff80cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.682+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff8157cb0 0x7f0ff80cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34726/0 (socket says 172.21.15.118:34726) 2023-07-13T13:52:55.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.682+0000 7f0ff6ffd700 1 -- 172.21.15.118:0/3010207146 learned_addr learned my addr 172.21.15.118:0/3010207146 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.686+0000 7f0ff6ffd700 1 -- 172.21.15.118:0/3010207146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ff80afcd0 msgr2=0x7f0ff80c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.686+0000 7f0ff6ffd700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ff80afcd0 0x7f0ff80c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.686+0000 7f0ff6ffd700 1 -- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ff815a3e0 msgr2=0x7f0ff80c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.686+0000 7f0ff6ffd700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ff815a3e0 0x7f0ff80c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.686+0000 7f0ff6ffd700 1 -- 172.21.15.118:0/3010207146 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8009550 con 0x7f0ff8157cb0 2023-07-13T13:52:55.660 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.688+0000 7f0ff6ffd700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff8157cb0 0x7f0ff80cc4e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000b4a0 tx=0x7f0fe000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.691+0000 7f0feffff700 1 -- 172.21.15.118:0/3010207146 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0011830 con 0x7f0ff8157cb0 2023-07-13T13:52:55.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.691+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80c5950 con 0x7f0ff8157cb0 2023-07-13T13:52:55.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.691+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff80ca700 con 0x7f0ff8157cb0 2023-07-13T13:52:55.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.692+0000 7f0feffff700 1 -- 172.21.15.118:0/3010207146 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0011990 con 0x7f0ff8157cb0 2023-07-13T13:52:55.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.692+0000 7f0feffff700 1 -- 172.21.15.118:0/3010207146 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00092c0 con 0x7f0ff8157cb0 2023-07-13T13:52:55.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.693+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff804e280 con 0x7f0ff8157cb0 2023-07-13T13:52:55.680 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-13T13:52:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.708+0000 7fcf36ffd700 1 -- 172.21.15.118:0/1231191462 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf38021030 con 0x7fcf480afcd0 2023-07-13T13:52:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.708+0000 7fcf36ffd700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcf2806ace0 0x7fcf2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.708+0000 7fcf36ffd700 1 -- 172.21.15.118:0/1231191462 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf3808b020 con 0x7fcf480afcd0 2023-07-13T13:52:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.709+0000 7fcf45d9b700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcf2806ace0 0x7fcf2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.709+0000 7fcf45d9b700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcf2806ace0 0x7fcf2806d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf481e1c90 tx=0x7fcf3c006c80 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.689 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-13T13:52:55.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.718+0000 7f0feffff700 1 -- 172.21.15.118:0/3010207146 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fe0011d00 con 0x7f0ff8157cb0 2023-07-13T13:52:55.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.718+0000 7f0feffff700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0fd806ace0 0x7f0fd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.718+0000 7f0ff77fe700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0fd806ace0 0x7f0fd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.719+0000 7f0feffff700 1 -- 172.21.15.118:0/3010207146 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0fe005c420 con 0x7f0ff8157cb0 2023-07-13T13:52:55.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.719+0000 7f0ff77fe700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0fd806ace0 0x7f0fd806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8000c00 tx=0x7f0fe8010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.717 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-13T13:52:55.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.814+0000 7f18577fe700 1 -- 172.21.15.118:0/970063838 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f18600587a0 con 0x7f187006e4c0 2023-07-13T13:52:55.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.851+0000 7f7619e39700 1 Processor -- start 2023-07-13T13:52:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.851+0000 7f7619e39700 1 -- start start 2023-07-13T13:52:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.852+0000 7f7619e39700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f761406ad90 0x7f76140c6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.852+0000 7f7619e39700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76140c7570 0x7f7614160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.852+0000 7f7619e39700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761406eb80 con 0x7f7614156d20 2023-07-13T13:52:55.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.852+0000 7f7619e39700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761415da90 con 0x7f761406ad90 2023-07-13T13:52:55.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.852+0000 7f7619e39700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761406edd0 con 0x7f76140c7570 2023-07-13T13:52:55.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.853+0000 7f7613fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76140c7570 0x7f7614160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.853+0000 7f7613fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f76140c7570 0x7f7614160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48420/0 (socket says 172.21.15.118:48420) 2023-07-13T13:52:55.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.853+0000 7f7613fff700 1 -- 172.21.15.118:0/2468917152 learned_addr learned my addr 172.21.15.118:0/2468917152 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.856+0000 7f7613fff700 1 -- 172.21.15.118:0/2468917152 >> v2:172.21.15.118:3300/0 conn(0x7f761406ad90 msgr2=0x7f76140c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.856+0000 7f7613fff700 1 --2- 172.21.15.118:0/2468917152 >> v2:172.21.15.118:3300/0 conn(0x7f761406ad90 0x7f76140c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.856+0000 7f7613fff700 1 -- 172.21.15.118:0/2468917152 >> v1:172.21.15.118:6789/0 conn(0x7f7614156d20 legacy=0x7f7614160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.828 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.856+0000 7f7613fff700 1 -- 172.21.15.118:0/2468917152 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7614069fd0 con 0x7f76140c7570 2023-07-13T13:52:55.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.858+0000 7f7613fff700 1 --2- 172.21.15.118:0/2468917152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76140c7570 0x7f7614160740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7614072670 tx=0x7f760c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c318ee722743467 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.861+0000 7fed429bc700 1 Processor -- start 2023-07-13T13:52:55.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.861+0000 7fed429bc700 1 -- start start 2023-07-13T13:52:55.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.861+0000 7f76127fc700 1 -- 172.21.15.118:0/2468917152 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00e070 con 0x7f76140c7570 2023-07-13T13:52:55.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.861+0000 7f76127fc700 1 -- 172.21.15.118:0/2468917152 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c003a20 con 0x7f76140c7570 2023-07-13T13:52:55.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.861+0000 7f76127fc700 1 -- 172.21.15.118:0/2468917152 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c003dd0 con 0x7f76140c7570 2023-07-13T13:52:55.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.862+0000 7fed429bc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed3c152550 0x7fed3c0c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.862+0000 7fed429bc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c159470 con 0x7fed3c0c7ff0 2023-07-13T13:52:55.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.862+0000 7fed429bc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c072360 con 0x7fed3c070f60 2023-07-13T13:52:55.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.862+0000 7fed429bc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3c0c50d0 con 0x7fed3c152550 2023-07-13T13:52:55.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.862+0000 7f7619e39700 1 -- 172.21.15.118:0/2468917152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76140c7570 msgr2=0x7f7614160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.862+0000 7f7619e39700 1 --2- 172.21.15.118:0/2468917152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76140c7570 0x7f7614160740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7614072670 tx=0x7f760c00b330 comp rx=0 tx=0).stop 2023-07-13T13:52:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.862+0000 7f7619e39700 1 -- 172.21.15.118:0/2468917152 shutdown_connections 2023-07-13T13:52:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.863+0000 7f7619e39700 1 --2- 172.21.15.118:0/2468917152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f76140c7570 0x7f7614160740 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.863+0000 7f7619e39700 1 --2- 172.21.15.118:0/2468917152 >> v2:172.21.15.118:3300/0 conn(0x7f761406ad90 0x7f76140c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.863+0000 7f7619e39700 1 -- 172.21.15.118:0/2468917152 >> 172.21.15.118:0/2468917152 conn(0x7f7614070d40 msgr2=0x7f7614071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.863+0000 7f7619e39700 1 -- 172.21.15.118:0/2468917152 shutdown_connections 2023-07-13T13:52:55.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.863+0000 7f7619e39700 1 -- 172.21.15.118:0/2468917152 wait complete. 2023-07-13T13:52:55.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.864+0000 7f7619e39700 1 Processor -- start 2023-07-13T13:52:55.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.864+0000 7f7619e39700 1 -- start start 2023-07-13T13:52:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.865+0000 7f7619e39700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761406ad90 0x7f76140c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.865+0000 7f7619e39700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f76140c7570 0x7f761415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.865+0000 7f7619e39700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7614156d20 0x7f761414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.865+0000 7f7619e39700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76141f6850 con 0x7f761406ad90 2023-07-13T13:52:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.865+0000 7f7619e39700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76140c44f0 con 0x7f7614156d20 2023-07-13T13:52:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.865+0000 7f7619e39700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761415d420 con 0x7f76140c7570 2023-07-13T13:52:55.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.864+0000 7fed40f59700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fed3c070f60 0x7fed3c0c5570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:42982/0 (socket says 172.21.15.118:42982) 2023-07-13T13:52:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.864+0000 7fed40f59700 1 -- 172.21.15.118:0/3655977534 learned_addr learned my addr 172.21.15.118:0/3655977534 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.867+0000 7f7613fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7614156d20 0x7f761414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.867+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820068130 0 0) 0x7fed3c072360 con 0x7fed3c070f60 2023-07-13T13:52:55.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.867+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed240035b0 con 0x7fed3c070f60 2023-07-13T13:52:55.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.868+0000 7f7613fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7614156d20 0x7f761414e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48432/0 (socket says 172.21.15.118:48432) 2023-07-13T13:52:55.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.868+0000 7f7613fff700 1 -- 172.21.15.118:0/3813338243 learned_addr learned my addr 172.21.15.118:0/3813338243 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.872+0000 7f7613fff700 1 -- 172.21.15.118:0/3813338243 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f76140c7570 msgr2=0x7f761415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.872+0000 7f7613fff700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f76140c7570 0x7f761415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.872+0000 7f7613fff700 1 -- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761406ad90 msgr2=0x7f76140c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.872+0000 7f7613fff700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761406ad90 0x7f76140c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.872+0000 7f7613fff700 1 -- 172.21.15.118:0/3813338243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009b30 con 0x7f7614156d20 2023-07-13T13:52:55.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2671813560 0 0) 0x7fed240035b0 con 0x7fed3c070f60 2023-07-13T13:52:55.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 >> v2:172.21.15.118:3300/0 conn(0x7fed3c152550 msgr2=0x7fed3c0c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 --2- 172.21.15.118:0/3655977534 >> v2:172.21.15.118:3300/0 conn(0x7fed3c152550 0x7fed3c0c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 >> v1:172.21.15.118:6789/0 conn(0x7fed3c0c7ff0 legacy=0x7fed3c070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c158610 con 0x7fed3c070f60 2023-07-13T13:52:55.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402946124 0 0) 0x7fed340019f0 con 0x7fed3c070f60 2023-07-13T13:52:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 >> v1:172.21.15.123:6789/0 conn(0x7fed3c070f60 legacy=0x7fed3c0c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed24003a50 0x7fed24003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed24004850 0x7fed24004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed24005300 0x7fed2400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c0c50d0 con 0x7fed24004850 2023-07-13T13:52:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2400c220 con 0x7fed24005300 2023-07-13T13:52:55.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed24014bf0 con 0x7fed24003a50 2023-07-13T13:52:55.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.877+0000 7f7613fff700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7614156d20 0x7f761414e3e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f760c015040 tx=0x7f760c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.882+0000 7f75fbfff700 1 -- 172.21.15.118:0/3813338243 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c004300 con 0x7f7614156d20 2023-07-13T13:52:55.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.882+0000 7f75fbfff700 1 -- 172.21.15.118:0/3813338243 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c004480 con 0x7f7614156d20 2023-07-13T13:52:55.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.882+0000 7f75fbfff700 1 -- 172.21.15.118:0/3813338243 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c004830 con 0x7f7614156d20 2023-07-13T13:52:55.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.882+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76141f6a40 con 0x7f7614156d20 2023-07-13T13:52:55.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.883+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76140c4740 con 0x7f7614156d20 2023-07-13T13:52:55.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.884+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761404e280 con 0x7f7614156d20 2023-07-13T13:52:55.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.884+0000 7fed40f59700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed24005300 0x7fed2400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.885+0000 7fcf36ffd700 1 -- 172.21.15.118:0/1231191462 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf38055e50 con 0x7fcf480afcd0 2023-07-13T13:52:55.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.896+0000 7ff9286c1700 1 Processor -- start 2023-07-13T13:52:55.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.896+0000 7ff9286c1700 1 -- start start 2023-07-13T13:52:55.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.897+0000 7ff9286c1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92014f520 0x7ff9200c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.897+0000 7ff9286c1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff92006b040 0x7ff92015fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.897+0000 7ff9286c1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9201593d0 con 0x7ff9200c8340 2023-07-13T13:52:55.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.897+0000 7ff9286c1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9200c2770 con 0x7ff92006b040 2023-07-13T13:52:55.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.897+0000 7ff9286c1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9200c1cf0 con 0x7ff92014f520 2023-07-13T13:52:55.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.941+0000 7fed3b7fe700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed24004850 0x7fed24004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.946+0000 7fed3b7fe700 1 -- 172.21.15.118:0/3655977534 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed24003a50 msgr2=0x7fed24003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.946+0000 7fed3b7fe700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed24003a50 0x7fed24003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.946+0000 7fed3b7fe700 1 -- 172.21.15.118:0/3655977534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed24005300 msgr2=0x7fed2400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.946+0000 7fed3b7fe700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed24005300 0x7fed2400ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.946+0000 7fed3b7fe700 1 -- 172.21.15.118:0/3655977534 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240035b0 con 0x7fed24004850 2023-07-13T13:52:55.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.946+0000 7fed40f59700 1 -- 172.21.15.118:0/3655977534 reap_dead start 2023-07-13T13:52:55.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.951+0000 7fed3b7fe700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed24004850 0x7fed24004cc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed300016c0 tx=0x7fed24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62988f129151803a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.923 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.951+0000 7ff926c5e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff92006b040 0x7ff92015fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.952+0000 7ff926c5e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff92006b040 0x7ff92015fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43434/0 (socket says 172.21.15.118:43434) 2023-07-13T13:52:55.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.952+0000 7ff926c5e700 1 -- 172.21.15.118:0/2029662995 learned_addr learned my addr 172.21.15.118:0/2029662995 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.929 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.958+0000 7ff926c5e700 1 -- 172.21.15.118:0/2029662995 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92014f520 msgr2=0x7ff9200c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.958+0000 7ff926c5e700 1 --2- 172.21.15.118:0/2029662995 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92014f520 0x7ff9200c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.958+0000 7ff926c5e700 1 -- 172.21.15.118:0/2029662995 >> v1:172.21.15.123:6789/0 conn(0x7ff9200c8340 legacy=0x7ff9201588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:55.930 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.958+0000 7ff926c5e700 1 -- 172.21.15.118:0/2029662995 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920071dd0 con 0x7ff92006b040 2023-07-13T13:52:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.960+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed300052d0 con 0x7fed24004850 2023-07-13T13:52:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.960+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed30005430 con 0x7fed24004850 2023-07-13T13:52:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.960+0000 7fed3affd700 1 -- 172.21.15.118:0/3655977534 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed300038c0 con 0x7fed24004850 2023-07-13T13:52:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.961+0000 7fed429bc700 1 -- 172.21.15.118:0/3655977534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed24004850 msgr2=0x7fed24004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.961+0000 7fed429bc700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed24004850 0x7fed24004cc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed300016c0 tx=0x7fed24005880 comp rx=0 tx=0).stop 2023-07-13T13:52:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.961+0000 7fed429bc700 1 -- 172.21.15.118:0/3655977534 shutdown_connections 2023-07-13T13:52:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.961+0000 7fed429bc700 1 --2- 172.21.15.118:0/3655977534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed24004850 0x7fed24004cc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.961+0000 7fed429bc700 1 -- 172.21.15.118:0/3655977534 >> 172.21.15.118:0/3655977534 conn(0x7fed3c0cb880 msgr2=0x7fed3c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.961+0000 7fed429bc700 1 -- 172.21.15.118:0/3655977534 shutdown_connections 2023-07-13T13:52:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.961+0000 7ff926c5e700 1 --2- 172.21.15.118:0/2029662995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff92006b040 0x7ff92015fc10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff918009e80 tx=0x7ff91800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5394ba5546c8e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.961+0000 7fed429bc700 1 -- 172.21.15.118:0/3655977534 wait complete. 2023-07-13T13:52:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.963+0000 7fed429bc700 1 Processor -- start 2023-07-13T13:52:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.963+0000 7fed429bc700 1 -- start start 2023-07-13T13:52:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.964+0000 7fed429bc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed24004850 0x7fed3c151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.964+0000 7fed429bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3c1e9c10 0x7fed3c155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.964+0000 7fed429bc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c1ea080 0x7fed3c14b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.964+0000 7fed429bc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c152f40 con 0x7fed3c1ea080 2023-07-13T13:52:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.964+0000 7fed429bc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c1e9780 con 0x7fed3c1e9c10 2023-07-13T13:52:55.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.964+0000 7fed429bc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c1537f0 con 0x7fed24004850 2023-07-13T13:52:55.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.966+0000 7f0feffff700 1 -- 172.21.15.118:0/3010207146 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0fe0058230 con 0x7f0ff8157cb0 2023-07-13T13:52:55.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.968+0000 7f75fbfff700 1 -- 172.21.15.118:0/3813338243 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f760c019070 con 0x7f7614156d20 2023-07-13T13:52:55.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.968+0000 7f75fbfff700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f760006ad10 0x7f760006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.969+0000 7f76137fe700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f760006ad10 0x7f760006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.969+0000 7f76137fe700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f760006ad10 0x7f760006d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76040096d0 tx=0x7f7604006c30 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.970+0000 7fed40f59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c1ea080 0x7fed3c14b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.971+0000 7fed40f59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c1ea080 0x7fed3c14b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43442/0 (socket says 172.21.15.118:43442) 2023-07-13T13:52:55.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.971+0000 7fed40f59700 1 -- 172.21.15.118:0/3207163236 learned_addr learned my addr 172.21.15.118:0/3207163236 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.973+0000 7f75fbfff700 1 -- 172.21.15.118:0/3813338243 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f760c05d760 con 0x7f7614156d20 2023-07-13T13:52:55.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.975+0000 7fed3bfff700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed24004850 0x7fed3c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.976+0000 7fed40f59700 1 -- 172.21.15.118:0/3207163236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed24004850 msgr2=0x7fed3c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.976+0000 7fed40f59700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed24004850 0x7fed3c151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.976+0000 7fed40f59700 1 -- 172.21.15.118:0/3207163236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3c1e9c10 msgr2=0x7fed3c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.976+0000 7fed40f59700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3c1e9c10 0x7fed3c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.976+0000 7fed40f59700 1 -- 172.21.15.118:0/3207163236 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c153ab0 con 0x7fed3c1ea080 2023-07-13T13:52:55.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.976+0000 7ff92545b700 1 -- 172.21.15.118:0/2029662995 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91800e070 con 0x7ff92006b040 2023-07-13T13:52:55.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.976+0000 7ff92545b700 1 -- 172.21.15.118:0/2029662995 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918003a20 con 0x7ff92006b040 2023-07-13T13:52:55.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.976+0000 7ff92545b700 1 -- 172.21.15.118:0/2029662995 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918003dd0 con 0x7ff92006b040 2023-07-13T13:52:55.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.977+0000 7ff9286c1700 1 -- 172.21.15.118:0/2029662995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff92006b040 msgr2=0x7ff92015fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.977+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2029662995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff92006b040 0x7ff92015fc10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff918009e80 tx=0x7ff91800b330 comp rx=0 tx=0).stop 2023-07-13T13:52:55.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.977+0000 7ff9286c1700 1 -- 172.21.15.118:0/2029662995 shutdown_connections 2023-07-13T13:52:55.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.977+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2029662995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff92006b040 0x7ff92015fc10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.977+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2029662995 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92014f520 0x7ff9200c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.977+0000 7ff9286c1700 1 -- 172.21.15.118:0/2029662995 >> 172.21.15.118:0/2029662995 conn(0x7ff9200cb880 msgr2=0x7ff9200c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:55.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.978+0000 7ff9286c1700 1 -- 172.21.15.118:0/2029662995 shutdown_connections 2023-07-13T13:52:55.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.978+0000 7ff9286c1700 1 -- 172.21.15.118:0/2029662995 wait complete. 2023-07-13T13:52:55.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.979+0000 7ff9286c1700 1 Processor -- start 2023-07-13T13:52:55.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.980+0000 7fed40f59700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c1ea080 0x7fed3c14b590 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0c8790 tx=0x7fed3400df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.980+0000 7ff9286c1700 1 -- start start 2023-07-13T13:52:55.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.981+0000 7ff9286c1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92006b040 0x7ff9200c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.981+0000 7ff9286c1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9200c8340 0x7ff9201f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.981+0000 7ff9286c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff92014f520 0x7ff9201f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:55.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.981+0000 7ff9286c1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920151e20 con 0x7ff92014f520 2023-07-13T13:52:55.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.981+0000 7ff9286c1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff920157d60 con 0x7ff9200c8340 2023-07-13T13:52:55.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.981+0000 7ff9286c1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9201f3040 con 0x7ff92006b040 2023-07-13T13:52:55.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.982+0000 7ff92645d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92006b040 0x7ff9200c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:55.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.982+0000 7ff92645d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92006b040 0x7ff9200c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34764/0 (socket says 172.21.15.118:34764) 2023-07-13T13:52:55.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.982+0000 7ff92645d700 1 -- 172.21.15.118:0/2136904854 learned_addr learned my addr 172.21.15.118:0/2136904854 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:55.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.986+0000 7ff92645d700 1 -- 172.21.15.118:0/2136904854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9200c8340 msgr2=0x7ff9201f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.986+0000 7ff92645d700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9200c8340 0x7ff9201f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.986+0000 7ff92645d700 1 -- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff92014f520 msgr2=0x7ff9201f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:55.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.986+0000 7ff92645d700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff92014f520 0x7ff9201f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:55.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.986+0000 7ff92645d700 1 -- 172.21.15.118:0/2136904854 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918009b30 con 0x7ff92006b040 2023-07-13T13:52:55.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.987+0000 7fed38ff9700 1 -- 172.21.15.118:0/3207163236 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3400bb40 con 0x7fed3c1ea080 2023-07-13T13:52:55.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.987+0000 7fed38ff9700 1 -- 172.21.15.118:0/3207163236 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3400bcc0 con 0x7fed3c1ea080 2023-07-13T13:52:55.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.987+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c153d90 con 0x7fed3c1ea080 2023-07-13T13:52:55.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.987+0000 7fed38ff9700 1 -- 172.21.15.118:0/3207163236 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34007030 con 0x7fed3c1ea080 2023-07-13T13:52:55.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.987+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c1e93a0 con 0x7fed3c1ea080 2023-07-13T13:52:55.960 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.989+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c0c9b90 con 0x7fed3c1ea080 2023-07-13T13:52:55.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.992+0000 7ff92645d700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92006b040 0x7ff9200c9dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00b560 tx=0x7ff91c00b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:55.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.996+0000 7ff916ffd700 1 -- 172.21.15.118:0/2136904854 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c011830 con 0x7ff92006b040 2023-07-13T13:52:55.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.996+0000 7ff916ffd700 1 -- 172.21.15.118:0/2136904854 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c011990 con 0x7ff92006b040 2023-07-13T13:52:55.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.996+0000 7ff916ffd700 1 -- 172.21.15.118:0/2136904854 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c011d40 con 0x7ff92006b040 2023-07-13T13:52:55.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.996+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9201f3700 con 0x7ff92006b040 2023-07-13T13:52:55.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.996+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff920156490 con 0x7ff92006b040 2023-07-13T13:52:55.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:55.997+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92004e280 con 0x7ff92006b040 2023-07-13T13:52:55.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-13T13:52:55.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-13T13:52:56.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.077+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f187004e280 con 0x7f187006e4c0 2023-07-13T13:52:56.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.135+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcf480b1ad0 con 0x7fcf480afcd0 2023-07-13T13:52:56.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.144+0000 7f1f18056700 1 Processor -- start 2023-07-13T13:52:56.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.144+0000 7f1f18056700 1 -- start start 2023-07-13T13:52:56.116 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.145+0000 7f1f18056700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f10152ce0 0x7f1f100c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.145+0000 7f1f18056700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f100c59c0 con 0x7f1f100b4370 2023-07-13T13:52:56.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.145+0000 7f1f18056700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f100c9710 con 0x7f1f100c9210 2023-07-13T13:52:56.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.145+0000 7f1f18056700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f101530b0 con 0x7f1f10152ce0 2023-07-13T13:52:56.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.153+0000 7fed38ff9700 1 -- 172.21.15.118:0/3207163236 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed34007190 con 0x7fed3c1ea080 2023-07-13T13:52:56.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.153+0000 7fed38ff9700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed2806ad30 0x7fed2806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.154+0000 7fed38ff9700 1 -- 172.21.15.118:0/3207163236 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed34089c00 con 0x7fed3c1ea080 2023-07-13T13:52:56.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.154+0000 7fed3bfff700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed2806ad30 0x7fed2806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:56.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.154+0000 7fed3bfff700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed2806ad30 0x7fed2806d1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fed2c004790 tx=0x7fed2c008040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:56.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.163+0000 7f68a2a0b700 1 Processor -- start 2023-07-13T13:52:56.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.163+0000 7f68a2a0b700 1 -- start start 2023-07-13T13:52:56.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.163+0000 7f68a2a0b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f689c06b040 0x7f689c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.163+0000 7f68a2a0b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c1587e0 con 0x7f689c152410 2023-07-13T13:52:56.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.163+0000 7f68a2a0b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c06bd00 con 0x7f689c06f040 2023-07-13T13:52:56.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.163+0000 7f68a2a0b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c1585f0 con 0x7f689c06b040 2023-07-13T13:52:56.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.167+0000 7f75fbfff700 1 -- 172.21.15.118:0/3813338243 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f760c055ae0 con 0x7f7614156d20 2023-07-13T13:52:56.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.173+0000 7ff916ffd700 1 -- 172.21.15.118:0/2136904854 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff91c01a400 con 0x7ff92006b040 2023-07-13T13:52:56.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.173+0000 7ff916ffd700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff90406ad10 0x7ff90406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.145 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.174+0000 7ff925c5c700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff90406ad10 0x7ff90406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:56.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.174+0000 7ff925c5c700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff90406ad10 0x7ff90406d1c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff920158420 tx=0x7ff910007a20 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:56.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.176+0000 7f18577fe700 1 -- 172.21.15.118:0/970063838 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f186005bdc0 con 0x7f187006e4c0 2023-07-13T13:52:56.148 INFO:teuthology.orchestra.run.smithi118.stdout:55834574860 2023-07-13T13:52:56.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.178+0000 7f1f15df2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f10152ce0 0x7f1f100c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:56.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f1f15df2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f10152ce0 0x7f1f100c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48488/0 (socket says 172.21.15.118:48488) 2023-07-13T13:52:56.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f1f15df2700 1 -- 172.21.15.118:0/3284324308 learned_addr learned my addr 172.21.15.118:0/3284324308 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:56.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f185c06ad10 msgr2=0x7f185c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f185c06ad10 0x7f185c06d1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1870156b00 tx=0x7f1864009040 comp rx=0 tx=0).stop 2023-07-13T13:52:56.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187006e4c0 msgr2=0x7f18701590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187006e4c0 0x7f18701590f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1860000c00 tx=0x7f1860004750 comp rx=0 tx=0).stop 2023-07-13T13:52:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 shutdown_connections 2023-07-13T13:52:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f185c06ad10 0x7f185c06d1c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187006e4c0 0x7f18701590f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1870155960 0x7f18701ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 --2- 172.21.15.118:0/970063838 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f187014f750 0x7f18701e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 >> 172.21.15.118:0/970063838 conn(0x7f1870070d40 msgr2=0x7f1870154c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 shutdown_connections 2023-07-13T13:52:56.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.179+0000 7f18750fb700 1 -- 172.21.15.118:0/970063838 wait complete. 2023-07-13T13:52:56.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.183+0000 7f1f15df2700 1 -- 172.21.15.118:0/3284324308 >> v1:172.21.15.123:6789/0 conn(0x7f1f100c9210 legacy=0x7f1f1006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:56.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.183+0000 7f1f15df2700 1 -- 172.21.15.118:0/3284324308 >> v1:172.21.15.118:6789/0 conn(0x7f1f100b4370 legacy=0x7f1f1015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:56.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.183+0000 7f1f15df2700 1 -- 172.21.15.118:0/3284324308 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10158990 con 0x7f1f10152ce0 2023-07-13T13:52:56.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.187+0000 7f1f15df2700 1 --2- 172.21.15.118:0/3284324308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f10152ce0 0x7f1f100c4ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0098f0 tx=0x7f1f0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19fc9932c569be0d server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:56.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.188+0000 7f689b7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f689c06f040 0x7f689c15c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:42990/0 (socket says 172.21.15.118:42990) 2023-07-13T13:52:56.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.188+0000 7f689b7fe700 1 -- 172.21.15.118:0/116955717 learned_addr learned my addr 172.21.15.118:0/116955717 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:56.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.193+0000 7f1f14df0700 1 -- 172.21.15.118:0/3284324308 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c004230 con 0x7f1f10152ce0 2023-07-13T13:52:56.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.194+0000 7f1f14df0700 1 -- 172.21.15.118:0/3284324308 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c004390 con 0x7f1f10152ce0 2023-07-13T13:52:56.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.194+0000 7f1f14df0700 1 -- 172.21.15.118:0/3284324308 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0036a0 con 0x7f1f10152ce0 2023-07-13T13:52:56.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.194+0000 7f1f18056700 1 -- 172.21.15.118:0/3284324308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f10152ce0 msgr2=0x7f1f100c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.194+0000 7f1f18056700 1 --2- 172.21.15.118:0/3284324308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f10152ce0 0x7f1f100c4ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0098f0 tx=0x7f1f0c009c00 comp rx=0 tx=0).stop 2023-07-13T13:52:56.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.194+0000 7f1f18056700 1 -- 172.21.15.118:0/3284324308 shutdown_connections 2023-07-13T13:52:56.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.194+0000 7f1f18056700 1 --2- 172.21.15.118:0/3284324308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f10152ce0 0x7f1f100c4ab0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.194+0000 7f1f18056700 1 -- 172.21.15.118:0/3284324308 >> 172.21.15.118:0/3284324308 conn(0x7f1f1006c7c0 msgr2=0x7f1f10071660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.195+0000 7f1f18056700 1 -- 172.21.15.118:0/3284324308 shutdown_connections 2023-07-13T13:52:56.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.195+0000 7f1f18056700 1 -- 172.21.15.118:0/3284324308 wait complete. 2023-07-13T13:52:56.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.1 2023-07-13T13:52:56.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.196+0000 7f1f18056700 1 Processor -- start 2023-07-13T13:52:56.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.197+0000 7f1f18056700 1 -- start start 2023-07-13T13:52:56.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.198+0000 7f1f18056700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f100b4370 0x7f1f101599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.198+0000 7f1f18056700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f100c9210 0x7f1f1014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.198+0000 7f1f18056700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f10152ce0 0x7f1f10157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.198+0000 7f1f18056700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f100cc8b0 con 0x7f1f100c9210 2023-07-13T13:52:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.198+0000 7f1f18056700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10157130 con 0x7f1f100b4370 2023-07-13T13:52:56.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.198+0000 7f1f18056700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f101f2760 con 0x7f1f10152ce0 2023-07-13T13:52:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.198+0000 7f1f15df2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f100b4370 0x7f1f101599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.199+0000 7f1f15df2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f100b4370 0x7f1f101599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48498/0 (socket says 172.21.15.118:48498) 2023-07-13T13:52:56.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.199+0000 7f1f15df2700 1 -- 172.21.15.118:0/3543524743 learned_addr learned my addr 172.21.15.118:0/3543524743 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.202+0000 7f1f15df2700 1 -- 172.21.15.118:0/3543524743 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f10152ce0 msgr2=0x7f1f10157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.202+0000 7f1f15df2700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f10152ce0 0x7f1f10157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.202+0000 7f1f15df2700 1 -- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f100c9210 msgr2=0x7f1f1014c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.202+0000 7f1f15df2700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f100c9210 0x7f1f1014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.175 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.202+0000 7f1f15df2700 1 -- 172.21.15.118:0/3543524743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c009550 con 0x7f1f100b4370 2023-07-13T13:52:56.176 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.205+0000 7f1f15df2700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f100b4370 0x7f1f101599e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00b0e0 tx=0x7f1f0c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:56.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.208+0000 7f1f067fc700 1 -- 172.21.15.118:0/3543524743 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c011630 con 0x7f1f100b4370 2023-07-13T13:52:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.209+0000 7f1f067fc700 1 -- 172.21.15.118:0/3543524743 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c011790 con 0x7f1f100b4370 2023-07-13T13:52:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.209+0000 7f1f067fc700 1 -- 172.21.15.118:0/3543524743 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c011b40 con 0x7f1f100b4370 2023-07-13T13:52:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.209+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f101f2200 con 0x7f1f100b4370 2023-07-13T13:52:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.209+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f101f2480 con 0x7f1f100b4370 2023-07-13T13:52:56.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.210+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1004e280 con 0x7f1f100b4370 2023-07-13T13:52:56.187 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.216+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0ff80c6f70 con 0x7f0ff8157cb0 2023-07-13T13:52:56.232 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.260+0000 7ff916ffd700 1 -- 172.21.15.118:0/2136904854 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff91c05c7d0 con 0x7ff92006b040 2023-07-13T13:52:56.244 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.273+0000 7ff916ffd700 1 -- 172.21.15.118:0/2136904854 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff91c054c00 con 0x7ff92006b040 2023-07-13T13:52:56.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.278+0000 7f0feffff700 1 -- 172.21.15.118:0/3010207146 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fe0015030 con 0x7f0ff8157cb0 2023-07-13T13:52:56.250 INFO:teuthology.orchestra.run.smithi118.stdout:64424509452 2023-07-13T13:52:56.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0fd806ace0 msgr2=0x7f0fd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0fd806ace0 0x7f0fd806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8000c00 tx=0x7f0fe8010000 comp rx=0 tx=0).stop 2023-07-13T13:52:56.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff8157cb0 msgr2=0x7f0ff80cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff8157cb0 0x7f0ff80cc4e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000b4a0 tx=0x7f0fe000b860 comp rx=0 tx=0).stop 2023-07-13T13:52:56.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 shutdown_connections 2023-07-13T13:52:56.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0fd806ace0 0x7f0fd806d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ff80afcd0 0x7f0ff80c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ff815a3e0 0x7f0ff80c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 --2- 172.21.15.118:0/3010207146 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ff8157cb0 0x7f0ff80cc4e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 >> 172.21.15.118:0/3010207146 conn(0x7f0ff806fa20 msgr2=0x7f0ff8158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 shutdown_connections 2023-07-13T13:52:56.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.280+0000 7f0ffde20700 1 -- 172.21.15.118:0/3010207146 wait complete. 2023-07-13T13:52:56.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.7 2023-07-13T13:52:56.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.347+0000 7fed38ff9700 1 -- 172.21.15.118:0/3207163236 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fed340549a0 con 0x7fed3c1ea080 2023-07-13T13:52:56.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.355+0000 7f689bfff700 1 --2- 172.21.15.118:0/116955717 >> v2:172.21.15.118:3300/0 conn(0x7f689c06b040 0x7f689c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:56.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.363+0000 7f689bfff700 1 -- 172.21.15.118:0/116955717 >> v1:172.21.15.123:6789/0 conn(0x7f689c06f040 legacy=0x7f689c15c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.363+0000 7f689bfff700 1 -- 172.21.15.118:0/116955717 >> v1:172.21.15.118:6789/0 conn(0x7f689c152410 legacy=0x7f689c15a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.363+0000 7f689bfff700 1 -- 172.21.15.118:0/116955717 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c1595c0 con 0x7f689c06b040 2023-07-13T13:52:56.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.373+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f761406bf10 con 0x7f7614156d20 2023-07-13T13:52:56.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.431+0000 7f689bfff700 1 --2- 172.21.15.118:0/116955717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c06b410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f688c009840 tx=0x7f688c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27747fd10515912f server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:56.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.441+0000 7fcf36ffd700 1 -- 172.21.15.118:0/1231191462 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf38059470 con 0x7fcf480afcd0 2023-07-13T13:52:56.413 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:56.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.444+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcf2806ace0 msgr2=0x7fcf2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.444+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcf2806ace0 0x7fcf2806d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf481e1c90 tx=0x7fcf3c006c80 comp rx=0 tx=0).stop 2023-07-13T13:52:56.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.444+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 msgr2=0x7fcf480c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.444+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 0x7fcf480c7ed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf38015000 tx=0x7fcf38004750 comp rx=0 tx=0).stop 2023-07-13T13:52:56.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.446+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 shutdown_connections 2023-07-13T13:52:56.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.446+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fcf2806ace0 0x7fcf2806d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.446+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf4815a3e0 0x7fcf480cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.446+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf480afcd0 0x7fcf480c7ed0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.446+0000 7fcf4ca5b700 1 --2- 172.21.15.118:0/1231191462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf480b1cf0 0x7fcf480cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.446+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 >> 172.21.15.118:0/1231191462 conn(0x7fcf4806fa20 msgr2=0x7fcf48159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.446+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 shutdown_connections 2023-07-13T13:52:56.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.446+0000 7fcf4ca5b700 1 -- 172.21.15.118:0/1231191462 wait complete. 2023-07-13T13:52:56.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.454+0000 7f689affd700 1 -- 172.21.15.118:0/116955717 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c011830 con 0x7f689c06b040 2023-07-13T13:52:56.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.454+0000 7f689affd700 1 -- 172.21.15.118:0/116955717 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c011990 con 0x7f689c06b040 2023-07-13T13:52:56.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.454+0000 7f689affd700 1 -- 172.21.15.118:0/116955717 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c011d20 con 0x7f689c06b040 2023-07-13T13:52:56.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.455+0000 7f68a2a0b700 1 -- 172.21.15.118:0/116955717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 msgr2=0x7f689c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.455+0000 7f68a2a0b700 1 --2- 172.21.15.118:0/116955717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c06b410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f688c009840 tx=0x7f688c009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:56.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.455+0000 7f68a2a0b700 1 -- 172.21.15.118:0/116955717 shutdown_connections 2023-07-13T13:52:56.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.455+0000 7f68a2a0b700 1 --2- 172.21.15.118:0/116955717 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c06b410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.455+0000 7f68a2a0b700 1 -- 172.21.15.118:0/116955717 >> 172.21.15.118:0/116955717 conn(0x7f689c06fa20 msgr2=0x7f689c06fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.455+0000 7f68a2a0b700 1 -- 172.21.15.118:0/116955717 shutdown_connections 2023-07-13T13:52:56.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.455+0000 7f68a2a0b700 1 -- 172.21.15.118:0/116955717 wait complete. 2023-07-13T13:52:56.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.457+0000 7f68a2a0b700 1 Processor -- start 2023-07-13T13:52:56.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.457+0000 7f68a2a0b700 1 -- start start 2023-07-13T13:52:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.458+0000 7f68a2a0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.458+0000 7f68a2a0b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689c06f040 0x7f689c1f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.458+0000 7f68a2a0b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689c152410 0x7f689c0c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.458+0000 7f68a2a0b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0c5b90 con 0x7f689c06b040 2023-07-13T13:52:56.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.458+0000 7f68a2a0b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0cbb80 con 0x7f689c152410 2023-07-13T13:52:56.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.458+0000 7f68a2a0b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0c78d0 con 0x7f689c06f040 2023-07-13T13:52:56.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.459+0000 7f689bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:56.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.459+0000 7f689bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43486/0 (socket says 172.21.15.118:43486) 2023-07-13T13:52:56.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.459+0000 7f689bfff700 1 -- 172.21.15.118:0/2494797093 learned_addr learned my addr 172.21.15.118:0/2494797093 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:56.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.4 2023-07-13T13:52:56.436 DEBUG:teuthology.parallel:result is None 2023-07-13T13:52:56.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.464+0000 7f689bfff700 1 -- 172.21.15.118:0/2494797093 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689c06f040 msgr2=0x7f689c1f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.464+0000 7f689bfff700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689c06f040 0x7f689c1f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.464+0000 7f689bfff700 1 -- 172.21.15.118:0/2494797093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689c152410 msgr2=0x7f689c0c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.464+0000 7f689bfff700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689c152410 0x7f689c0c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.464+0000 7f689bfff700 1 -- 172.21.15.118:0/2494797093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0094a0 con 0x7f689c06b040 2023-07-13T13:52:56.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.464+0000 7f1f067fc700 1 -- 172.21.15.118:0/3543524743 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f0c021070 con 0x7f1f100b4370 2023-07-13T13:52:56.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.465+0000 7f1f067fc700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ef406ace0 0x7f1ef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.465+0000 7f1f155f1700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ef406ace0 0x7f1ef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:56.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.465+0000 7f1f155f1700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ef406ace0 0x7f1ef406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1f100c41c0 tx=0x7f1f00007a20 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:56.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.467+0000 7f689bfff700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c14f750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f688c000c00 tx=0x7f688c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:56.441 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.470+0000 7f1f067fc700 1 -- 172.21.15.118:0/3543524743 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f0c02d3a0 con 0x7f1f100b4370 2023-07-13T13:52:56.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.470+0000 7f6898ff9700 1 -- 172.21.15.118:0/2494797093 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c0036a0 con 0x7f689c06b040 2023-07-13T13:52:56.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.470+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c0caab0 con 0x7f689c06b040 2023-07-13T13:52:56.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.470+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c0c5eb0 con 0x7f689c06b040 2023-07-13T13:52:56.442 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.471+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c0c5d10 con 0x7f689c06b040 2023-07-13T13:52:56.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.471+0000 7f6898ff9700 1 -- 172.21.15.118:0/2494797093 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c01e070 con 0x7f689c06b040 2023-07-13T13:52:56.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.471+0000 7f6898ff9700 1 -- 172.21.15.118:0/2494797093 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c003a00 con 0x7f689c06b040 2023-07-13T13:52:56.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.482+0000 7f1f067fc700 1 -- 172.21.15.118:0/3543524743 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f0c055fe0 con 0x7f1f100b4370 2023-07-13T13:52:56.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.483+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9200c4400 con 0x7ff92006b040 2023-07-13T13:52:56.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.523+0000 7ff916ffd700 1 -- 172.21.15.118:0/2136904854 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff91c015020 con 0x7ff92006b040 2023-07-13T13:52:56.495 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:56.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff90406ad10 msgr2=0x7ff90406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff90406ad10 0x7ff90406d1c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff920158420 tx=0x7ff910007a20 comp rx=0 tx=0).stop 2023-07-13T13:52:56.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92006b040 msgr2=0x7ff9200c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92006b040 0x7ff9200c9dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00b560 tx=0x7ff91c00b920 comp rx=0 tx=0).stop 2023-07-13T13:52:56.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 shutdown_connections 2023-07-13T13:52:56.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff90406ad10 0x7ff90406d1c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff92014f520 0x7ff9201f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff92006b040 0x7ff9200c9dc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 --2- 172.21.15.118:0/2136904854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9200c8340 0x7ff9201f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 >> 172.21.15.118:0/2136904854 conn(0x7ff9200cb880 msgr2=0x7ff9200c3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.526+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 shutdown_connections 2023-07-13T13:52:56.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.527+0000 7ff9286c1700 1 -- 172.21.15.118:0/2136904854 wait complete. 2023-07-13T13:52:56.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.2 2023-07-13T13:52:56.515 DEBUG:teuthology.parallel:result is None 2023-07-13T13:52:56.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.550+0000 7f75fbfff700 1 -- 172.21.15.118:0/3813338243 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f760c059100 con 0x7f7614156d20 2023-07-13T13:52:56.523 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:56.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f760006ad10 msgr2=0x7f760006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f760006ad10 0x7f760006d1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76040096d0 tx=0x7f7604006c30 comp rx=0 tx=0).stop 2023-07-13T13:52:56.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7614156d20 msgr2=0x7f761414e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7614156d20 0x7f761414e3e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f760c015040 tx=0x7f760c004ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 shutdown_connections 2023-07-13T13:52:56.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f760006ad10 0x7f760006d1c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7614156d20 0x7f761414e3e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f761406ad90 0x7f76140c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 --2- 172.21.15.118:0/3813338243 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f76140c7570 0x7f761415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 >> 172.21.15.118:0/3813338243 conn(0x7f7614070d40 msgr2=0x7f7614154500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 shutdown_connections 2023-07-13T13:52:56.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.554+0000 7f7619e39700 1 -- 172.21.15.118:0/3813338243 wait complete. 2023-07-13T13:52:56.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.565+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fed3c04e280 con 0x7fed3c1ea080 2023-07-13T13:52:56.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.6 2023-07-13T13:52:56.543 DEBUG:teuthology.parallel:result is None 2023-07-13T13:52:56.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.695+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1f1004e280 con 0x7f1f100b4370 2023-07-13T13:52:56.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.700+0000 7f1f067fc700 1 -- 172.21.15.118:0/3543524743 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f0c029020 con 0x7f1f100b4370 2023-07-13T13:52:56.672 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:56.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ef406ace0 msgr2=0x7f1ef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ef406ace0 0x7f1ef406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1f100c41c0 tx=0x7f1f00007a20 comp rx=0 tx=0).stop 2023-07-13T13:52:56.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f100b4370 msgr2=0x7f1f101599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f100b4370 0x7f1f101599e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00b0e0 tx=0x7f1f0c004750 comp rx=0 tx=0).stop 2023-07-13T13:52:56.674 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 shutdown_connections 2023-07-13T13:52:56.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ef406ace0 0x7f1ef406d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f100b4370 0x7f1f101599e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1f10152ce0 0x7f1f10157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 --2- 172.21.15.118:0/3543524743 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f100c9210 0x7f1f1014c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 >> 172.21.15.118:0/3543524743 conn(0x7f1f1006c7c0 msgr2=0x7f1f1006ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 shutdown_connections 2023-07-13T13:52:56.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.702+0000 7f1f18056700 1 -- 172.21.15.118:0/3543524743 wait complete. 2023-07-13T13:52:56.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.5 2023-07-13T13:52:56.686 DEBUG:teuthology.parallel:result is None 2023-07-13T13:52:56.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.749+0000 7f6898ff9700 1 -- 172.21.15.118:0/2494797093 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f688c003b60 con 0x7f689c06b040 2023-07-13T13:52:56.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.749+0000 7f6898ff9700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f688806ace0 0x7f688806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:56.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.749+0000 7f6898ff9700 1 -- 172.21.15.118:0/2494797093 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f688c08aab0 con 0x7f689c06b040 2023-07-13T13:52:56.722 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.749+0000 7f689b7fe700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f688806ace0 0x7f688806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:56.722 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.750+0000 7f689b7fe700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f688806ace0 0x7f688806d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f689c0c7d30 tx=0x7f6890007ad0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:56.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.775+0000 7f6898ff9700 1 -- 172.21.15.118:0/2494797093 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f688c0557f0 con 0x7f689c06b040 2023-07-13T13:52:56.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.785+0000 7fed38ff9700 1 -- 172.21.15.118:0/3207163236 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed34019090 con 0x7fed3c1ea080 2023-07-13T13:52:56.758 INFO:teuthology.orchestra.run.smithi118.stdout:60129542157 2023-07-13T13:52:56.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.788+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed2806ad30 msgr2=0x7fed2806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed2806ad30 0x7fed2806d1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fed2c004790 tx=0x7fed2c008040 comp rx=0 tx=0).stop 2023-07-13T13:52:56.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c1ea080 msgr2=0x7fed3c14b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c1ea080 0x7fed3c14b590 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0c8790 tx=0x7fed3400df40 comp rx=0 tx=0).stop 2023-07-13T13:52:56.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 shutdown_connections 2023-07-13T13:52:56.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fed2806ad30 0x7fed2806d1e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed3c1ea080 0x7fed3c14b590 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fed24004850 0x7fed3c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 --2- 172.21.15.118:0/3207163236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3c1e9c10 0x7fed3c155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 >> 172.21.15.118:0/3207163236 conn(0x7fed3c0cb880 msgr2=0x7fed3c0c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 shutdown_connections 2023-07-13T13:52:56.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.789+0000 7fed429bc700 1 -- 172.21.15.118:0/3207163236 wait complete. 2023-07-13T13:52:56.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.0 2023-07-13T13:52:56.774 DEBUG:teuthology.parallel:result is None 2023-07-13T13:52:56.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.991+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f689c0c5d10 con 0x7f689c06b040 2023-07-13T13:52:56.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.995+0000 7f6898ff9700 1 -- 172.21.15.118:0/2494797093 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f689c0c5d10 con 0x7f689c06b040 2023-07-13T13:52:56.967 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:56.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f688806ace0 msgr2=0x7f688806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f688806ace0 0x7f688806d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f689c0c7d30 tx=0x7f6890007ad0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 msgr2=0x7f689c14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c14f750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f688c000c00 tx=0x7f688c004750 comp rx=0 tx=0).stop 2023-07-13T13:52:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 shutdown_connections 2023-07-13T13:52:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f688806ace0 0x7f688806d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f689c152410 0x7f689c0c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f689c06b040 0x7f689c14f750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 --2- 172.21.15.118:0/2494797093 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f689c06f040 0x7f689c1f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:56.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 >> 172.21.15.118:0/2494797093 conn(0x7f689c06fa20 msgr2=0x7f689c15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:56.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 shutdown_connections 2023-07-13T13:52:56.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:56.998+0000 7f68a2a0b700 1 -- 172.21.15.118:0/2494797093 wait complete. 2023-07-13T13:52:56.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.3 2023-07-13T13:52:56.982 DEBUG:teuthology.parallel:result is None 2023-07-13T13:52:57.169 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-13T13:52:57.269 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-13T13:52:57.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.322+0000 7feaf6a41700 1 Processor -- start 2023-07-13T13:52:57.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.322+0000 7feaf6a41700 1 -- start start 2023-07-13T13:52:57.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.323+0000 7feaf6a41700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf0152850 0x7feaf006f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.323+0000 7feaf6a41700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feaf00c5d90 0x7feaf01590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.323+0000 7feaf6a41700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf00c6c60 con 0x7feaf006eaa0 2023-07-13T13:52:57.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.323+0000 7feaf6a41700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00c66a0 con 0x7feaf00c5d90 2023-07-13T13:52:57.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.323+0000 7feaf6a41700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00c6980 con 0x7feaf0152850 2023-07-13T13:52:57.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.324+0000 7feaeffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf0152850 0x7feaf006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.324+0000 7feaef7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feaf00c5d90 0x7feaf01590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.324+0000 7feaf4fde700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7feaf006eaa0 0x7feaf00c7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:42994/0 (socket says 172.21.15.118:42994) 2023-07-13T13:52:57.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.324+0000 7feaf4fde700 1 -- 172.21.15.118:0/580550162 learned_addr learned my addr 172.21.15.118:0/580550162 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:57.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.327+0000 7feaeeffd700 1 -- 172.21.15.118:0/580550162 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904927482 0 0) 0x7feaf00c6c60 con 0x7feaf006eaa0 2023-07-13T13:52:57.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.327+0000 7feaeeffd700 1 -- 172.21.15.118:0/580550162 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead80035b0 con 0x7feaf006eaa0 2023-07-13T13:52:57.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.327+0000 7feaeffff700 1 -- 172.21.15.118:0/580550162 >> v2:172.21.15.118:3300/0 conn(0x7feaf00c5d90 msgr2=0x7feaf01590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:57.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.327+0000 7feaeffff700 1 --2- 172.21.15.118:0/580550162 >> v2:172.21.15.118:3300/0 conn(0x7feaf00c5d90 0x7feaf01590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.327+0000 7feaeffff700 1 -- 172.21.15.118:0/580550162 >> v1:172.21.15.123:6789/0 conn(0x7feaf006eaa0 legacy=0x7feaf00c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.327+0000 7feaeffff700 1 -- 172.21.15.118:0/580550162 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf006e2a0 con 0x7feaf0152850 2023-07-13T13:52:57.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.329+0000 7feaeffff700 1 --2- 172.21.15.118:0/580550162 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf0152850 0x7feaf006f380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feae0009840 tx=0x7feae0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=705d5dcbc1fe3c79 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:57.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.333+0000 7feaeeffd700 1 -- 172.21.15.118:0/580550162 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0011830 con 0x7feaf0152850 2023-07-13T13:52:57.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.333+0000 7feaeeffd700 1 -- 172.21.15.118:0/580550162 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae0011990 con 0x7feaf0152850 2023-07-13T13:52:57.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.333+0000 7feaeeffd700 1 -- 172.21.15.118:0/580550162 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0011d20 con 0x7feaf0152850 2023-07-13T13:52:57.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.334+0000 7feaf6a41700 1 -- 172.21.15.118:0/580550162 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf0152850 msgr2=0x7feaf006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.334+0000 7feaf6a41700 1 --2- 172.21.15.118:0/580550162 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf0152850 0x7feaf006f380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feae0009840 tx=0x7feae0009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:57.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.334+0000 7feaf6a41700 1 -- 172.21.15.118:0/580550162 shutdown_connections 2023-07-13T13:52:57.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.334+0000 7feaf6a41700 1 --2- 172.21.15.118:0/580550162 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf0152850 0x7feaf006f380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.334+0000 7feaf6a41700 1 --2- 172.21.15.118:0/580550162 >> v2:172.21.15.118:3300/0 conn(0x7feaf00c5d90 0x7feaf01590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.334+0000 7feaf6a41700 1 -- 172.21.15.118:0/580550162 >> 172.21.15.118:0/580550162 conn(0x7feaf0070d40 msgr2=0x7feaf0071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:57.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.334+0000 7feaf6a41700 1 -- 172.21.15.118:0/580550162 shutdown_connections 2023-07-13T13:52:57.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.334+0000 7feaf6a41700 1 -- 172.21.15.118:0/580550162 wait complete. 2023-07-13T13:52:57.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.335+0000 7feaf6a41700 1 Processor -- start 2023-07-13T13:52:57.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.335+0000 7feaf6a41700 1 -- start start 2023-07-13T13:52:57.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.336+0000 7feaf6a41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf006eaa0 0x7feaf014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.336+0000 7feaf6a41700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf00c5d90 0x7feaf014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.336+0000 7feaf6a41700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf0152850 0x7feaf0144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.336+0000 7feaf6a41700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0144a90 con 0x7feaf006eaa0 2023-07-13T13:52:57.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.336+0000 7feaf6a41700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf01f1ae0 con 0x7feaf0152850 2023-07-13T13:52:57.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.336+0000 7feaf6a41700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf01edf20 con 0x7feaf00c5d90 2023-07-13T13:52:57.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.336+0000 7feaf4fde700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf0152850 0x7feaf0144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.337+0000 7feaef7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf00c5d90 0x7feaf014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.337+0000 7feaeffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf006eaa0 0x7feaf014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.337+0000 7feaef7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf00c5d90 0x7feaf014d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34788/0 (socket says 172.21.15.118:34788) 2023-07-13T13:52:57.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.337+0000 7feaef7fe700 1 -- 172.21.15.118:0/4025047721 learned_addr learned my addr 172.21.15.118:0/4025047721 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:57.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.341+0000 7feaf4fde700 1 -- 172.21.15.118:0/4025047721 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf00c5d90 msgr2=0x7feaf014d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.341+0000 7feaf4fde700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf00c5d90 0x7feaf014d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.341+0000 7feaf4fde700 1 -- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf006eaa0 msgr2=0x7feaf014dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.341+0000 7feaf4fde700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf006eaa0 0x7feaf014dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.341+0000 7feaf4fde700 1 -- 172.21.15.118:0/4025047721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00094a0 con 0x7feaf0152850 2023-07-13T13:52:57.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.341+0000 7feaef7fe700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf00c5d90 0x7feaf014d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:57.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.343+0000 7feaf4fde700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf0152850 0x7feaf0144550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feae800caa0 tx=0x7feae800cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:57.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.346+0000 7feaecff9700 1 -- 172.21.15.118:0/4025047721 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800a940 con 0x7feaf0152850 2023-07-13T13:52:57.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.346+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf01f1ff0 con 0x7feaf0152850 2023-07-13T13:52:57.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.346+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf014c090 con 0x7feaf0152850 2023-07-13T13:52:57.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.347+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf01ee090 con 0x7feaf0152850 2023-07-13T13:52:57.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.424+0000 7feeb141d700 1 Processor -- start 2023-07-13T13:52:57.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.424+0000 7feeb141d700 1 -- start start 2023-07-13T13:52:57.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.424+0000 7feeb141d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feeac152980 0x7feeac0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.424+0000 7feeb141d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feeac0c9e30 0x7feeac0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.424+0000 7feeb141d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac0c54f0 0x7feeac15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.424+0000 7feeb141d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac0c9140 con 0x7feeac0c9e30 2023-07-13T13:52:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.424+0000 7feeb141d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac06b570 con 0x7feeac152980 2023-07-13T13:52:57.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.424+0000 7feeb141d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac06b810 con 0x7feeac0c54f0 2023-07-13T13:52:57.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.425+0000 7feeab7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac0c54f0 0x7feeac15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.425+0000 7feeaa7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feeac0c9e30 0x7feeac0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.425+0000 7feeab7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac0c54f0 0x7feeac15baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34800/0 (socket says 172.21.15.118:34800) 2023-07-13T13:52:57.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.426+0000 7feeab7fe700 1 -- 172.21.15.118:0/3250225464 learned_addr learned my addr 172.21.15.118:0/3250225464 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:57.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.428+0000 7feeaa7fc700 1 -- 172.21.15.118:0/3250225464 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac0c54f0 msgr2=0x7feeac15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:57.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.428+0000 7feeaa7fc700 1 --2- 172.21.15.118:0/3250225464 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac0c54f0 0x7feeac15baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.428+0000 7feeaa7fc700 1 -- 172.21.15.118:0/3250225464 >> v2:172.21.15.123:3300/0 conn(0x7feeac152980 msgr2=0x7feeac0c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:57.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.428+0000 7feeaa7fc700 1 --2- 172.21.15.118:0/3250225464 >> v2:172.21.15.123:3300/0 conn(0x7feeac152980 0x7feeac0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.428+0000 7feeaa7fc700 1 -- 172.21.15.118:0/3250225464 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac06baf0 con 0x7feeac0c9e30 2023-07-13T13:52:57.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.428+0000 7feeab7fe700 1 --2- 172.21.15.118:0/3250225464 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac0c54f0 0x7feeac15baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:52:57.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.430+0000 7feeaa7fc700 1 --2- 172.21.15.118:0/3250225464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 0x7feeac0c3b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feeac06b020 tx=0x7fee9c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e477adcb489b021 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:57.409 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.438+0000 7feea9ffb700 1 -- 172.21.15.118:0/3250225464 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c011830 con 0x7feeac0c9e30 2023-07-13T13:52:57.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.438+0000 7feea9ffb700 1 -- 172.21.15.118:0/3250225464 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c011990 con 0x7feeac0c9e30 2023-07-13T13:52:57.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.438+0000 7feea9ffb700 1 -- 172.21.15.118:0/3250225464 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c011d20 con 0x7feeac0c9e30 2023-07-13T13:52:57.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.438+0000 7feeb141d700 1 -- 172.21.15.118:0/3250225464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 msgr2=0x7feeac0c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.438+0000 7feeb141d700 1 --2- 172.21.15.118:0/3250225464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 0x7feeac0c3b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feeac06b020 tx=0x7fee9c009b20 comp rx=0 tx=0).stop 2023-07-13T13:52:57.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.439+0000 7feeb141d700 1 -- 172.21.15.118:0/3250225464 shutdown_connections 2023-07-13T13:52:57.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.439+0000 7feeb141d700 1 --2- 172.21.15.118:0/3250225464 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac0c54f0 0x7feeac15baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.439+0000 7feeb141d700 1 --2- 172.21.15.118:0/3250225464 >> v2:172.21.15.123:3300/0 conn(0x7feeac152980 0x7feeac0c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.439+0000 7feeb141d700 1 --2- 172.21.15.118:0/3250225464 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 0x7feeac0c3b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.439+0000 7feeb141d700 1 -- 172.21.15.118:0/3250225464 >> 172.21.15.118:0/3250225464 conn(0x7feeac06c730 msgr2=0x7feeac06cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:57.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.439+0000 7feeb141d700 1 -- 172.21.15.118:0/3250225464 shutdown_connections 2023-07-13T13:52:57.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.439+0000 7feeb141d700 1 -- 172.21.15.118:0/3250225464 wait complete. 2023-07-13T13:52:57.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.440+0000 7feeb141d700 1 Processor -- start 2023-07-13T13:52:57.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.440+0000 7feeb141d700 1 -- start start 2023-07-13T13:52:57.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.441+0000 7feeb141d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeac0c54f0 0x7feeac15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.441+0000 7feeb141d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 0x7feeac1edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.441+0000 7feeb141d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac152980 0x7feeac14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.441+0000 7feeb141d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac1539a0 con 0x7feeac0c9e30 2023-07-13T13:52:57.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.441+0000 7feeb141d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac1ed770 con 0x7feeac0c54f0 2023-07-13T13:52:57.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.441+0000 7feeb141d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac151750 con 0x7feeac152980 2023-07-13T13:52:57.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.441+0000 7feeaa7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 0x7feeac1edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.441+0000 7feeab7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac152980 0x7feeac14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.442+0000 7feeaa7fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 0x7feeac1edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43510/0 (socket says 172.21.15.118:43510) 2023-07-13T13:52:57.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.442+0000 7feeaa7fc700 1 -- 172.21.15.118:0/3576430871 learned_addr learned my addr 172.21.15.118:0/3576430871 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:57.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.445+0000 7feeab7fe700 1 -- 172.21.15.118:0/3576430871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeac0c54f0 msgr2=0x7feeac15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.445+0000 7feeab7fe700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeac0c54f0 0x7feeac15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.445+0000 7feeab7fe700 1 -- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 msgr2=0x7feeac1edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.445+0000 7feeab7fe700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 0x7feeac1edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.445+0000 7feeab7fe700 1 -- 172.21.15.118:0/3576430871 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4009b30 con 0x7feeac152980 2023-07-13T13:52:57.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.448+0000 7feeab7fe700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac152980 0x7feeac14df50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feea400efc0 tx=0x7feea400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.452+0000 7fee937fe700 1 -- 172.21.15.118:0/3576430871 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4018070 con 0x7feeac152980 2023-07-13T13:52:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.452+0000 7fee937fe700 1 -- 172.21.15.118:0/3576430871 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400f040 con 0x7feeac152980 2023-07-13T13:52:57.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.452+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c0094a0 con 0x7feeac152980 2023-07-13T13:52:57.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.452+0000 7fee937fe700 1 -- 172.21.15.118:0/3576430871 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4003c60 con 0x7feeac152980 2023-07-13T13:52:57.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.452+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac1f14b0 con 0x7feeac152980 2023-07-13T13:52:57.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.453+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac06bf20 con 0x7feeac152980 2023-07-13T13:52:57.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.458+0000 7feaecff9700 1 -- 172.21.15.118:0/4025047721 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800aaa0 con 0x7feaf0152850 2023-07-13T13:52:57.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.458+0000 7feaecff9700 1 -- 172.21.15.118:0/4025047721 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800ae10 con 0x7feaf0152850 2023-07-13T13:52:57.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.459+0000 7feaecff9700 1 -- 172.21.15.118:0/4025047721 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feae8012400 con 0x7feaf0152850 2023-07-13T13:52:57.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.459+0000 7feaecff9700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feadc06ad10 0x7feadc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.459+0000 7feaeffff700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feadc06ad10 0x7feadc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.459+0000 7feaeffff700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feadc06ad10 0x7feadc06d1c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feae0000c00 tx=0x7feae001c040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:57.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.524+0000 7fee937fe700 1 -- 172.21.15.118:0/3576430871 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feea400c930 con 0x7feeac152980 2023-07-13T13:52:57.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.525+0000 7fee937fe700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fee9806ad30 0x7fee9806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:57.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.525+0000 7feeaaffd700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fee9806ad30 0x7fee9806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:57.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.525+0000 7feeaaffd700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fee9806ad30 0x7fee9806d1e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feea0009710 tx=0x7feea0006c80 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:57.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.609+0000 7feaecff9700 1 -- 172.21.15.118:0/4025047721 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feae8058590 con 0x7feaf0152850 2023-07-13T13:52:57.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.611+0000 7fee937fe700 1 -- 172.21.15.118:0/3576430871 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feea405d1b0 con 0x7feeac152980 2023-07-13T13:52:57.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.620+0000 7feaecff9700 1 -- 172.21.15.118:0/4025047721 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feae80548d0 con 0x7feaf0152850 2023-07-13T13:52:57.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.731+0000 7fee937fe700 1 -- 172.21.15.118:0/3576430871 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feea4055530 con 0x7feeac152980 2023-07-13T13:52:57.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.842+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feaf004e280 con 0x7feaf0152850 2023-07-13T13:52:57.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.877+0000 7feaecff9700 1 -- 172.21.15.118:0/4025047721 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feae8017020 con 0x7feaf0152850 2023-07-13T13:52:57.849 INFO:teuthology.orchestra.run.smithi118.stdout:55834574861 2023-07-13T13:52:57.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.879+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feadc06ad10 msgr2=0x7feadc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.879+0000 7feaf6a41700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feadc06ad10 0x7feadc06d1c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feae0000c00 tx=0x7feae001c040 comp rx=0 tx=0).stop 2023-07-13T13:52:57.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.879+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf0152850 msgr2=0x7feaf0144550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.879+0000 7feaf6a41700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf0152850 0x7feaf0144550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feae800caa0 tx=0x7feae800cdb0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.880+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 shutdown_connections 2023-07-13T13:52:57.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.880+0000 7feaf6a41700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feadc06ad10 0x7feadc06d1c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.880+0000 7feaf6a41700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf0152850 0x7feaf0144550 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.880+0000 7feaf6a41700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feaf006eaa0 0x7feaf014dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.880+0000 7feaf6a41700 1 --2- 172.21.15.118:0/4025047721 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feaf00c5d90 0x7feaf014d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.880+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 >> 172.21.15.118:0/4025047721 conn(0x7feaf0070d40 msgr2=0x7feaf00c3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:57.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.880+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 shutdown_connections 2023-07-13T13:52:57.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.880+0000 7feaf6a41700 1 -- 172.21.15.118:0/4025047721 wait complete. 2023-07-13T13:52:57.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.1 2023-07-13T13:52:57.869 DEBUG:teuthology.parallel:result is None 2023-07-13T13:52:57.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.990+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feeac1501c0 con 0x7feeac152980 2023-07-13T13:52:57.966 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.994+0000 7fee937fe700 1 -- 172.21.15.118:0/3576430871 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feea4025390 con 0x7feeac152980 2023-07-13T13:52:57.966 INFO:teuthology.orchestra.run.smithi118.stdout:64424509453 2023-07-13T13:52:57.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.996+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fee9806ad30 msgr2=0x7fee9806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.996+0000 7feeb141d700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fee9806ad30 0x7fee9806d1e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feea0009710 tx=0x7feea0006c80 comp rx=0 tx=0).stop 2023-07-13T13:52:57.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.996+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac152980 msgr2=0x7feeac14df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:57.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.996+0000 7feeb141d700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac152980 0x7feeac14df50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feea400efc0 tx=0x7feea400c3a0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.997+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 shutdown_connections 2023-07-13T13:52:57.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.997+0000 7feeb141d700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fee9806ad30 0x7fee9806d1e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.997+0000 7feeb141d700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feeac0c54f0 0x7feeac15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.997+0000 7feeb141d700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feeac152980 0x7feeac14df50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.997+0000 7feeb141d700 1 --2- 172.21.15.118:0/3576430871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feeac0c9e30 0x7feeac1edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:57.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.997+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 >> 172.21.15.118:0/3576430871 conn(0x7feeac06c730 msgr2=0x7feeac159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:57.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.997+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 shutdown_connections 2023-07-13T13:52:57.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:57.997+0000 7feeb141d700 1 -- 172.21.15.118:0/3576430871 wait complete. 2023-07-13T13:52:57.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.7 2023-07-13T13:52:57.981 DEBUG:teuthology.parallel:result is None 2023-07-13T13:52:57.981 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-13T13:52:57.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T13:52:58.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.135+0000 7f3e14aca700 1 Processor -- start 2023-07-13T13:52:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.135+0000 7f3e14aca700 1 -- start start 2023-07-13T13:52:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.136+0000 7f3e14aca700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e100c99c0 0x7f3e100c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.136+0000 7f3e14aca700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e100c9d90 0x7f3e100c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.136+0000 7f3e14aca700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100ca910 con 0x7f3e10158390 2023-07-13T13:52:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.136+0000 7f3e14aca700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e100c9600 con 0x7f3e100c9d90 2023-07-13T13:52:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.136+0000 7f3e14aca700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1006c080 con 0x7f3e100c99c0 2023-07-13T13:52:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.137+0000 7f3e0dd9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e100c9d90 0x7f3e100c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.137+0000 7f3e0e59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e100c99c0 0x7f3e100c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.138+0000 7f3e0dd9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e100c9d90 0x7f3e100c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43512/0 (socket says 172.21.15.118:43512) 2023-07-13T13:52:58.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.138+0000 7f3e0dd9b700 1 -- 172.21.15.118:0/497707081 learned_addr learned my addr 172.21.15.118:0/497707081 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.141+0000 7f3e0dd9b700 1 -- 172.21.15.118:0/497707081 >> v2:172.21.15.123:3300/0 conn(0x7f3e100c99c0 msgr2=0x7f3e100c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.141+0000 7f3e0dd9b700 1 --2- 172.21.15.118:0/497707081 >> v2:172.21.15.123:3300/0 conn(0x7f3e100c99c0 0x7f3e100c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.141+0000 7f3e0dd9b700 1 -- 172.21.15.118:0/497707081 >> v1:172.21.15.123:6789/0 conn(0x7f3e10158390 legacy=0x7f3e100cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.141+0000 7f3e0dd9b700 1 -- 172.21.15.118:0/497707081 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e100cec80 con 0x7f3e100c9d90 2023-07-13T13:52:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.143+0000 7f3e0dd9b700 1 --2- 172.21.15.118:0/497707081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 0x7f3e100c8430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e100cb0b0 tx=0x7f3e0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e0d5394c1d78f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.147+0000 7f3e0d59a700 1 -- 172.21.15.118:0/497707081 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0400e070 con 0x7f3e100c9d90 2023-07-13T13:52:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.147+0000 7f3e0d59a700 1 -- 172.21.15.118:0/497707081 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0400b910 con 0x7f3e100c9d90 2023-07-13T13:52:58.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.147+0000 7f3e0d59a700 1 -- 172.21.15.118:0/497707081 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0400bcc0 con 0x7f3e100c9d90 2023-07-13T13:52:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.148+0000 7f3e14aca700 1 -- 172.21.15.118:0/497707081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 msgr2=0x7f3e100c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.148+0000 7f3e14aca700 1 --2- 172.21.15.118:0/497707081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 0x7f3e100c8430 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e100cb0b0 tx=0x7f3e0400b330 comp rx=0 tx=0).stop 2023-07-13T13:52:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.148+0000 7f3e14aca700 1 -- 172.21.15.118:0/497707081 shutdown_connections 2023-07-13T13:52:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.148+0000 7f3e14aca700 1 --2- 172.21.15.118:0/497707081 >> v2:172.21.15.123:3300/0 conn(0x7f3e100c99c0 0x7f3e100c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.148+0000 7f3e14aca700 1 --2- 172.21.15.118:0/497707081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 0x7f3e100c8430 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.148+0000 7f3e14aca700 1 -- 172.21.15.118:0/497707081 >> 172.21.15.118:0/497707081 conn(0x7f3e1006c750 msgr2=0x7f3e1006cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.148+0000 7f3e14aca700 1 -- 172.21.15.118:0/497707081 shutdown_connections 2023-07-13T13:52:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.148+0000 7f3e14aca700 1 -- 172.21.15.118:0/497707081 wait complete. 2023-07-13T13:52:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.149+0000 7f3e14aca700 1 Processor -- start 2023-07-13T13:52:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.149+0000 7f3e14aca700 1 -- start start 2023-07-13T13:52:58.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.150+0000 7f3e14aca700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e100c99c0 0x7f3e10157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.150+0000 7f3e14aca700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 0x7f3e10151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.150+0000 7f3e14aca700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e10158390 0x7f3e10150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.150+0000 7f3e14aca700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101ee270 con 0x7f3e100c9d90 2023-07-13T13:52:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.150+0000 7f3e14aca700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101ee550 con 0x7f3e10158390 2023-07-13T13:52:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.150+0000 7f3e14aca700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e101ee830 con 0x7f3e100c99c0 2023-07-13T13:52:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.150+0000 7f3e0dd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 0x7f3e10151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.151+0000 7f3e0ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e10158390 0x7f3e10150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.151+0000 7f3e0e59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e100c99c0 0x7f3e10157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.151+0000 7f3e0dd9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 0x7f3e10151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43528/0 (socket says 172.21.15.118:43528) 2023-07-13T13:52:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.151+0000 7f3e0dd9b700 1 -- 172.21.15.118:0/270805030 learned_addr learned my addr 172.21.15.118:0/270805030 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:58.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.155+0000 7f3e0ed9d700 1 -- 172.21.15.118:0/270805030 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e100c99c0 msgr2=0x7f3e10157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.155+0000 7f3e0ed9d700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e100c99c0 0x7f3e10157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.155+0000 7f3e0ed9d700 1 -- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 msgr2=0x7f3e10151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.155+0000 7f3e0ed9d700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 0x7f3e10151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.155+0000 7f3e0ed9d700 1 -- 172.21.15.118:0/270805030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04009b30 con 0x7f3e10158390 2023-07-13T13:52:58.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.157+0000 7f3e0ed9d700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e10158390 0x7f3e10150010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000f60 tx=0x7f3e0000c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.161+0000 7f3dfeffd700 1 -- 172.21.15.118:0/270805030 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000052d0 con 0x7f3e10158390 2023-07-13T13:52:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.161+0000 7f3dfeffd700 1 -- 172.21.15.118:0/270805030 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e00005430 con 0x7f3e10158390 2023-07-13T13:52:58.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.161+0000 7f3dfeffd700 1 -- 172.21.15.118:0/270805030 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000038c0 con 0x7f3e10158390 2023-07-13T13:52:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.161+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e101eeb10 con 0x7f3e10158390 2023-07-13T13:52:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.162+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1015abf0 con 0x7f3e10158390 2023-07-13T13:52:58.134 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.162+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e100cc000 con 0x7f3e10158390 2023-07-13T13:52:58.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.182+0000 7f3dfeffd700 1 -- 172.21.15.118:0/270805030 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e00003a20 con 0x7f3e10158390 2023-07-13T13:52:58.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.182+0000 7f3dfeffd700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3df006ad30 0x7f3df006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.182+0000 7f3e0e59c700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3df006ad30 0x7f3df006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.183+0000 7f3e0e59c700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3df006ad30 0x7f3df006d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009be0 tx=0x7f3e08009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:58.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.186+0000 7f3dfeffd700 1 -- 172.21.15.118:0/270805030 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3e0005b830 con 0x7f3e10158390 2023-07-13T13:52:58.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.421+0000 7f3dfeffd700 1 -- 172.21.15.118:0/270805030 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e00053bb0 con 0x7f3e10158390 2023-07-13T13:52:58.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.636+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e100cf240 con 0x7f3df006ad30 2023-07-13T13:52:58.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.646+0000 7f3dfeffd700 1 -- 172.21.15.118:0/270805030 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370761 (secure 0 0 0) 0x7f3e08011860 con 0x7f3df006ad30 2023-07-13T13:52:58.621 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:58.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3df006ad30 msgr2=0x7f3df006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3df006ad30 0x7f3df006d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009be0 tx=0x7f3e08009210 comp rx=0 tx=0).stop 2023-07-13T13:52:58.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e10158390 msgr2=0x7f3e10150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e10158390 0x7f3e10150010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000f60 tx=0x7f3e0000c670 comp rx=0 tx=0).stop 2023-07-13T13:52:58.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 shutdown_connections 2023-07-13T13:52:58.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f3df006ad30 0x7f3df006d1e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e10158390 0x7f3e10150010 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e100c99c0 0x7f3e10157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 --2- 172.21.15.118:0/270805030 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e100c9d90 0x7f3e10151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 >> 172.21.15.118:0/270805030 conn(0x7f3e1006c750 msgr2=0x7f3e100cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:58.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 shutdown_connections 2023-07-13T13:52:58.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.650+0000 7f3e14aca700 1 -- 172.21.15.118:0/270805030 wait complete. 2023-07-13T13:52:58.625 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T13:52:58.633 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-07-13T13:52:58.025043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218748,"kb_used_data":2592,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755972,"statfs":{"total":773094113280,"available":772870115328,"internally_reserved":0,"allocated":2654208,"data_stored":2212488,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.099793"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.812490+0000","last_change":"2023-07-13T13:52:17.926057+0000","last_active":"2023-07-13T13:52:56.812490+0000","last_peered":"2023-07-13T13:52:56.812490+0000","last_clean":"2023-07-13T13:52:56.812490+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T13:52:56.812490+0000","last_undegraded":"2023-07-13T13:52:56.812490+0000","last_fullsized":"2023-07-13T13:52:56.812490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:15:51.471433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832308+0000","last_change":"2023-07-13T13:52:17.952706+0000","last_active":"2023-07-13T13:52:56.832308+0000","last_peered":"2023-07-13T13:52:56.832308+0000","last_clean":"2023-07-13T13:52:56.832308+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T13:52:56.832308+0000","last_undegraded":"2023-07-13T13:52:56.832308+0000","last_fullsized":"2023-07-13T13:52:56.832308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:27.813368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928336+0000","last_change":"2023-07-13T13:52:17.943505+0000","last_active":"2023-07-13T13:52:24.928336+0000","last_peered":"2023-07-13T13:52:24.928336+0000","last_clean":"2023-07-13T13:52:24.928336+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T13:52:24.928336+0000","last_undegraded":"2023-07-13T13:52:24.928336+0000","last_fullsized":"2023-07-13T13:52:24.928336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:42.655686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927626+0000","last_change":"2023-07-13T13:52:17.933893+0000","last_active":"2023-07-13T13:52:24.927626+0000","last_peered":"2023-07-13T13:52:24.927626+0000","last_clean":"2023-07-13T13:52:24.927626+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T13:52:24.927626+0000","last_undegraded":"2023-07-13T13:52:24.927626+0000","last_fullsized":"2023-07-13T13:52:24.927626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:13:20.456240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927809+0000","last_change":"2023-07-13T13:52:17.886730+0000","last_active":"2023-07-13T13:52:24.927809+0000","last_peered":"2023-07-13T13:52:24.927809+0000","last_clean":"2023-07-13T13:52:24.927809+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T13:52:24.927809+0000","last_undegraded":"2023-07-13T13:52:24.927809+0000","last_fullsized":"2023-07-13T13:52:24.927809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:35:09.042667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927978+0000","last_change":"2023-07-13T13:52:17.942599+0000","last_active":"2023-07-13T13:52:24.927978+0000","last_peered":"2023-07-13T13:52:24.927978+0000","last_clean":"2023-07-13T13:52:24.927978+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T13:52:24.927978+0000","last_undegraded":"2023-07-13T13:52:24.927978+0000","last_fullsized":"2023-07-13T13:52:24.927978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:32.256216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824386+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T13:52:56.824386+0000","last_peered":"2023-07-13T13:52:56.824386+0000","last_clean":"2023-07-13T13:52:56.824386+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T13:52:56.824386+0000","last_undegraded":"2023-07-13T13:52:56.824386+0000","last_fullsized":"2023-07-13T13:52:56.824386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:26.344890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.831801+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T13:52:56.831801+0000","last_peered":"2023-07-13T13:52:56.831801+0000","last_clean":"2023-07-13T13:52:56.831801+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T13:52:56.831801+0000","last_undegraded":"2023-07-13T13:52:56.831801+0000","last_fullsized":"2023-07-13T13:52:56.831801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:54:00.921870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927391+0000","last_change":"2023-07-13T13:52:17.887431+0000","last_active":"2023-07-13T13:52:24.927391+0000","last_peered":"2023-07-13T13:52:24.927391+0000","last_clean":"2023-07-13T13:52:24.927391+0000","last_became_active":"2023-07-13T13:52:17.887217+0000","last_became_peered":"2023-07-13T13:52:17.887217+0000","last_unstale":"2023-07-13T13:52:24.927391+0000","last_undegraded":"2023-07-13T13:52:24.927391+0000","last_fullsized":"2023-07-13T13:52:24.927391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:42:21.528797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832692+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T13:52:56.832692+0000","last_peered":"2023-07-13T13:52:56.832692+0000","last_clean":"2023-07-13T13:52:56.832692+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T13:52:56.832692+0000","last_undegraded":"2023-07-13T13:52:56.832692+0000","last_fullsized":"2023-07-13T13:52:56.832692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:07:44.633939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928606+0000","last_change":"2023-07-13T13:52:17.951567+0000","last_active":"2023-07-13T13:52:24.928606+0000","last_peered":"2023-07-13T13:52:24.928606+0000","last_clean":"2023-07-13T13:52:24.928606+0000","last_became_active":"2023-07-13T13:52:17.951313+0000","last_became_peered":"2023-07-13T13:52:17.951313+0000","last_unstale":"2023-07-13T13:52:24.928606+0000","last_undegraded":"2023-07-13T13:52:24.928606+0000","last_fullsized":"2023-07-13T13:52:24.928606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:38:28.382470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811100+0000","last_change":"2023-07-13T13:52:17.943253+0000","last_active":"2023-07-13T13:52:56.811100+0000","last_peered":"2023-07-13T13:52:56.811100+0000","last_clean":"2023-07-13T13:52:56.811100+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T13:52:56.811100+0000","last_undegraded":"2023-07-13T13:52:56.811100+0000","last_fullsized":"2023-07-13T13:52:56.811100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:47:54.607847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.810807+0000","last_change":"2023-07-13T13:52:17.925230+0000","last_active":"2023-07-13T13:52:56.810807+0000","last_peered":"2023-07-13T13:52:56.810807+0000","last_clean":"2023-07-13T13:52:56.810807+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T13:52:56.810807+0000","last_undegraded":"2023-07-13T13:52:56.810807+0000","last_fullsized":"2023-07-13T13:52:56.810807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:44:42.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.831969+0000","last_change":"2023-07-13T13:52:17.925445+0000","last_active":"2023-07-13T13:52:56.831969+0000","last_peered":"2023-07-13T13:52:56.831969+0000","last_clean":"2023-07-13T13:52:56.831969+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T13:52:56.831969+0000","last_undegraded":"2023-07-13T13:52:56.831969+0000","last_fullsized":"2023-07-13T13:52:56.831969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:10:58.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824291+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T13:52:56.824291+0000","last_peered":"2023-07-13T13:52:56.824291+0000","last_clean":"2023-07-13T13:52:56.824291+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T13:52:56.824291+0000","last_undegraded":"2023-07-13T13:52:56.824291+0000","last_fullsized":"2023-07-13T13:52:56.824291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:27:45.905189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927178+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T13:52:24.927178+0000","last_peered":"2023-07-13T13:52:24.927178+0000","last_clean":"2023-07-13T13:52:24.927178+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T13:52:24.927178+0000","last_undegraded":"2023-07-13T13:52:24.927178+0000","last_fullsized":"2023-07-13T13:52:24.927178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:44:32.655763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927416+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T13:52:24.927416+0000","last_peered":"2023-07-13T13:52:24.927416+0000","last_clean":"2023-07-13T13:52:24.927416+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T13:52:24.927416+0000","last_undegraded":"2023-07-13T13:52:24.927416+0000","last_fullsized":"2023-07-13T13:52:24.927416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:56:45.107513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928765+0000","last_change":"2023-07-13T13:52:17.942704+0000","last_active":"2023-07-13T13:52:24.928765+0000","last_peered":"2023-07-13T13:52:24.928765+0000","last_clean":"2023-07-13T13:52:24.928765+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T13:52:24.928765+0000","last_undegraded":"2023-07-13T13:52:24.928765+0000","last_fullsized":"2023-07-13T13:52:24.928765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:12.764288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.810954+0000","last_change":"2023-07-13T13:52:17.934990+0000","last_active":"2023-07-13T13:52:56.810954+0000","last_peered":"2023-07-13T13:52:56.810954+0000","last_clean":"2023-07-13T13:52:56.810954+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T13:52:56.810954+0000","last_undegraded":"2023-07-13T13:52:56.810954+0000","last_fullsized":"2023-07-13T13:52:56.810954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:45:21.747666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928683+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T13:52:24.928683+0000","last_peered":"2023-07-13T13:52:24.928683+0000","last_clean":"2023-07-13T13:52:24.928683+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T13:52:24.928683+0000","last_undegraded":"2023-07-13T13:52:24.928683+0000","last_fullsized":"2023-07-13T13:52:24.928683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:25:08.080128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824449+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T13:52:56.824449+0000","last_peered":"2023-07-13T13:52:56.824449+0000","last_clean":"2023-07-13T13:52:56.824449+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T13:52:56.824449+0000","last_undegraded":"2023-07-13T13:52:56.824449+0000","last_fullsized":"2023-07-13T13:52:56.824449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:45:11.763527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927206+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T13:52:24.927206+0000","last_peered":"2023-07-13T13:52:24.927206+0000","last_clean":"2023-07-13T13:52:24.927206+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T13:52:24.927206+0000","last_undegraded":"2023-07-13T13:52:24.927206+0000","last_fullsized":"2023-07-13T13:52:24.927206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:35:36.595395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879195+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T13:52:24.879195+0000","last_peered":"2023-07-13T13:52:24.879195+0000","last_clean":"2023-07-13T13:52:24.879195+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T13:52:24.879195+0000","last_undegraded":"2023-07-13T13:52:24.879195+0000","last_fullsized":"2023-07-13T13:52:24.879195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:05.503930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824441+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T13:52:56.824441+0000","last_peered":"2023-07-13T13:52:56.824441+0000","last_clean":"2023-07-13T13:52:56.824441+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T13:52:56.824441+0000","last_undegraded":"2023-07-13T13:52:56.824441+0000","last_fullsized":"2023-07-13T13:52:56.824441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:18:31.628279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892101+0000","last_change":"2023-07-13T13:52:17.951443+0000","last_active":"2023-07-13T13:52:24.892101+0000","last_peered":"2023-07-13T13:52:24.892101+0000","last_clean":"2023-07-13T13:52:24.892101+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T13:52:24.892101+0000","last_undegraded":"2023-07-13T13:52:24.892101+0000","last_fullsized":"2023-07-13T13:52:24.892101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:15:13.905216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892221+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T13:52:24.892221+0000","last_peered":"2023-07-13T13:52:24.892221+0000","last_clean":"2023-07-13T13:52:24.892221+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T13:52:24.892221+0000","last_undegraded":"2023-07-13T13:52:24.892221+0000","last_fullsized":"2023-07-13T13:52:24.892221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:25:07.338467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832435+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T13:52:56.832435+0000","last_peered":"2023-07-13T13:52:56.832435+0000","last_clean":"2023-07-13T13:52:56.832435+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T13:52:56.832435+0000","last_undegraded":"2023-07-13T13:52:56.832435+0000","last_fullsized":"2023-07-13T13:52:56.832435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:05:05.424970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928347+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T13:52:24.928347+0000","last_peered":"2023-07-13T13:52:24.928347+0000","last_clean":"2023-07-13T13:52:24.928347+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T13:52:24.928347+0000","last_undegraded":"2023-07-13T13:52:24.928347+0000","last_fullsized":"2023-07-13T13:52:24.928347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:27.502582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927905+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T13:52:24.927905+0000","last_peered":"2023-07-13T13:52:24.927905+0000","last_clean":"2023-07-13T13:52:24.927905+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T13:52:24.927905+0000","last_undegraded":"2023-07-13T13:52:24.927905+0000","last_fullsized":"2023-07-13T13:52:24.927905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.301671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879893+0000","last_change":"2023-07-13T13:52:17.948432+0000","last_active":"2023-07-13T13:52:24.879893+0000","last_peered":"2023-07-13T13:52:24.879893+0000","last_clean":"2023-07-13T13:52:24.879893+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T13:52:24.879893+0000","last_undegraded":"2023-07-13T13:52:24.879893+0000","last_fullsized":"2023-07-13T13:52:24.879893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:56:28.970102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927636+0000","last_change":"2023-07-13T13:52:23.984769+0000","last_active":"2023-07-13T13:52:24.927636+0000","last_peered":"2023-07-13T13:52:24.927636+0000","last_clean":"2023-07-13T13:52:24.927636+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T13:52:24.927636+0000","last_undegraded":"2023-07-13T13:52:24.927636+0000","last_fullsized":"2023-07-13T13:52:24.927636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:04:41.174657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891603+0000","last_change":"2023-07-13T13:52:16.667863+0000","last_active":"2023-07-13T13:52:24.891603+0000","last_peered":"2023-07-13T13:52:24.891603+0000","last_clean":"2023-07-13T13:52:24.891603+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T13:52:24.891603+0000","last_undegraded":"2023-07-13T13:52:24.891603+0000","last_fullsized":"2023-07-13T13:52:24.891603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:26:34.960591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927548+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T13:52:24.927548+0000","last_peered":"2023-07-13T13:52:24.927548+0000","last_clean":"2023-07-13T13:52:24.927548+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T13:52:24.927548+0000","last_undegraded":"2023-07-13T13:52:24.927548+0000","last_fullsized":"2023-07-13T13:52:24.927548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:34:06.937251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927832+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T13:52:24.927832+0000","last_peered":"2023-07-13T13:52:24.927832+0000","last_clean":"2023-07-13T13:52:24.927832+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T13:52:24.927832+0000","last_undegraded":"2023-07-13T13:52:24.927832+0000","last_fullsized":"2023-07-13T13:52:24.927832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:44:38.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879435+0000","last_change":"2023-07-13T13:52:16.607515+0000","last_active":"2023-07-13T13:52:24.879435+0000","last_peered":"2023-07-13T13:52:24.879435+0000","last_clean":"2023-07-13T13:52:24.879435+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T13:52:24.879435+0000","last_undegraded":"2023-07-13T13:52:24.879435+0000","last_fullsized":"2023-07-13T13:52:24.879435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:24:27.668099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927817+0000","last_change":"2023-07-13T13:52:17.934538+0000","last_active":"2023-07-13T13:52:24.927817+0000","last_peered":"2023-07-13T13:52:24.927817+0000","last_clean":"2023-07-13T13:52:24.927817+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T13:52:24.927817+0000","last_undegraded":"2023-07-13T13:52:24.927817+0000","last_fullsized":"2023-07-13T13:52:24.927817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:55:29.065632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927005+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T13:52:24.927005+0000","last_peered":"2023-07-13T13:52:24.927005+0000","last_clean":"2023-07-13T13:52:24.927005+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T13:52:24.927005+0000","last_undegraded":"2023-07-13T13:52:24.927005+0000","last_fullsized":"2023-07-13T13:52:24.927005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:54:23.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927512+0000","last_change":"2023-07-13T13:52:16.668908+0000","last_active":"2023-07-13T13:52:24.927512+0000","last_peered":"2023-07-13T13:52:24.927512+0000","last_clean":"2023-07-13T13:52:24.927512+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T13:52:24.927512+0000","last_undegraded":"2023-07-13T13:52:24.927512+0000","last_fullsized":"2023-07-13T13:52:24.927512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:15:12.759166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879407+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T13:52:24.879407+0000","last_peered":"2023-07-13T13:52:24.879407+0000","last_clean":"2023-07-13T13:52:24.879407+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T13:52:24.879407+0000","last_undegraded":"2023-07-13T13:52:24.879407+0000","last_fullsized":"2023-07-13T13:52:24.879407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:11:59.869006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824157+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T13:52:56.824157+0000","last_peered":"2023-07-13T13:52:56.824157+0000","last_clean":"2023-07-13T13:52:56.824157+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T13:52:56.824157+0000","last_undegraded":"2023-07-13T13:52:56.824157+0000","last_fullsized":"2023-07-13T13:52:56.824157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:47:51.181841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832510+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T13:52:56.832510+0000","last_peered":"2023-07-13T13:52:56.832510+0000","last_clean":"2023-07-13T13:52:56.832510+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T13:52:56.832510+0000","last_undegraded":"2023-07-13T13:52:56.832510+0000","last_fullsized":"2023-07-13T13:52:56.832510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:47.823453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879193+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T13:52:24.879193+0000","last_peered":"2023-07-13T13:52:24.879193+0000","last_clean":"2023-07-13T13:52:24.879193+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T13:52:24.879193+0000","last_undegraded":"2023-07-13T13:52:24.879193+0000","last_fullsized":"2023-07-13T13:52:24.879193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:11.920803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879638+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T13:52:24.879638+0000","last_peered":"2023-07-13T13:52:24.879638+0000","last_clean":"2023-07-13T13:52:24.879638+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T13:52:24.879638+0000","last_undegraded":"2023-07-13T13:52:24.879638+0000","last_fullsized":"2023-07-13T13:52:24.879638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:40:03.468109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824722+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T13:52:56.824722+0000","last_peered":"2023-07-13T13:52:56.824722+0000","last_clean":"2023-07-13T13:52:56.824722+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T13:52:56.824722+0000","last_undegraded":"2023-07-13T13:52:56.824722+0000","last_fullsized":"2023-07-13T13:52:56.824722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:05:04.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892115+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T13:52:24.892115+0000","last_peered":"2023-07-13T13:52:24.892115+0000","last_clean":"2023-07-13T13:52:24.892115+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T13:52:24.892115+0000","last_undegraded":"2023-07-13T13:52:24.892115+0000","last_fullsized":"2023-07-13T13:52:24.892115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:45:09.342439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891618+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T13:52:24.891618+0000","last_peered":"2023-07-13T13:52:24.891618+0000","last_clean":"2023-07-13T13:52:24.891618+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T13:52:24.891618+0000","last_undegraded":"2023-07-13T13:52:24.891618+0000","last_fullsized":"2023-07-13T13:52:24.891618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:54:40.996212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:33.640166+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T13:52:33.640166+0000","last_peered":"2023-07-13T13:52:33.640166+0000","last_clean":"2023-07-13T13:52:33.640166+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T13:52:33.640166+0000","last_undegraded":"2023-07-13T13:52:33.640166+0000","last_fullsized":"2023-07-13T13:52:33.640166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:47:20.741487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928282+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T13:52:24.928282+0000","last_peered":"2023-07-13T13:52:24.928282+0000","last_clean":"2023-07-13T13:52:24.928282+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T13:52:24.928282+0000","last_undegraded":"2023-07-13T13:52:24.928282+0000","last_fullsized":"2023-07-13T13:52:24.928282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:37:56.904122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832132+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T13:52:56.832132+0000","last_peered":"2023-07-13T13:52:56.832132+0000","last_clean":"2023-07-13T13:52:56.832132+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T13:52:56.832132+0000","last_undegraded":"2023-07-13T13:52:56.832132+0000","last_fullsized":"2023-07-13T13:52:56.832132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:22:11.643832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824530+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T13:52:56.824530+0000","last_peered":"2023-07-13T13:52:56.824530+0000","last_clean":"2023-07-13T13:52:56.824530+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T13:52:56.824530+0000","last_undegraded":"2023-07-13T13:52:56.824530+0000","last_fullsized":"2023-07-13T13:52:56.824530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:32:12.663193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879700+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T13:52:24.879700+0000","last_peered":"2023-07-13T13:52:24.879700+0000","last_clean":"2023-07-13T13:52:24.879700+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T13:52:24.879700+0000","last_undegraded":"2023-07-13T13:52:24.879700+0000","last_fullsized":"2023-07-13T13:52:24.879700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:11:25.930718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879777+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T13:52:24.879777+0000","last_peered":"2023-07-13T13:52:24.879777+0000","last_clean":"2023-07-13T13:52:24.879777+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T13:52:24.879777+0000","last_undegraded":"2023-07-13T13:52:24.879777+0000","last_fullsized":"2023-07-13T13:52:24.879777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:11:10.845693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927068+0000","last_change":"2023-07-13T13:52:16.663350+0000","last_active":"2023-07-13T13:52:24.927068+0000","last_peered":"2023-07-13T13:52:24.927068+0000","last_clean":"2023-07-13T13:52:24.927068+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T13:52:24.927068+0000","last_undegraded":"2023-07-13T13:52:24.927068+0000","last_fullsized":"2023-07-13T13:52:24.927068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:16:40.928511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832382+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T13:52:56.832382+0000","last_peered":"2023-07-13T13:52:56.832382+0000","last_clean":"2023-07-13T13:52:56.832382+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T13:52:56.832382+0000","last_undegraded":"2023-07-13T13:52:56.832382+0000","last_fullsized":"2023-07-13T13:52:56.832382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:04:43.546347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879939+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T13:52:24.879939+0000","last_peered":"2023-07-13T13:52:24.879939+0000","last_clean":"2023-07-13T13:52:24.879939+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T13:52:24.879939+0000","last_undegraded":"2023-07-13T13:52:24.879939+0000","last_fullsized":"2023-07-13T13:52:24.879939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:22:04.157829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824260+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T13:52:56.824260+0000","last_peered":"2023-07-13T13:52:56.824260+0000","last_clean":"2023-07-13T13:52:56.824260+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T13:52:56.824260+0000","last_undegraded":"2023-07-13T13:52:56.824260+0000","last_fullsized":"2023-07-13T13:52:56.824260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:10:57.527430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927667+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T13:52:24.927667+0000","last_peered":"2023-07-13T13:52:24.927667+0000","last_clean":"2023-07-13T13:52:24.927667+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T13:52:24.927667+0000","last_undegraded":"2023-07-13T13:52:24.927667+0000","last_fullsized":"2023-07-13T13:52:24.927667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:36:21.525254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832183+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T13:52:56.832183+0000","last_peered":"2023-07-13T13:52:56.832183+0000","last_clean":"2023-07-13T13:52:56.832183+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T13:52:56.832183+0000","last_undegraded":"2023-07-13T13:52:56.832183+0000","last_fullsized":"2023-07-13T13:52:56.832183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:19:11.804958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.926948+0000","last_change":"2023-07-13T13:52:16.692808+0000","last_active":"2023-07-13T13:52:24.926948+0000","last_peered":"2023-07-13T13:52:24.926948+0000","last_clean":"2023-07-13T13:52:24.926948+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T13:52:24.926948+0000","last_undegraded":"2023-07-13T13:52:24.926948+0000","last_fullsized":"2023-07-13T13:52:24.926948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:00:42.596139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879892+0000","last_change":"2023-07-13T13:52:17.838408+0000","last_active":"2023-07-13T13:52:24.879892+0000","last_peered":"2023-07-13T13:52:24.879892+0000","last_clean":"2023-07-13T13:52:24.879892+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T13:52:24.879892+0000","last_undegraded":"2023-07-13T13:52:24.879892+0000","last_fullsized":"2023-07-13T13:52:24.879892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:43:05.930281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824438+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T13:52:56.824438+0000","last_peered":"2023-07-13T13:52:56.824438+0000","last_clean":"2023-07-13T13:52:56.824438+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T13:52:56.824438+0000","last_undegraded":"2023-07-13T13:52:56.824438+0000","last_fullsized":"2023-07-13T13:52:56.824438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:19:11.804958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824999+0000","last_change":"2023-07-13T13:52:16.666097+0000","last_active":"2023-07-13T13:52:56.824999+0000","last_peered":"2023-07-13T13:52:56.824999+0000","last_clean":"2023-07-13T13:52:56.824999+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T13:52:56.824999+0000","last_undegraded":"2023-07-13T13:52:56.824999+0000","last_fullsized":"2023-07-13T13:52:56.824999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:07:43.487888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.831674+0000","last_change":"2023-07-13T13:52:17.838908+0000","last_active":"2023-07-13T13:52:56.831674+0000","last_peered":"2023-07-13T13:52:56.831674+0000","last_clean":"2023-07-13T13:52:56.831674+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T13:52:56.831674+0000","last_undegraded":"2023-07-13T13:52:56.831674+0000","last_fullsized":"2023-07-13T13:52:56.831674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:58:17.828294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.809947+0000","last_change":"2023-07-13T13:52:23.993113+0000","last_active":"2023-07-13T13:52:56.809947+0000","last_peered":"2023-07-13T13:52:56.809947+0000","last_clean":"2023-07-13T13:52:56.809947+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T13:52:56.809947+0000","last_undegraded":"2023-07-13T13:52:56.809947+0000","last_fullsized":"2023-07-13T13:52:56.809947+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:32:29.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824819+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T13:52:56.824819+0000","last_peered":"2023-07-13T13:52:56.824819+0000","last_clean":"2023-07-13T13:52:56.824819+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T13:52:56.824819+0000","last_undegraded":"2023-07-13T13:52:56.824819+0000","last_fullsized":"2023-07-13T13:52:56.824819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:47.823453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927753+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T13:52:24.927753+0000","last_peered":"2023-07-13T13:52:24.927753+0000","last_clean":"2023-07-13T13:52:24.927753+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T13:52:24.927753+0000","last_undegraded":"2023-07-13T13:52:24.927753+0000","last_fullsized":"2023-07-13T13:52:24.927753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:01:04.196253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.810624+0000","last_change":"2023-07-13T13:52:23.992085+0000","last_active":"2023-07-13T13:52:56.810624+0000","last_peered":"2023-07-13T13:52:56.810624+0000","last_clean":"2023-07-13T13:52:56.810624+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T13:52:56.810624+0000","last_undegraded":"2023-07-13T13:52:56.810624+0000","last_fullsized":"2023-07-13T13:52:56.810624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:43:27.078037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824903+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T13:52:56.824903+0000","last_peered":"2023-07-13T13:52:56.824903+0000","last_clean":"2023-07-13T13:52:56.824903+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T13:52:56.824903+0000","last_undegraded":"2023-07-13T13:52:56.824903+0000","last_fullsized":"2023-07-13T13:52:56.824903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:25:36.691496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927219+0000","last_change":"2023-07-13T13:52:17.952164+0000","last_active":"2023-07-13T13:52:24.927219+0000","last_peered":"2023-07-13T13:52:24.927219+0000","last_clean":"2023-07-13T13:52:24.927219+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T13:52:24.927219+0000","last_undegraded":"2023-07-13T13:52:24.927219+0000","last_fullsized":"2023-07-13T13:52:24.927219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:19.822713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.810466+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T13:52:56.810466+0000","last_peered":"2023-07-13T13:52:56.810466+0000","last_clean":"2023-07-13T13:52:56.810466+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T13:52:56.810466+0000","last_undegraded":"2023-07-13T13:52:56.810466+0000","last_fullsized":"2023-07-13T13:52:56.810466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:24:23.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.831925+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T13:52:56.831925+0000","last_peered":"2023-07-13T13:52:56.831925+0000","last_clean":"2023-07-13T13:52:56.831925+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T13:52:56.831925+0000","last_undegraded":"2023-07-13T13:52:56.831925+0000","last_fullsized":"2023-07-13T13:52:56.831925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:47:43.828953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927647+0000","last_change":"2023-07-13T13:52:17.952349+0000","last_active":"2023-07-13T13:52:24.927647+0000","last_peered":"2023-07-13T13:52:24.927647+0000","last_clean":"2023-07-13T13:52:24.927647+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T13:52:24.927647+0000","last_undegraded":"2023-07-13T13:52:24.927647+0000","last_fullsized":"2023-07-13T13:52:24.927647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:25:07.338467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811077+0000","last_change":"2023-07-13T13:52:23.987269+0000","last_active":"2023-07-13T13:52:56.811077+0000","last_peered":"2023-07-13T13:52:56.811077+0000","last_clean":"2023-07-13T13:52:56.811077+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T13:52:56.811077+0000","last_undegraded":"2023-07-13T13:52:56.811077+0000","last_fullsized":"2023-07-13T13:52:56.811077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:38:16.419873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879419+0000","last_change":"2023-07-13T13:52:16.607455+0000","last_active":"2023-07-13T13:52:24.879419+0000","last_peered":"2023-07-13T13:52:24.879419+0000","last_clean":"2023-07-13T13:52:24.879419+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T13:52:24.879419+0000","last_undegraded":"2023-07-13T13:52:24.879419+0000","last_fullsized":"2023-07-13T13:52:24.879419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:08.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928550+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T13:52:24.928550+0000","last_peered":"2023-07-13T13:52:24.928550+0000","last_clean":"2023-07-13T13:52:24.928550+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T13:52:24.928550+0000","last_undegraded":"2023-07-13T13:52:24.928550+0000","last_fullsized":"2023-07-13T13:52:24.928550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:05:24.675504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891810+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T13:52:24.891810+0000","last_peered":"2023-07-13T13:52:24.891810+0000","last_clean":"2023-07-13T13:52:24.891810+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T13:52:24.891810+0000","last_undegraded":"2023-07-13T13:52:24.891810+0000","last_fullsized":"2023-07-13T13:52:24.891810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:16:48.281399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927299+0000","last_change":"2023-07-13T13:52:16.692899+0000","last_active":"2023-07-13T13:52:24.927299+0000","last_peered":"2023-07-13T13:52:24.927299+0000","last_clean":"2023-07-13T13:52:24.927299+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T13:52:24.927299+0000","last_undegraded":"2023-07-13T13:52:24.927299+0000","last_fullsized":"2023-07-13T13:52:24.927299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:32:47.704876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928496+0000","last_change":"2023-07-13T13:52:17.942165+0000","last_active":"2023-07-13T13:52:24.928496+0000","last_peered":"2023-07-13T13:52:24.928496+0000","last_clean":"2023-07-13T13:52:24.928496+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T13:52:24.928496+0000","last_undegraded":"2023-07-13T13:52:24.928496+0000","last_fullsized":"2023-07-13T13:52:24.928496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:12:48.876978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832529+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T13:52:56.832529+0000","last_peered":"2023-07-13T13:52:56.832529+0000","last_clean":"2023-07-13T13:52:56.832529+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T13:52:56.832529+0000","last_undegraded":"2023-07-13T13:52:56.832529+0000","last_fullsized":"2023-07-13T13:52:56.832529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:09:14.270230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927452+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T13:52:24.927452+0000","last_peered":"2023-07-13T13:52:24.927452+0000","last_clean":"2023-07-13T13:52:24.927452+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T13:52:24.927452+0000","last_undegraded":"2023-07-13T13:52:24.927452+0000","last_fullsized":"2023-07-13T13:52:24.927452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:03.894064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929645+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T13:52:24.929645+0000","last_peered":"2023-07-13T13:52:24.929645+0000","last_clean":"2023-07-13T13:52:24.929645+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T13:52:24.929645+0000","last_undegraded":"2023-07-13T13:52:24.929645+0000","last_fullsized":"2023-07-13T13:52:24.929645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:35:22.230584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929592+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T13:52:24.929592+0000","last_peered":"2023-07-13T13:52:24.929592+0000","last_clean":"2023-07-13T13:52:24.929592+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T13:52:24.929592+0000","last_undegraded":"2023-07-13T13:52:24.929592+0000","last_fullsized":"2023-07-13T13:52:24.929592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:00:18.335695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879297+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T13:52:24.879297+0000","last_peered":"2023-07-13T13:52:24.879297+0000","last_clean":"2023-07-13T13:52:24.879297+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T13:52:24.879297+0000","last_undegraded":"2023-07-13T13:52:24.879297+0000","last_fullsized":"2023-07-13T13:52:24.879297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:18.698131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892152+0000","last_change":"2023-07-13T13:52:17.949610+0000","last_active":"2023-07-13T13:52:24.892152+0000","last_peered":"2023-07-13T13:52:24.892152+0000","last_clean":"2023-07-13T13:52:24.892152+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T13:52:24.892152+0000","last_undegraded":"2023-07-13T13:52:24.892152+0000","last_fullsized":"2023-07-13T13:52:24.892152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:40.017246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927555+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T13:52:24.927555+0000","last_peered":"2023-07-13T13:52:24.927555+0000","last_clean":"2023-07-13T13:52:24.927555+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T13:52:24.927555+0000","last_undegraded":"2023-07-13T13:52:24.927555+0000","last_fullsized":"2023-07-13T13:52:24.927555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:45:15.549277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891895+0000","last_change":"2023-07-13T13:51:59.916015+0000","last_active":"2023-07-13T13:52:24.891895+0000","last_peered":"2023-07-13T13:52:24.891895+0000","last_clean":"2023-07-13T13:52:24.891895+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T13:52:24.891895+0000","last_undegraded":"2023-07-13T13:52:24.891895+0000","last_fullsized":"2023-07-13T13:52:24.891895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:58:56.377294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832257+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T13:52:56.832257+0000","last_peered":"2023-07-13T13:52:56.832257+0000","last_clean":"2023-07-13T13:52:56.832257+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T13:52:56.832257+0000","last_undegraded":"2023-07-13T13:52:56.832257+0000","last_fullsized":"2023-07-13T13:52:56.832257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:18:30.482228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891909+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T13:52:24.891909+0000","last_peered":"2023-07-13T13:52:24.891909+0000","last_clean":"2023-07-13T13:52:24.891909+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T13:52:24.891909+0000","last_undegraded":"2023-07-13T13:52:24.891909+0000","last_fullsized":"2023-07-13T13:52:24.891909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:42:21.528797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927325+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T13:52:24.927325+0000","last_peered":"2023-07-13T13:52:24.927325+0000","last_clean":"2023-07-13T13:52:24.927325+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T13:52:24.927325+0000","last_undegraded":"2023-07-13T13:52:24.927325+0000","last_fullsized":"2023-07-13T13:52:24.927325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:59:20.772189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832025+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T13:52:56.832025+0000","last_peered":"2023-07-13T13:52:56.832025+0000","last_clean":"2023-07-13T13:52:56.832025+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T13:52:56.832025+0000","last_undegraded":"2023-07-13T13:52:56.832025+0000","last_fullsized":"2023-07-13T13:52:56.832025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:54:42.578741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928641+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T13:52:24.928641+0000","last_peered":"2023-07-13T13:52:24.928641+0000","last_clean":"2023-07-13T13:52:24.928641+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T13:52:24.928641+0000","last_undegraded":"2023-07-13T13:52:24.928641+0000","last_fullsized":"2023-07-13T13:52:24.928641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:59.268490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891765+0000","last_change":"2023-07-13T13:52:17.947909+0000","last_active":"2023-07-13T13:52:24.891765+0000","last_peered":"2023-07-13T13:52:24.891765+0000","last_clean":"2023-07-13T13:52:24.891765+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T13:52:24.891765+0000","last_undegraded":"2023-07-13T13:52:24.891765+0000","last_fullsized":"2023-07-13T13:52:24.891765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:53:25.856736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811628+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T13:52:56.811628+0000","last_peered":"2023-07-13T13:52:56.811628+0000","last_clean":"2023-07-13T13:52:56.811628+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T13:52:56.811628+0000","last_undegraded":"2023-07-13T13:52:56.811628+0000","last_fullsized":"2023-07-13T13:52:56.811628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:24:06.312873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811239+0000","last_change":"2023-07-13T13:52:01.224691+0000","last_active":"2023-07-13T13:52:56.811239+0000","last_peered":"2023-07-13T13:52:56.811239+0000","last_clean":"2023-07-13T13:52:56.811239+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T13:52:56.811239+0000","last_undegraded":"2023-07-13T13:52:56.811239+0000","last_fullsized":"2023-07-13T13:52:56.811239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:53:16.252001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891536+0000","last_change":"2023-07-13T13:52:16.668065+0000","last_active":"2023-07-13T13:52:24.891536+0000","last_peered":"2023-07-13T13:52:24.891536+0000","last_clean":"2023-07-13T13:52:24.891536+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T13:52:24.891536+0000","last_undegraded":"2023-07-13T13:52:24.891536+0000","last_fullsized":"2023-07-13T13:52:24.891536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:24:28.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892038+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T13:52:24.892038+0000","last_peered":"2023-07-13T13:52:24.892038+0000","last_clean":"2023-07-13T13:52:24.892038+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T13:52:24.892038+0000","last_undegraded":"2023-07-13T13:52:24.892038+0000","last_fullsized":"2023-07-13T13:52:24.892038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:49:06.930579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824507+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T13:52:56.824507+0000","last_peered":"2023-07-13T13:52:56.824507+0000","last_clean":"2023-07-13T13:52:56.824507+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T13:52:56.824507+0000","last_undegraded":"2023-07-13T13:52:56.824507+0000","last_fullsized":"2023-07-13T13:52:56.824507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:34.020205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832434+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T13:52:56.832434+0000","last_peered":"2023-07-13T13:52:56.832434+0000","last_clean":"2023-07-13T13:52:56.832434+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T13:52:56.832434+0000","last_undegraded":"2023-07-13T13:52:56.832434+0000","last_fullsized":"2023-07-13T13:52:56.832434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:44:53.575469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824317+0000","last_change":"2023-07-13T13:51:57.962882+0000","last_active":"2023-07-13T13:52:56.824317+0000","last_peered":"2023-07-13T13:52:56.824317+0000","last_clean":"2023-07-13T13:52:56.824317+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T13:52:56.824317+0000","last_undegraded":"2023-07-13T13:52:56.824317+0000","last_fullsized":"2023-07-13T13:52:56.824317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_clean_scrub_stamp":"2023-07-13T13:51:55.598839+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:54:39.901236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879350+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T13:52:24.879350+0000","last_peered":"2023-07-13T13:52:24.879350+0000","last_clean":"2023-07-13T13:52:24.879350+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T13:52:24.879350+0000","last_undegraded":"2023-07-13T13:52:24.879350+0000","last_fullsized":"2023-07-13T13:52:24.879350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:03:57.800032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927892+0000","last_change":"2023-07-13T13:52:17.942525+0000","last_active":"2023-07-13T13:52:24.927892+0000","last_peered":"2023-07-13T13:52:24.927892+0000","last_clean":"2023-07-13T13:52:24.927892+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T13:52:24.927892+0000","last_undegraded":"2023-07-13T13:52:24.927892+0000","last_fullsized":"2023-07-13T13:52:24.927892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:00:29.156794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832258+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T13:52:56.832258+0000","last_peered":"2023-07-13T13:52:56.832258+0000","last_clean":"2023-07-13T13:52:56.832258+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T13:52:56.832258+0000","last_undegraded":"2023-07-13T13:52:56.832258+0000","last_fullsized":"2023-07-13T13:52:56.832258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:25:44.044383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824567+0000","last_change":"2023-07-13T13:52:00.016430+0000","last_active":"2023-07-13T13:52:56.824567+0000","last_peered":"2023-07-13T13:52:56.824567+0000","last_clean":"2023-07-13T13:52:56.824567+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T13:52:56.824567+0000","last_undegraded":"2023-07-13T13:52:56.824567+0000","last_fullsized":"2023-07-13T13:52:56.824567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:04:25.358290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.926955+0000","last_change":"2023-07-13T13:52:16.630297+0000","last_active":"2023-07-13T13:52:24.926955+0000","last_peered":"2023-07-13T13:52:24.926955+0000","last_clean":"2023-07-13T13:52:24.926955+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T13:52:24.926955+0000","last_undegraded":"2023-07-13T13:52:24.926955+0000","last_fullsized":"2023-07-13T13:52:24.926955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:53:24.710686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927322+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T13:52:24.927322+0000","last_peered":"2023-07-13T13:52:24.927322+0000","last_clean":"2023-07-13T13:52:24.927322+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T13:52:24.927322+0000","last_undegraded":"2023-07-13T13:52:24.927322+0000","last_fullsized":"2023-07-13T13:52:24.927322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:23:18.465639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927124+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T13:52:24.927124+0000","last_peered":"2023-07-13T13:52:24.927124+0000","last_clean":"2023-07-13T13:52:24.927124+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T13:52:24.927124+0000","last_undegraded":"2023-07-13T13:52:24.927124+0000","last_fullsized":"2023-07-13T13:52:24.927124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:15:57.574963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824844+0000","last_change":"2023-07-13T13:52:00.019670+0000","last_active":"2023-07-13T13:52:56.824844+0000","last_peered":"2023-07-13T13:52:56.824844+0000","last_clean":"2023-07-13T13:52:56.824844+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T13:52:56.824844+0000","last_undegraded":"2023-07-13T13:52:56.824844+0000","last_fullsized":"2023-07-13T13:52:56.824844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:08:49.875336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892015+0000","last_change":"2023-07-13T13:52:16.668244+0000","last_active":"2023-07-13T13:52:24.892015+0000","last_peered":"2023-07-13T13:52:24.892015+0000","last_clean":"2023-07-13T13:52:24.892015+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T13:52:24.892015+0000","last_undegraded":"2023-07-13T13:52:24.892015+0000","last_fullsized":"2023-07-13T13:52:24.892015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:56:43.961463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927745+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T13:52:24.927745+0000","last_peered":"2023-07-13T13:52:24.927745+0000","last_clean":"2023-07-13T13:52:24.927745+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T13:52:24.927745+0000","last_undegraded":"2023-07-13T13:52:24.927745+0000","last_fullsized":"2023-07-13T13:52:24.927745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:12:41.254584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929834+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T13:52:24.929834+0000","last_peered":"2023-07-13T13:52:24.929834+0000","last_clean":"2023-07-13T13:52:24.929834+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T13:52:24.929834+0000","last_undegraded":"2023-07-13T13:52:24.929834+0000","last_fullsized":"2023-07-13T13:52:24.929834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:37:00.550738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.880010+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T13:52:24.880010+0000","last_peered":"2023-07-13T13:52:24.880010+0000","last_clean":"2023-07-13T13:52:24.880010+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T13:52:24.880010+0000","last_undegraded":"2023-07-13T13:52:24.880010+0000","last_fullsized":"2023-07-13T13:52:24.880010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:13:01.211759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891905+0000","last_change":"2023-07-13T13:51:59.757569+0000","last_active":"2023-07-13T13:52:24.891905+0000","last_peered":"2023-07-13T13:52:24.891905+0000","last_clean":"2023-07-13T13:52:24.891905+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T13:52:24.891905+0000","last_undegraded":"2023-07-13T13:52:24.891905+0000","last_fullsized":"2023-07-13T13:52:24.891905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:23:00.277581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879225+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T13:52:24.879225+0000","last_peered":"2023-07-13T13:52:24.879225+0000","last_clean":"2023-07-13T13:52:24.879225+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T13:52:24.879225+0000","last_undegraded":"2023-07-13T13:52:24.879225+0000","last_fullsized":"2023-07-13T13:52:24.879225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879206+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T13:52:24.879206+0000","last_peered":"2023-07-13T13:52:24.879206+0000","last_clean":"2023-07-13T13:52:24.879206+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T13:52:24.879206+0000","last_undegraded":"2023-07-13T13:52:24.879206+0000","last_fullsized":"2023-07-13T13:52:24.879206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:48.589588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927710+0000","last_change":"2023-07-13T13:52:00.015919+0000","last_active":"2023-07-13T13:52:24.927710+0000","last_peered":"2023-07-13T13:52:24.927710+0000","last_clean":"2023-07-13T13:52:24.927710+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T13:52:24.927710+0000","last_undegraded":"2023-07-13T13:52:24.927710+0000","last_fullsized":"2023-07-13T13:52:24.927710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:46:47.618201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927436+0000","last_change":"2023-07-13T13:52:16.665545+0000","last_active":"2023-07-13T13:52:24.927436+0000","last_peered":"2023-07-13T13:52:24.927436+0000","last_clean":"2023-07-13T13:52:24.927436+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T13:52:24.927436+0000","last_undegraded":"2023-07-13T13:52:24.927436+0000","last_fullsized":"2023-07-13T13:52:24.927436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:49:05.784529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927636+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T13:52:24.927636+0000","last_peered":"2023-07-13T13:52:24.927636+0000","last_clean":"2023-07-13T13:52:24.927636+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T13:52:24.927636+0000","last_undegraded":"2023-07-13T13:52:24.927636+0000","last_fullsized":"2023-07-13T13:52:24.927636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:16:16.297416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892883+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T13:52:24.892883+0000","last_peered":"2023-07-13T13:52:24.892883+0000","last_clean":"2023-07-13T13:52:24.892883+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T13:52:24.892883+0000","last_undegraded":"2023-07-13T13:52:24.892883+0000","last_fullsized":"2023-07-13T13:52:24.892883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:36:27.732091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927759+0000","last_change":"2023-07-13T13:52:16.631174+0000","last_active":"2023-07-13T13:52:24.927759+0000","last_peered":"2023-07-13T13:52:24.927759+0000","last_clean":"2023-07-13T13:52:24.927759+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T13:52:24.927759+0000","last_undegraded":"2023-07-13T13:52:24.927759+0000","last_fullsized":"2023-07-13T13:52:24.927759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:23:47.339702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811375+0000","last_change":"2023-07-13T13:52:17.952450+0000","last_active":"2023-07-13T13:52:56.811375+0000","last_peered":"2023-07-13T13:52:56.811375+0000","last_clean":"2023-07-13T13:52:56.811375+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T13:52:56.811375+0000","last_undegraded":"2023-07-13T13:52:56.811375+0000","last_fullsized":"2023-07-13T13:52:56.811375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:11:25.398073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824349+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T13:52:56.824349+0000","last_peered":"2023-07-13T13:52:56.824349+0000","last_clean":"2023-07-13T13:52:56.824349+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T13:52:56.824349+0000","last_undegraded":"2023-07-13T13:52:56.824349+0000","last_fullsized":"2023-07-13T13:52:56.824349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:22:11.643832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832000+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T13:52:56.832000+0000","last_peered":"2023-07-13T13:52:56.832000+0000","last_clean":"2023-07-13T13:52:56.832000+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T13:52:56.832000+0000","last_undegraded":"2023-07-13T13:52:56.832000+0000","last_fullsized":"2023-07-13T13:52:56.832000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:27:44.759139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928459+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T13:52:24.928459+0000","last_peered":"2023-07-13T13:52:24.928459+0000","last_clean":"2023-07-13T13:52:24.928459+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T13:52:24.928459+0000","last_undegraded":"2023-07-13T13:52:24.928459+0000","last_fullsized":"2023-07-13T13:52:24.928459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:32:17.932880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832299+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T13:52:56.832299+0000","last_peered":"2023-07-13T13:52:56.832299+0000","last_clean":"2023-07-13T13:52:56.832299+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T13:52:56.832299+0000","last_undegraded":"2023-07-13T13:52:56.832299+0000","last_fullsized":"2023-07-13T13:52:56.832299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:32:20.016081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832186+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T13:52:56.832186+0000","last_peered":"2023-07-13T13:52:56.832186+0000","last_clean":"2023-07-13T13:52:56.832186+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T13:52:56.832186+0000","last_undegraded":"2023-07-13T13:52:56.832186+0000","last_fullsized":"2023-07-13T13:52:56.832186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:25.198839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927870+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T13:52:24.927870+0000","last_peered":"2023-07-13T13:52:24.927870+0000","last_clean":"2023-07-13T13:52:24.927870+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T13:52:24.927870+0000","last_undegraded":"2023-07-13T13:52:24.927870+0000","last_fullsized":"2023-07-13T13:52:24.927870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:04:57.309588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927014+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T13:52:24.927014+0000","last_peered":"2023-07-13T13:52:24.927014+0000","last_clean":"2023-07-13T13:52:24.927014+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T13:52:24.927014+0000","last_undegraded":"2023-07-13T13:52:24.927014+0000","last_fullsized":"2023-07-13T13:52:24.927014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:02.313280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879724+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T13:52:24.879724+0000","last_peered":"2023-07-13T13:52:24.879724+0000","last_clean":"2023-07-13T13:52:24.879724+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T13:52:24.879724+0000","last_undegraded":"2023-07-13T13:52:24.879724+0000","last_fullsized":"2023-07-13T13:52:24.879724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:16:20.785254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879350+0000","last_change":"2023-07-13T13:52:17.925281+0000","last_active":"2023-07-13T13:52:24.879350+0000","last_peered":"2023-07-13T13:52:24.879350+0000","last_clean":"2023-07-13T13:52:24.879350+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T13:52:24.879350+0000","last_undegraded":"2023-07-13T13:52:24.879350+0000","last_fullsized":"2023-07-13T13:52:24.879350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:02.191186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891831+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T13:52:24.891831+0000","last_peered":"2023-07-13T13:52:24.891831+0000","last_clean":"2023-07-13T13:52:24.891831+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T13:52:24.891831+0000","last_undegraded":"2023-07-13T13:52:24.891831+0000","last_fullsized":"2023-07-13T13:52:24.891831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:35:42.802232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927618+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T13:52:24.927618+0000","last_peered":"2023-07-13T13:52:24.927618+0000","last_clean":"2023-07-13T13:52:24.927618+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T13:52:24.927618+0000","last_undegraded":"2023-07-13T13:52:24.927618+0000","last_fullsized":"2023-07-13T13:52:24.927618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:38.871196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927419+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T13:52:24.927419+0000","last_peered":"2023-07-13T13:52:24.927419+0000","last_clean":"2023-07-13T13:52:24.927419+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T13:52:24.927419+0000","last_undegraded":"2023-07-13T13:52:24.927419+0000","last_fullsized":"2023-07-13T13:52:24.927419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:37:29.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927179+0000","last_change":"2023-07-13T13:52:17.933894+0000","last_active":"2023-07-13T13:52:24.927179+0000","last_peered":"2023-07-13T13:52:24.927179+0000","last_clean":"2023-07-13T13:52:24.927179+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T13:52:24.927179+0000","last_undegraded":"2023-07-13T13:52:24.927179+0000","last_fullsized":"2023-07-13T13:52:24.927179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:55:58.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879592+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T13:52:24.879592+0000","last_peered":"2023-07-13T13:52:24.879592+0000","last_clean":"2023-07-13T13:52:24.879592+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T13:52:24.879592+0000","last_undegraded":"2023-07-13T13:52:24.879592+0000","last_fullsized":"2023-07-13T13:52:24.879592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:05:06.705721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928085+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T13:52:24.928085+0000","last_peered":"2023-07-13T13:52:24.928085+0000","last_clean":"2023-07-13T13:52:24.928085+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T13:52:24.928085+0000","last_undegraded":"2023-07-13T13:52:24.928085+0000","last_fullsized":"2023-07-13T13:52:24.928085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:03:23.227917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879302+0000","last_change":"2023-07-13T13:52:17.838377+0000","last_active":"2023-07-13T13:52:24.879302+0000","last_peered":"2023-07-13T13:52:24.879302+0000","last_clean":"2023-07-13T13:52:24.879302+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T13:52:24.879302+0000","last_undegraded":"2023-07-13T13:52:24.879302+0000","last_fullsized":"2023-07-13T13:52:24.879302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:37.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892135+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T13:52:24.892135+0000","last_peered":"2023-07-13T13:52:24.892135+0000","last_clean":"2023-07-13T13:52:24.892135+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T13:52:24.892135+0000","last_undegraded":"2023-07-13T13:52:24.892135+0000","last_fullsized":"2023-07-13T13:52:24.892135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:34:06.937251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":722199,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":718771,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 13:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":127911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.439}]},{"osd":2,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.372}]},{"osd":4,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.621},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.503}]},{"osd":7,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.84299999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":131671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":128473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T13:52:58.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T13:52:58.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.828+0000 7f0f4568f700 1 Processor -- start 2023-07-13T13:52:58.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.828+0000 7f0f4568f700 1 -- start start 2023-07-13T13:52:58.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.829+0000 7f0f4568f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f40150690 0x7f0f401599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.829+0000 7f0f4568f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f40071a40 con 0x7f0f400c1ab0 2023-07-13T13:52:58.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.829+0000 7f0f4568f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f40071d00 con 0x7f0f400c55b0 2023-07-13T13:52:58.801 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.829+0000 7f0f4568f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400708f0 con 0x7f0f40150690 2023-07-13T13:52:58.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.832+0000 7f0f3e7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0f400c55b0 0x7f0f400c4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43016/0 (socket says 172.21.15.118:43016) 2023-07-13T13:52:58.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.832+0000 7f0f3e7fc700 1 -- 172.21.15.118:0/2167450649 learned_addr learned my addr 172.21.15.118:0/2167450649 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:58.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.832+0000 7f0f3effd700 1 --2- 172.21.15.118:0/2167450649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f40150690 0x7f0f401599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.880+0000 7f0f3effd700 1 -- 172.21.15.118:0/2167450649 >> v1:172.21.15.123:6789/0 conn(0x7f0f400c55b0 legacy=0x7f0f400c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.880+0000 7f0f3effd700 1 -- 172.21.15.118:0/2167450649 >> v1:172.21.15.118:6789/0 conn(0x7f0f400c1ab0 legacy=0x7f0f40160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:58.853 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.880+0000 7f0f3effd700 1 -- 172.21.15.118:0/2167450649 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f40071fc0 con 0x7f0f40150690 2023-07-13T13:52:58.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.885+0000 7f0f3effd700 1 --2- 172.21.15.118:0/2167450649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f40150690 0x7f0f401599a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009870 tx=0x7f0f30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfed5f8a72844f98 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:58.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.893+0000 7f0f3dffb700 1 -- 172.21.15.118:0/2167450649 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30004230 con 0x7f0f40150690 2023-07-13T13:52:58.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.894+0000 7f0f3dffb700 1 -- 172.21.15.118:0/2167450649 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f30004390 con 0x7f0f40150690 2023-07-13T13:52:58.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.895+0000 7f0f3dffb700 1 -- 172.21.15.118:0/2167450649 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300036a0 con 0x7f0f40150690 2023-07-13T13:52:58.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.895+0000 7f0f4568f700 1 -- 172.21.15.118:0/2167450649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f40150690 msgr2=0x7f0f401599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.895+0000 7f0f4568f700 1 --2- 172.21.15.118:0/2167450649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f40150690 0x7f0f401599a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009870 tx=0x7f0f30009b80 comp rx=0 tx=0).stop 2023-07-13T13:52:58.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.895+0000 7f0f4568f700 1 -- 172.21.15.118:0/2167450649 shutdown_connections 2023-07-13T13:52:58.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.895+0000 7f0f4568f700 1 --2- 172.21.15.118:0/2167450649 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f40150690 0x7f0f401599a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.895+0000 7f0f4568f700 1 -- 172.21.15.118:0/2167450649 >> 172.21.15.118:0/2167450649 conn(0x7f0f400cb880 msgr2=0x7f0f400c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:58.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.895+0000 7f0f4568f700 1 -- 172.21.15.118:0/2167450649 shutdown_connections 2023-07-13T13:52:58.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.895+0000 7f0f4568f700 1 -- 172.21.15.118:0/2167450649 wait complete. 2023-07-13T13:52:58.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.897+0000 7f0f4568f700 1 Processor -- start 2023-07-13T13:52:58.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.897+0000 7f0f4568f700 1 -- start start 2023-07-13T13:52:58.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.897+0000 7f0f4568f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f400c1ab0 0x7f0f40144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.897+0000 7f0f4568f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f400c55b0 0x7f0f4014f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.897+0000 7f0f4568f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f40150690 0x7f0f401575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:58.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.897+0000 7f0f4568f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40156b20 con 0x7f0f40150690 2023-07-13T13:52:58.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.897+0000 7f0f4568f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4014f610 con 0x7f0f400c55b0 2023-07-13T13:52:58.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.897+0000 7f0f4568f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f400c6720 con 0x7f0f400c1ab0 2023-07-13T13:52:58.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.898+0000 7f0f3e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f400c55b0 0x7f0f4014f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.898+0000 7f0f3f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f40150690 0x7f0f401575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.898+0000 7f0f3effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f400c1ab0 0x7f0f40144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:58.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.898+0000 7f0f3e7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f400c55b0 0x7f0f4014f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:48554/0 (socket says 172.21.15.118:48554) 2023-07-13T13:52:58.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.898+0000 7f0f3e7fc700 1 -- 172.21.15.118:0/3069631993 learned_addr learned my addr 172.21.15.118:0/3069631993 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:58.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.903+0000 7f0f3e7fc700 1 -- 172.21.15.118:0/3069631993 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f400c1ab0 msgr2=0x7f0f40144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.903+0000 7f0f3e7fc700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f400c1ab0 0x7f0f40144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.903+0000 7f0f3e7fc700 1 -- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f40150690 msgr2=0x7f0f401575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:58.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.903+0000 7f0f3e7fc700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f40150690 0x7f0f401575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:58.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.903+0000 7f0f3e7fc700 1 -- 172.21.15.118:0/3069631993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300094a0 con 0x7f0f400c55b0 2023-07-13T13:52:58.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.905+0000 7f0f3e7fc700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f400c55b0 0x7f0f4014f0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c500 tx=0x7f0f3400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.909+0000 7f0f277fe700 1 -- 172.21.15.118:0/3069631993 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34005d70 con 0x7f0f400c55b0 2023-07-13T13:52:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.909+0000 7f0f277fe700 1 -- 172.21.15.118:0/3069631993 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3400ce70 con 0x7f0f400c55b0 2023-07-13T13:52:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.909+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f401590c0 con 0x7f0f400c55b0 2023-07-13T13:52:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.909+0000 7f0f277fe700 1 -- 172.21.15.118:0/3069631993 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f340072f0 con 0x7f0f400c55b0 2023-07-13T13:52:58.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.909+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f400c74c0 con 0x7f0f400c55b0 2023-07-13T13:52:58.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:58.910+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4006b970 con 0x7f0f400c55b0 2023-07-13T13:52:59.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.156+0000 7f0f277fe700 1 -- 172.21.15.118:0/3069631993 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f34007450 con 0x7f0f400c55b0 2023-07-13T13:52:59.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.156+0000 7f0f277fe700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0f2c06ad10 0x7f0f2c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:59.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.157+0000 7f0f3effd700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0f2c06ad10 0x7f0f2c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:59.129 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.157+0000 7f0f3effd700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0f2c06ad10 0x7f0f2c06d1c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f300090b0 tx=0x7f0f30008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:59.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.161+0000 7f0f277fe700 1 -- 172.21.15.118:0/3069631993 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f3405b9a0 con 0x7f0f400c55b0 2023-07-13T13:52:59.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.170+0000 7f0f277fe700 1 -- 172.21.15.118:0/3069631993 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f34053d20 con 0x7f0f400c55b0 2023-07-13T13:52:59.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.349+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f40156740 con 0x7f0f2c06ad10 2023-07-13T13:52:59.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.358+0000 7f0f277fe700 1 -- 172.21.15.118:0/3069631993 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370761 (secure 0 0 0) 0x7f0f30004500 con 0x7f0f2c06ad10 2023-07-13T13:52:59.337 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:52:59.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0f2c06ad10 msgr2=0x7f0f2c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:59.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0f2c06ad10 0x7f0f2c06d1c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f300090b0 tx=0x7f0f30008030 comp rx=0 tx=0).stop 2023-07-13T13:52:59.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f400c55b0 msgr2=0x7f0f4014f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:59.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f400c55b0 0x7f0f4014f0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c500 tx=0x7f0f3400c810 comp rx=0 tx=0).stop 2023-07-13T13:52:59.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 shutdown_connections 2023-07-13T13:52:59.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0f2c06ad10 0x7f0f2c06d1c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f40150690 0x7f0f401575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f400c1ab0 0x7f0f40144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 --2- 172.21.15.118:0/3069631993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f400c55b0 0x7f0f4014f0d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 >> 172.21.15.118:0/3069631993 conn(0x7f0f400cb880 msgr2=0x7f0f400c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:59.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 shutdown_connections 2023-07-13T13:52:59.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.362+0000 7f0f4568f700 1 -- 172.21.15.118:0/3069631993 wait complete. 2023-07-13T13:52:59.343 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T13:52:59.346 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-07-13T13:52:58.927706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218748,"kb_used_data":2592,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755972,"statfs":{"total":773094113280,"available":772870115328,"internally_reserved":0,"allocated":2654208,"data_stored":2212488,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002025"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.812490+0000","last_change":"2023-07-13T13:52:17.926057+0000","last_active":"2023-07-13T13:52:56.812490+0000","last_peered":"2023-07-13T13:52:56.812490+0000","last_clean":"2023-07-13T13:52:56.812490+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T13:52:56.812490+0000","last_undegraded":"2023-07-13T13:52:56.812490+0000","last_fullsized":"2023-07-13T13:52:56.812490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:15:51.471433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832308+0000","last_change":"2023-07-13T13:52:17.952706+0000","last_active":"2023-07-13T13:52:56.832308+0000","last_peered":"2023-07-13T13:52:56.832308+0000","last_clean":"2023-07-13T13:52:56.832308+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T13:52:56.832308+0000","last_undegraded":"2023-07-13T13:52:56.832308+0000","last_fullsized":"2023-07-13T13:52:56.832308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:27.813368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928336+0000","last_change":"2023-07-13T13:52:17.943505+0000","last_active":"2023-07-13T13:52:24.928336+0000","last_peered":"2023-07-13T13:52:24.928336+0000","last_clean":"2023-07-13T13:52:24.928336+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T13:52:24.928336+0000","last_undegraded":"2023-07-13T13:52:24.928336+0000","last_fullsized":"2023-07-13T13:52:24.928336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:42.655686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927626+0000","last_change":"2023-07-13T13:52:17.933893+0000","last_active":"2023-07-13T13:52:24.927626+0000","last_peered":"2023-07-13T13:52:24.927626+0000","last_clean":"2023-07-13T13:52:24.927626+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T13:52:24.927626+0000","last_undegraded":"2023-07-13T13:52:24.927626+0000","last_fullsized":"2023-07-13T13:52:24.927626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:13:20.456240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927809+0000","last_change":"2023-07-13T13:52:17.886730+0000","last_active":"2023-07-13T13:52:24.927809+0000","last_peered":"2023-07-13T13:52:24.927809+0000","last_clean":"2023-07-13T13:52:24.927809+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T13:52:24.927809+0000","last_undegraded":"2023-07-13T13:52:24.927809+0000","last_fullsized":"2023-07-13T13:52:24.927809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:35:09.042667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927978+0000","last_change":"2023-07-13T13:52:17.942599+0000","last_active":"2023-07-13T13:52:24.927978+0000","last_peered":"2023-07-13T13:52:24.927978+0000","last_clean":"2023-07-13T13:52:24.927978+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T13:52:24.927978+0000","last_undegraded":"2023-07-13T13:52:24.927978+0000","last_fullsized":"2023-07-13T13:52:24.927978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:32.256216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824386+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T13:52:56.824386+0000","last_peered":"2023-07-13T13:52:56.824386+0000","last_clean":"2023-07-13T13:52:56.824386+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T13:52:56.824386+0000","last_undegraded":"2023-07-13T13:52:56.824386+0000","last_fullsized":"2023-07-13T13:52:56.824386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:26.344890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.831801+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T13:52:56.831801+0000","last_peered":"2023-07-13T13:52:56.831801+0000","last_clean":"2023-07-13T13:52:56.831801+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T13:52:56.831801+0000","last_undegraded":"2023-07-13T13:52:56.831801+0000","last_fullsized":"2023-07-13T13:52:56.831801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:54:00.921870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927391+0000","last_change":"2023-07-13T13:52:17.887431+0000","last_active":"2023-07-13T13:52:24.927391+0000","last_peered":"2023-07-13T13:52:24.927391+0000","last_clean":"2023-07-13T13:52:24.927391+0000","last_became_active":"2023-07-13T13:52:17.887217+0000","last_became_peered":"2023-07-13T13:52:17.887217+0000","last_unstale":"2023-07-13T13:52:24.927391+0000","last_undegraded":"2023-07-13T13:52:24.927391+0000","last_fullsized":"2023-07-13T13:52:24.927391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:42:21.528797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832692+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T13:52:56.832692+0000","last_peered":"2023-07-13T13:52:56.832692+0000","last_clean":"2023-07-13T13:52:56.832692+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T13:52:56.832692+0000","last_undegraded":"2023-07-13T13:52:56.832692+0000","last_fullsized":"2023-07-13T13:52:56.832692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:07:44.633939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928606+0000","last_change":"2023-07-13T13:52:17.951567+0000","last_active":"2023-07-13T13:52:24.928606+0000","last_peered":"2023-07-13T13:52:24.928606+0000","last_clean":"2023-07-13T13:52:24.928606+0000","last_became_active":"2023-07-13T13:52:17.951313+0000","last_became_peered":"2023-07-13T13:52:17.951313+0000","last_unstale":"2023-07-13T13:52:24.928606+0000","last_undegraded":"2023-07-13T13:52:24.928606+0000","last_fullsized":"2023-07-13T13:52:24.928606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:38:28.382470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811100+0000","last_change":"2023-07-13T13:52:17.943253+0000","last_active":"2023-07-13T13:52:56.811100+0000","last_peered":"2023-07-13T13:52:56.811100+0000","last_clean":"2023-07-13T13:52:56.811100+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T13:52:56.811100+0000","last_undegraded":"2023-07-13T13:52:56.811100+0000","last_fullsized":"2023-07-13T13:52:56.811100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:47:54.607847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.810807+0000","last_change":"2023-07-13T13:52:17.925230+0000","last_active":"2023-07-13T13:52:56.810807+0000","last_peered":"2023-07-13T13:52:56.810807+0000","last_clean":"2023-07-13T13:52:56.810807+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T13:52:56.810807+0000","last_undegraded":"2023-07-13T13:52:56.810807+0000","last_fullsized":"2023-07-13T13:52:56.810807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:44:42.006637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.831969+0000","last_change":"2023-07-13T13:52:17.925445+0000","last_active":"2023-07-13T13:52:56.831969+0000","last_peered":"2023-07-13T13:52:56.831969+0000","last_clean":"2023-07-13T13:52:56.831969+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T13:52:56.831969+0000","last_undegraded":"2023-07-13T13:52:56.831969+0000","last_fullsized":"2023-07-13T13:52:56.831969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:10:58.673480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824291+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T13:52:56.824291+0000","last_peered":"2023-07-13T13:52:56.824291+0000","last_clean":"2023-07-13T13:52:56.824291+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T13:52:56.824291+0000","last_undegraded":"2023-07-13T13:52:56.824291+0000","last_fullsized":"2023-07-13T13:52:56.824291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:27:45.905189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927178+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T13:52:24.927178+0000","last_peered":"2023-07-13T13:52:24.927178+0000","last_clean":"2023-07-13T13:52:24.927178+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T13:52:24.927178+0000","last_undegraded":"2023-07-13T13:52:24.927178+0000","last_fullsized":"2023-07-13T13:52:24.927178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:44:32.655763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927416+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T13:52:24.927416+0000","last_peered":"2023-07-13T13:52:24.927416+0000","last_clean":"2023-07-13T13:52:24.927416+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T13:52:24.927416+0000","last_undegraded":"2023-07-13T13:52:24.927416+0000","last_fullsized":"2023-07-13T13:52:24.927416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:56:45.107513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928765+0000","last_change":"2023-07-13T13:52:17.942704+0000","last_active":"2023-07-13T13:52:24.928765+0000","last_peered":"2023-07-13T13:52:24.928765+0000","last_clean":"2023-07-13T13:52:24.928765+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T13:52:24.928765+0000","last_undegraded":"2023-07-13T13:52:24.928765+0000","last_fullsized":"2023-07-13T13:52:24.928765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:12.764288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.810954+0000","last_change":"2023-07-13T13:52:17.934990+0000","last_active":"2023-07-13T13:52:56.810954+0000","last_peered":"2023-07-13T13:52:56.810954+0000","last_clean":"2023-07-13T13:52:56.810954+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T13:52:56.810954+0000","last_undegraded":"2023-07-13T13:52:56.810954+0000","last_fullsized":"2023-07-13T13:52:56.810954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:45:21.747666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928683+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T13:52:24.928683+0000","last_peered":"2023-07-13T13:52:24.928683+0000","last_clean":"2023-07-13T13:52:24.928683+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T13:52:24.928683+0000","last_undegraded":"2023-07-13T13:52:24.928683+0000","last_fullsized":"2023-07-13T13:52:24.928683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:25:08.080128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824449+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T13:52:56.824449+0000","last_peered":"2023-07-13T13:52:56.824449+0000","last_clean":"2023-07-13T13:52:56.824449+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T13:52:56.824449+0000","last_undegraded":"2023-07-13T13:52:56.824449+0000","last_fullsized":"2023-07-13T13:52:56.824449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:45:11.763527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927206+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T13:52:24.927206+0000","last_peered":"2023-07-13T13:52:24.927206+0000","last_clean":"2023-07-13T13:52:24.927206+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T13:52:24.927206+0000","last_undegraded":"2023-07-13T13:52:24.927206+0000","last_fullsized":"2023-07-13T13:52:24.927206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:35:36.595395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879195+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T13:52:24.879195+0000","last_peered":"2023-07-13T13:52:24.879195+0000","last_clean":"2023-07-13T13:52:24.879195+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T13:52:24.879195+0000","last_undegraded":"2023-07-13T13:52:24.879195+0000","last_fullsized":"2023-07-13T13:52:24.879195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:05.503930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824441+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T13:52:56.824441+0000","last_peered":"2023-07-13T13:52:56.824441+0000","last_clean":"2023-07-13T13:52:56.824441+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T13:52:56.824441+0000","last_undegraded":"2023-07-13T13:52:56.824441+0000","last_fullsized":"2023-07-13T13:52:56.824441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:18:31.628279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892101+0000","last_change":"2023-07-13T13:52:17.951443+0000","last_active":"2023-07-13T13:52:24.892101+0000","last_peered":"2023-07-13T13:52:24.892101+0000","last_clean":"2023-07-13T13:52:24.892101+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T13:52:24.892101+0000","last_undegraded":"2023-07-13T13:52:24.892101+0000","last_fullsized":"2023-07-13T13:52:24.892101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:15:13.905216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892221+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T13:52:24.892221+0000","last_peered":"2023-07-13T13:52:24.892221+0000","last_clean":"2023-07-13T13:52:24.892221+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T13:52:24.892221+0000","last_undegraded":"2023-07-13T13:52:24.892221+0000","last_fullsized":"2023-07-13T13:52:24.892221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:25:07.338467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832435+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T13:52:56.832435+0000","last_peered":"2023-07-13T13:52:56.832435+0000","last_clean":"2023-07-13T13:52:56.832435+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T13:52:56.832435+0000","last_undegraded":"2023-07-13T13:52:56.832435+0000","last_fullsized":"2023-07-13T13:52:56.832435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:05:05.424970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928347+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T13:52:24.928347+0000","last_peered":"2023-07-13T13:52:24.928347+0000","last_clean":"2023-07-13T13:52:24.928347+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T13:52:24.928347+0000","last_undegraded":"2023-07-13T13:52:24.928347+0000","last_fullsized":"2023-07-13T13:52:24.928347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:16:27.502582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927905+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T13:52:24.927905+0000","last_peered":"2023-07-13T13:52:24.927905+0000","last_clean":"2023-07-13T13:52:24.927905+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T13:52:24.927905+0000","last_undegraded":"2023-07-13T13:52:24.927905+0000","last_fullsized":"2023-07-13T13:52:24.927905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.301671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879893+0000","last_change":"2023-07-13T13:52:17.948432+0000","last_active":"2023-07-13T13:52:24.879893+0000","last_peered":"2023-07-13T13:52:24.879893+0000","last_clean":"2023-07-13T13:52:24.879893+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T13:52:24.879893+0000","last_undegraded":"2023-07-13T13:52:24.879893+0000","last_fullsized":"2023-07-13T13:52:24.879893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:56:28.970102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927636+0000","last_change":"2023-07-13T13:52:23.984769+0000","last_active":"2023-07-13T13:52:24.927636+0000","last_peered":"2023-07-13T13:52:24.927636+0000","last_clean":"2023-07-13T13:52:24.927636+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T13:52:24.927636+0000","last_undegraded":"2023-07-13T13:52:24.927636+0000","last_fullsized":"2023-07-13T13:52:24.927636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:04:41.174657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891603+0000","last_change":"2023-07-13T13:52:16.667863+0000","last_active":"2023-07-13T13:52:24.891603+0000","last_peered":"2023-07-13T13:52:24.891603+0000","last_clean":"2023-07-13T13:52:24.891603+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T13:52:24.891603+0000","last_undegraded":"2023-07-13T13:52:24.891603+0000","last_fullsized":"2023-07-13T13:52:24.891603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:26:34.960591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927548+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T13:52:24.927548+0000","last_peered":"2023-07-13T13:52:24.927548+0000","last_clean":"2023-07-13T13:52:24.927548+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T13:52:24.927548+0000","last_undegraded":"2023-07-13T13:52:24.927548+0000","last_fullsized":"2023-07-13T13:52:24.927548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:34:06.937251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927832+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T13:52:24.927832+0000","last_peered":"2023-07-13T13:52:24.927832+0000","last_clean":"2023-07-13T13:52:24.927832+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T13:52:24.927832+0000","last_undegraded":"2023-07-13T13:52:24.927832+0000","last_fullsized":"2023-07-13T13:52:24.927832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:44:38.213490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879435+0000","last_change":"2023-07-13T13:52:16.607515+0000","last_active":"2023-07-13T13:52:24.879435+0000","last_peered":"2023-07-13T13:52:24.879435+0000","last_clean":"2023-07-13T13:52:24.879435+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T13:52:24.879435+0000","last_undegraded":"2023-07-13T13:52:24.879435+0000","last_fullsized":"2023-07-13T13:52:24.879435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:24:27.668099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927817+0000","last_change":"2023-07-13T13:52:17.934538+0000","last_active":"2023-07-13T13:52:24.927817+0000","last_peered":"2023-07-13T13:52:24.927817+0000","last_clean":"2023-07-13T13:52:24.927817+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T13:52:24.927817+0000","last_undegraded":"2023-07-13T13:52:24.927817+0000","last_fullsized":"2023-07-13T13:52:24.927817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:55:29.065632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927005+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T13:52:24.927005+0000","last_peered":"2023-07-13T13:52:24.927005+0000","last_clean":"2023-07-13T13:52:24.927005+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T13:52:24.927005+0000","last_undegraded":"2023-07-13T13:52:24.927005+0000","last_fullsized":"2023-07-13T13:52:24.927005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:54:23.868141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927512+0000","last_change":"2023-07-13T13:52:16.668908+0000","last_active":"2023-07-13T13:52:24.927512+0000","last_peered":"2023-07-13T13:52:24.927512+0000","last_clean":"2023-07-13T13:52:24.927512+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T13:52:24.927512+0000","last_undegraded":"2023-07-13T13:52:24.927512+0000","last_fullsized":"2023-07-13T13:52:24.927512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:15:12.759166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879407+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T13:52:24.879407+0000","last_peered":"2023-07-13T13:52:24.879407+0000","last_clean":"2023-07-13T13:52:24.879407+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T13:52:24.879407+0000","last_undegraded":"2023-07-13T13:52:24.879407+0000","last_fullsized":"2023-07-13T13:52:24.879407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:11:59.869006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824157+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T13:52:56.824157+0000","last_peered":"2023-07-13T13:52:56.824157+0000","last_clean":"2023-07-13T13:52:56.824157+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T13:52:56.824157+0000","last_undegraded":"2023-07-13T13:52:56.824157+0000","last_fullsized":"2023-07-13T13:52:56.824157+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:47:51.181841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832510+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T13:52:56.832510+0000","last_peered":"2023-07-13T13:52:56.832510+0000","last_clean":"2023-07-13T13:52:56.832510+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T13:52:56.832510+0000","last_undegraded":"2023-07-13T13:52:56.832510+0000","last_fullsized":"2023-07-13T13:52:56.832510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:47.823453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879193+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T13:52:24.879193+0000","last_peered":"2023-07-13T13:52:24.879193+0000","last_clean":"2023-07-13T13:52:24.879193+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T13:52:24.879193+0000","last_undegraded":"2023-07-13T13:52:24.879193+0000","last_fullsized":"2023-07-13T13:52:24.879193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:11.920803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879638+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T13:52:24.879638+0000","last_peered":"2023-07-13T13:52:24.879638+0000","last_clean":"2023-07-13T13:52:24.879638+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T13:52:24.879638+0000","last_undegraded":"2023-07-13T13:52:24.879638+0000","last_fullsized":"2023-07-13T13:52:24.879638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:40:03.468109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824722+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T13:52:56.824722+0000","last_peered":"2023-07-13T13:52:56.824722+0000","last_clean":"2023-07-13T13:52:56.824722+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T13:52:56.824722+0000","last_undegraded":"2023-07-13T13:52:56.824722+0000","last_fullsized":"2023-07-13T13:52:56.824722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:05:04.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892115+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T13:52:24.892115+0000","last_peered":"2023-07-13T13:52:24.892115+0000","last_clean":"2023-07-13T13:52:24.892115+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T13:52:24.892115+0000","last_undegraded":"2023-07-13T13:52:24.892115+0000","last_fullsized":"2023-07-13T13:52:24.892115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:45:09.342439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891618+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T13:52:24.891618+0000","last_peered":"2023-07-13T13:52:24.891618+0000","last_clean":"2023-07-13T13:52:24.891618+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T13:52:24.891618+0000","last_undegraded":"2023-07-13T13:52:24.891618+0000","last_fullsized":"2023-07-13T13:52:24.891618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:54:40.996212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:33.640166+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T13:52:33.640166+0000","last_peered":"2023-07-13T13:52:33.640166+0000","last_clean":"2023-07-13T13:52:33.640166+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T13:52:33.640166+0000","last_undegraded":"2023-07-13T13:52:33.640166+0000","last_fullsized":"2023-07-13T13:52:33.640166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:47:20.741487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928282+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T13:52:24.928282+0000","last_peered":"2023-07-13T13:52:24.928282+0000","last_clean":"2023-07-13T13:52:24.928282+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T13:52:24.928282+0000","last_undegraded":"2023-07-13T13:52:24.928282+0000","last_fullsized":"2023-07-13T13:52:24.928282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:37:56.904122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832132+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T13:52:56.832132+0000","last_peered":"2023-07-13T13:52:56.832132+0000","last_clean":"2023-07-13T13:52:56.832132+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T13:52:56.832132+0000","last_undegraded":"2023-07-13T13:52:56.832132+0000","last_fullsized":"2023-07-13T13:52:56.832132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:22:11.643832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824530+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T13:52:56.824530+0000","last_peered":"2023-07-13T13:52:56.824530+0000","last_clean":"2023-07-13T13:52:56.824530+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T13:52:56.824530+0000","last_undegraded":"2023-07-13T13:52:56.824530+0000","last_fullsized":"2023-07-13T13:52:56.824530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:32:12.663193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879700+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T13:52:24.879700+0000","last_peered":"2023-07-13T13:52:24.879700+0000","last_clean":"2023-07-13T13:52:24.879700+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T13:52:24.879700+0000","last_undegraded":"2023-07-13T13:52:24.879700+0000","last_fullsized":"2023-07-13T13:52:24.879700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:11:25.930718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879777+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T13:52:24.879777+0000","last_peered":"2023-07-13T13:52:24.879777+0000","last_clean":"2023-07-13T13:52:24.879777+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T13:52:24.879777+0000","last_undegraded":"2023-07-13T13:52:24.879777+0000","last_fullsized":"2023-07-13T13:52:24.879777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:11:10.845693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927068+0000","last_change":"2023-07-13T13:52:16.663350+0000","last_active":"2023-07-13T13:52:24.927068+0000","last_peered":"2023-07-13T13:52:24.927068+0000","last_clean":"2023-07-13T13:52:24.927068+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T13:52:24.927068+0000","last_undegraded":"2023-07-13T13:52:24.927068+0000","last_fullsized":"2023-07-13T13:52:24.927068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:16:40.928511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832382+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T13:52:56.832382+0000","last_peered":"2023-07-13T13:52:56.832382+0000","last_clean":"2023-07-13T13:52:56.832382+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T13:52:56.832382+0000","last_undegraded":"2023-07-13T13:52:56.832382+0000","last_fullsized":"2023-07-13T13:52:56.832382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:04:43.546347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879939+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T13:52:24.879939+0000","last_peered":"2023-07-13T13:52:24.879939+0000","last_clean":"2023-07-13T13:52:24.879939+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T13:52:24.879939+0000","last_undegraded":"2023-07-13T13:52:24.879939+0000","last_fullsized":"2023-07-13T13:52:24.879939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:22:04.157829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824260+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T13:52:56.824260+0000","last_peered":"2023-07-13T13:52:56.824260+0000","last_clean":"2023-07-13T13:52:56.824260+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T13:52:56.824260+0000","last_undegraded":"2023-07-13T13:52:56.824260+0000","last_fullsized":"2023-07-13T13:52:56.824260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:10:57.527430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927667+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T13:52:24.927667+0000","last_peered":"2023-07-13T13:52:24.927667+0000","last_clean":"2023-07-13T13:52:24.927667+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T13:52:24.927667+0000","last_undegraded":"2023-07-13T13:52:24.927667+0000","last_fullsized":"2023-07-13T13:52:24.927667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:36:21.525254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832183+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T13:52:56.832183+0000","last_peered":"2023-07-13T13:52:56.832183+0000","last_clean":"2023-07-13T13:52:56.832183+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T13:52:56.832183+0000","last_undegraded":"2023-07-13T13:52:56.832183+0000","last_fullsized":"2023-07-13T13:52:56.832183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:19:11.804958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.926948+0000","last_change":"2023-07-13T13:52:16.692808+0000","last_active":"2023-07-13T13:52:24.926948+0000","last_peered":"2023-07-13T13:52:24.926948+0000","last_clean":"2023-07-13T13:52:24.926948+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T13:52:24.926948+0000","last_undegraded":"2023-07-13T13:52:24.926948+0000","last_fullsized":"2023-07-13T13:52:24.926948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:00:42.596139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879892+0000","last_change":"2023-07-13T13:52:17.838408+0000","last_active":"2023-07-13T13:52:24.879892+0000","last_peered":"2023-07-13T13:52:24.879892+0000","last_clean":"2023-07-13T13:52:24.879892+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T13:52:24.879892+0000","last_undegraded":"2023-07-13T13:52:24.879892+0000","last_fullsized":"2023-07-13T13:52:24.879892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:43:05.930281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824438+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T13:52:56.824438+0000","last_peered":"2023-07-13T13:52:56.824438+0000","last_clean":"2023-07-13T13:52:56.824438+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T13:52:56.824438+0000","last_undegraded":"2023-07-13T13:52:56.824438+0000","last_fullsized":"2023-07-13T13:52:56.824438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:19:11.804958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824999+0000","last_change":"2023-07-13T13:52:16.666097+0000","last_active":"2023-07-13T13:52:56.824999+0000","last_peered":"2023-07-13T13:52:56.824999+0000","last_clean":"2023-07-13T13:52:56.824999+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T13:52:56.824999+0000","last_undegraded":"2023-07-13T13:52:56.824999+0000","last_fullsized":"2023-07-13T13:52:56.824999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:07:43.487888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.831674+0000","last_change":"2023-07-13T13:52:17.838908+0000","last_active":"2023-07-13T13:52:56.831674+0000","last_peered":"2023-07-13T13:52:56.831674+0000","last_clean":"2023-07-13T13:52:56.831674+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T13:52:56.831674+0000","last_undegraded":"2023-07-13T13:52:56.831674+0000","last_fullsized":"2023-07-13T13:52:56.831674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:58:17.828294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.809947+0000","last_change":"2023-07-13T13:52:23.993113+0000","last_active":"2023-07-13T13:52:56.809947+0000","last_peered":"2023-07-13T13:52:56.809947+0000","last_clean":"2023-07-13T13:52:56.809947+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T13:52:56.809947+0000","last_undegraded":"2023-07-13T13:52:56.809947+0000","last_fullsized":"2023-07-13T13:52:56.809947+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:32:29.710037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824819+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T13:52:56.824819+0000","last_peered":"2023-07-13T13:52:56.824819+0000","last_clean":"2023-07-13T13:52:56.824819+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T13:52:56.824819+0000","last_undegraded":"2023-07-13T13:52:56.824819+0000","last_fullsized":"2023-07-13T13:52:56.824819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:47.823453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927753+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T13:52:24.927753+0000","last_peered":"2023-07-13T13:52:24.927753+0000","last_clean":"2023-07-13T13:52:24.927753+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T13:52:24.927753+0000","last_undegraded":"2023-07-13T13:52:24.927753+0000","last_fullsized":"2023-07-13T13:52:24.927753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:01:04.196253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.810624+0000","last_change":"2023-07-13T13:52:23.992085+0000","last_active":"2023-07-13T13:52:56.810624+0000","last_peered":"2023-07-13T13:52:56.810624+0000","last_clean":"2023-07-13T13:52:56.810624+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T13:52:56.810624+0000","last_undegraded":"2023-07-13T13:52:56.810624+0000","last_fullsized":"2023-07-13T13:52:56.810624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:43:27.078037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824903+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T13:52:56.824903+0000","last_peered":"2023-07-13T13:52:56.824903+0000","last_clean":"2023-07-13T13:52:56.824903+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T13:52:56.824903+0000","last_undegraded":"2023-07-13T13:52:56.824903+0000","last_fullsized":"2023-07-13T13:52:56.824903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:25:36.691496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927219+0000","last_change":"2023-07-13T13:52:17.952164+0000","last_active":"2023-07-13T13:52:24.927219+0000","last_peered":"2023-07-13T13:52:24.927219+0000","last_clean":"2023-07-13T13:52:24.927219+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T13:52:24.927219+0000","last_undegraded":"2023-07-13T13:52:24.927219+0000","last_fullsized":"2023-07-13T13:52:24.927219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:19.822713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.810466+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T13:52:56.810466+0000","last_peered":"2023-07-13T13:52:56.810466+0000","last_clean":"2023-07-13T13:52:56.810466+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T13:52:56.810466+0000","last_undegraded":"2023-07-13T13:52:56.810466+0000","last_fullsized":"2023-07-13T13:52:56.810466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:24:23.962685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.831925+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T13:52:56.831925+0000","last_peered":"2023-07-13T13:52:56.831925+0000","last_clean":"2023-07-13T13:52:56.831925+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T13:52:56.831925+0000","last_undegraded":"2023-07-13T13:52:56.831925+0000","last_fullsized":"2023-07-13T13:52:56.831925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:47:43.828953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927647+0000","last_change":"2023-07-13T13:52:17.952349+0000","last_active":"2023-07-13T13:52:24.927647+0000","last_peered":"2023-07-13T13:52:24.927647+0000","last_clean":"2023-07-13T13:52:24.927647+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T13:52:24.927647+0000","last_undegraded":"2023-07-13T13:52:24.927647+0000","last_fullsized":"2023-07-13T13:52:24.927647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:25:07.338467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811077+0000","last_change":"2023-07-13T13:52:23.987269+0000","last_active":"2023-07-13T13:52:56.811077+0000","last_peered":"2023-07-13T13:52:56.811077+0000","last_clean":"2023-07-13T13:52:56.811077+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T13:52:56.811077+0000","last_undegraded":"2023-07-13T13:52:56.811077+0000","last_fullsized":"2023-07-13T13:52:56.811077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:38:16.419873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879419+0000","last_change":"2023-07-13T13:52:16.607455+0000","last_active":"2023-07-13T13:52:24.879419+0000","last_peered":"2023-07-13T13:52:24.879419+0000","last_clean":"2023-07-13T13:52:24.879419+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T13:52:24.879419+0000","last_undegraded":"2023-07-13T13:52:24.879419+0000","last_fullsized":"2023-07-13T13:52:24.879419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:08.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928550+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T13:52:24.928550+0000","last_peered":"2023-07-13T13:52:24.928550+0000","last_clean":"2023-07-13T13:52:24.928550+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T13:52:24.928550+0000","last_undegraded":"2023-07-13T13:52:24.928550+0000","last_fullsized":"2023-07-13T13:52:24.928550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:05:24.675504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891810+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T13:52:24.891810+0000","last_peered":"2023-07-13T13:52:24.891810+0000","last_clean":"2023-07-13T13:52:24.891810+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T13:52:24.891810+0000","last_undegraded":"2023-07-13T13:52:24.891810+0000","last_fullsized":"2023-07-13T13:52:24.891810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:16:48.281399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927299+0000","last_change":"2023-07-13T13:52:16.692899+0000","last_active":"2023-07-13T13:52:24.927299+0000","last_peered":"2023-07-13T13:52:24.927299+0000","last_clean":"2023-07-13T13:52:24.927299+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T13:52:24.927299+0000","last_undegraded":"2023-07-13T13:52:24.927299+0000","last_fullsized":"2023-07-13T13:52:24.927299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:32:47.704876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928496+0000","last_change":"2023-07-13T13:52:17.942165+0000","last_active":"2023-07-13T13:52:24.928496+0000","last_peered":"2023-07-13T13:52:24.928496+0000","last_clean":"2023-07-13T13:52:24.928496+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T13:52:24.928496+0000","last_undegraded":"2023-07-13T13:52:24.928496+0000","last_fullsized":"2023-07-13T13:52:24.928496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:12:48.876978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832529+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T13:52:56.832529+0000","last_peered":"2023-07-13T13:52:56.832529+0000","last_clean":"2023-07-13T13:52:56.832529+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T13:52:56.832529+0000","last_undegraded":"2023-07-13T13:52:56.832529+0000","last_fullsized":"2023-07-13T13:52:56.832529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:09:14.270230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927452+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T13:52:24.927452+0000","last_peered":"2023-07-13T13:52:24.927452+0000","last_clean":"2023-07-13T13:52:24.927452+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T13:52:24.927452+0000","last_undegraded":"2023-07-13T13:52:24.927452+0000","last_fullsized":"2023-07-13T13:52:24.927452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:03.894064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929645+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T13:52:24.929645+0000","last_peered":"2023-07-13T13:52:24.929645+0000","last_clean":"2023-07-13T13:52:24.929645+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T13:52:24.929645+0000","last_undegraded":"2023-07-13T13:52:24.929645+0000","last_fullsized":"2023-07-13T13:52:24.929645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:35:22.230584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929592+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T13:52:24.929592+0000","last_peered":"2023-07-13T13:52:24.929592+0000","last_clean":"2023-07-13T13:52:24.929592+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T13:52:24.929592+0000","last_undegraded":"2023-07-13T13:52:24.929592+0000","last_fullsized":"2023-07-13T13:52:24.929592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:00:18.335695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879297+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T13:52:24.879297+0000","last_peered":"2023-07-13T13:52:24.879297+0000","last_clean":"2023-07-13T13:52:24.879297+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T13:52:24.879297+0000","last_undegraded":"2023-07-13T13:52:24.879297+0000","last_fullsized":"2023-07-13T13:52:24.879297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:18.698131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892152+0000","last_change":"2023-07-13T13:52:17.949610+0000","last_active":"2023-07-13T13:52:24.892152+0000","last_peered":"2023-07-13T13:52:24.892152+0000","last_clean":"2023-07-13T13:52:24.892152+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T13:52:24.892152+0000","last_undegraded":"2023-07-13T13:52:24.892152+0000","last_fullsized":"2023-07-13T13:52:24.892152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:40.017246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927555+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T13:52:24.927555+0000","last_peered":"2023-07-13T13:52:24.927555+0000","last_clean":"2023-07-13T13:52:24.927555+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T13:52:24.927555+0000","last_undegraded":"2023-07-13T13:52:24.927555+0000","last_fullsized":"2023-07-13T13:52:24.927555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:45:15.549277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891895+0000","last_change":"2023-07-13T13:51:59.916015+0000","last_active":"2023-07-13T13:52:24.891895+0000","last_peered":"2023-07-13T13:52:24.891895+0000","last_clean":"2023-07-13T13:52:24.891895+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T13:52:24.891895+0000","last_undegraded":"2023-07-13T13:52:24.891895+0000","last_fullsized":"2023-07-13T13:52:24.891895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:58:56.377294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832257+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T13:52:56.832257+0000","last_peered":"2023-07-13T13:52:56.832257+0000","last_clean":"2023-07-13T13:52:56.832257+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T13:52:56.832257+0000","last_undegraded":"2023-07-13T13:52:56.832257+0000","last_fullsized":"2023-07-13T13:52:56.832257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:18:30.482228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891909+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T13:52:24.891909+0000","last_peered":"2023-07-13T13:52:24.891909+0000","last_clean":"2023-07-13T13:52:24.891909+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T13:52:24.891909+0000","last_undegraded":"2023-07-13T13:52:24.891909+0000","last_fullsized":"2023-07-13T13:52:24.891909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:42:21.528797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927325+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T13:52:24.927325+0000","last_peered":"2023-07-13T13:52:24.927325+0000","last_clean":"2023-07-13T13:52:24.927325+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T13:52:24.927325+0000","last_undegraded":"2023-07-13T13:52:24.927325+0000","last_fullsized":"2023-07-13T13:52:24.927325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:59:20.772189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832025+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T13:52:56.832025+0000","last_peered":"2023-07-13T13:52:56.832025+0000","last_clean":"2023-07-13T13:52:56.832025+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T13:52:56.832025+0000","last_undegraded":"2023-07-13T13:52:56.832025+0000","last_fullsized":"2023-07-13T13:52:56.832025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:54:42.578741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928641+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T13:52:24.928641+0000","last_peered":"2023-07-13T13:52:24.928641+0000","last_clean":"2023-07-13T13:52:24.928641+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T13:52:24.928641+0000","last_undegraded":"2023-07-13T13:52:24.928641+0000","last_fullsized":"2023-07-13T13:52:24.928641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:59.268490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891765+0000","last_change":"2023-07-13T13:52:17.947909+0000","last_active":"2023-07-13T13:52:24.891765+0000","last_peered":"2023-07-13T13:52:24.891765+0000","last_clean":"2023-07-13T13:52:24.891765+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T13:52:24.891765+0000","last_undegraded":"2023-07-13T13:52:24.891765+0000","last_fullsized":"2023-07-13T13:52:24.891765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:53:25.856736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811628+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T13:52:56.811628+0000","last_peered":"2023-07-13T13:52:56.811628+0000","last_clean":"2023-07-13T13:52:56.811628+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T13:52:56.811628+0000","last_undegraded":"2023-07-13T13:52:56.811628+0000","last_fullsized":"2023-07-13T13:52:56.811628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:24:06.312873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811239+0000","last_change":"2023-07-13T13:52:01.224691+0000","last_active":"2023-07-13T13:52:56.811239+0000","last_peered":"2023-07-13T13:52:56.811239+0000","last_clean":"2023-07-13T13:52:56.811239+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T13:52:56.811239+0000","last_undegraded":"2023-07-13T13:52:56.811239+0000","last_fullsized":"2023-07-13T13:52:56.811239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:53:16.252001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891536+0000","last_change":"2023-07-13T13:52:16.668065+0000","last_active":"2023-07-13T13:52:24.891536+0000","last_peered":"2023-07-13T13:52:24.891536+0000","last_clean":"2023-07-13T13:52:24.891536+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T13:52:24.891536+0000","last_undegraded":"2023-07-13T13:52:24.891536+0000","last_fullsized":"2023-07-13T13:52:24.891536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:24:28.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892038+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T13:52:24.892038+0000","last_peered":"2023-07-13T13:52:24.892038+0000","last_clean":"2023-07-13T13:52:24.892038+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T13:52:24.892038+0000","last_undegraded":"2023-07-13T13:52:24.892038+0000","last_fullsized":"2023-07-13T13:52:24.892038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:49:06.930579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824507+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T13:52:56.824507+0000","last_peered":"2023-07-13T13:52:56.824507+0000","last_clean":"2023-07-13T13:52:56.824507+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T13:52:56.824507+0000","last_undegraded":"2023-07-13T13:52:56.824507+0000","last_fullsized":"2023-07-13T13:52:56.824507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:34.020205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832434+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T13:52:56.832434+0000","last_peered":"2023-07-13T13:52:56.832434+0000","last_clean":"2023-07-13T13:52:56.832434+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T13:52:56.832434+0000","last_undegraded":"2023-07-13T13:52:56.832434+0000","last_fullsized":"2023-07-13T13:52:56.832434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:44:53.575469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824317+0000","last_change":"2023-07-13T13:51:57.962882+0000","last_active":"2023-07-13T13:52:56.824317+0000","last_peered":"2023-07-13T13:52:56.824317+0000","last_clean":"2023-07-13T13:52:56.824317+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T13:52:56.824317+0000","last_undegraded":"2023-07-13T13:52:56.824317+0000","last_fullsized":"2023-07-13T13:52:56.824317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_clean_scrub_stamp":"2023-07-13T13:51:55.598839+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:54:39.901236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879350+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T13:52:24.879350+0000","last_peered":"2023-07-13T13:52:24.879350+0000","last_clean":"2023-07-13T13:52:24.879350+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T13:52:24.879350+0000","last_undegraded":"2023-07-13T13:52:24.879350+0000","last_fullsized":"2023-07-13T13:52:24.879350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:03:57.800032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927892+0000","last_change":"2023-07-13T13:52:17.942525+0000","last_active":"2023-07-13T13:52:24.927892+0000","last_peered":"2023-07-13T13:52:24.927892+0000","last_clean":"2023-07-13T13:52:24.927892+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T13:52:24.927892+0000","last_undegraded":"2023-07-13T13:52:24.927892+0000","last_fullsized":"2023-07-13T13:52:24.927892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:00:29.156794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832258+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T13:52:56.832258+0000","last_peered":"2023-07-13T13:52:56.832258+0000","last_clean":"2023-07-13T13:52:56.832258+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T13:52:56.832258+0000","last_undegraded":"2023-07-13T13:52:56.832258+0000","last_fullsized":"2023-07-13T13:52:56.832258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:25:44.044383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824567+0000","last_change":"2023-07-13T13:52:00.016430+0000","last_active":"2023-07-13T13:52:56.824567+0000","last_peered":"2023-07-13T13:52:56.824567+0000","last_clean":"2023-07-13T13:52:56.824567+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T13:52:56.824567+0000","last_undegraded":"2023-07-13T13:52:56.824567+0000","last_fullsized":"2023-07-13T13:52:56.824567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:04:25.358290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.926955+0000","last_change":"2023-07-13T13:52:16.630297+0000","last_active":"2023-07-13T13:52:24.926955+0000","last_peered":"2023-07-13T13:52:24.926955+0000","last_clean":"2023-07-13T13:52:24.926955+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T13:52:24.926955+0000","last_undegraded":"2023-07-13T13:52:24.926955+0000","last_fullsized":"2023-07-13T13:52:24.926955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:53:24.710686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927322+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T13:52:24.927322+0000","last_peered":"2023-07-13T13:52:24.927322+0000","last_clean":"2023-07-13T13:52:24.927322+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T13:52:24.927322+0000","last_undegraded":"2023-07-13T13:52:24.927322+0000","last_fullsized":"2023-07-13T13:52:24.927322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:23:18.465639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927124+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T13:52:24.927124+0000","last_peered":"2023-07-13T13:52:24.927124+0000","last_clean":"2023-07-13T13:52:24.927124+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T13:52:24.927124+0000","last_undegraded":"2023-07-13T13:52:24.927124+0000","last_fullsized":"2023-07-13T13:52:24.927124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:15:57.574963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824844+0000","last_change":"2023-07-13T13:52:00.019670+0000","last_active":"2023-07-13T13:52:56.824844+0000","last_peered":"2023-07-13T13:52:56.824844+0000","last_clean":"2023-07-13T13:52:56.824844+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T13:52:56.824844+0000","last_undegraded":"2023-07-13T13:52:56.824844+0000","last_fullsized":"2023-07-13T13:52:56.824844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:08:49.875336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892015+0000","last_change":"2023-07-13T13:52:16.668244+0000","last_active":"2023-07-13T13:52:24.892015+0000","last_peered":"2023-07-13T13:52:24.892015+0000","last_clean":"2023-07-13T13:52:24.892015+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T13:52:24.892015+0000","last_undegraded":"2023-07-13T13:52:24.892015+0000","last_fullsized":"2023-07-13T13:52:24.892015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:56:43.961463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927745+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T13:52:24.927745+0000","last_peered":"2023-07-13T13:52:24.927745+0000","last_clean":"2023-07-13T13:52:24.927745+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T13:52:24.927745+0000","last_undegraded":"2023-07-13T13:52:24.927745+0000","last_fullsized":"2023-07-13T13:52:24.927745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:12:41.254584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.929834+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T13:52:24.929834+0000","last_peered":"2023-07-13T13:52:24.929834+0000","last_clean":"2023-07-13T13:52:24.929834+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T13:52:24.929834+0000","last_undegraded":"2023-07-13T13:52:24.929834+0000","last_fullsized":"2023-07-13T13:52:24.929834+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:37:00.550738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.880010+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T13:52:24.880010+0000","last_peered":"2023-07-13T13:52:24.880010+0000","last_clean":"2023-07-13T13:52:24.880010+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T13:52:24.880010+0000","last_undegraded":"2023-07-13T13:52:24.880010+0000","last_fullsized":"2023-07-13T13:52:24.880010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:13:01.211759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891905+0000","last_change":"2023-07-13T13:51:59.757569+0000","last_active":"2023-07-13T13:52:24.891905+0000","last_peered":"2023-07-13T13:52:24.891905+0000","last_clean":"2023-07-13T13:52:24.891905+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T13:52:24.891905+0000","last_undegraded":"2023-07-13T13:52:24.891905+0000","last_fullsized":"2023-07-13T13:52:24.891905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:23:00.277581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879225+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T13:52:24.879225+0000","last_peered":"2023-07-13T13:52:24.879225+0000","last_clean":"2023-07-13T13:52:24.879225+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T13:52:24.879225+0000","last_undegraded":"2023-07-13T13:52:24.879225+0000","last_fullsized":"2023-07-13T13:52:24.879225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879206+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T13:52:24.879206+0000","last_peered":"2023-07-13T13:52:24.879206+0000","last_clean":"2023-07-13T13:52:24.879206+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T13:52:24.879206+0000","last_undegraded":"2023-07-13T13:52:24.879206+0000","last_fullsized":"2023-07-13T13:52:24.879206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:48.589588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927710+0000","last_change":"2023-07-13T13:52:00.015919+0000","last_active":"2023-07-13T13:52:24.927710+0000","last_peered":"2023-07-13T13:52:24.927710+0000","last_clean":"2023-07-13T13:52:24.927710+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T13:52:24.927710+0000","last_undegraded":"2023-07-13T13:52:24.927710+0000","last_fullsized":"2023-07-13T13:52:24.927710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:46:47.618201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927436+0000","last_change":"2023-07-13T13:52:16.665545+0000","last_active":"2023-07-13T13:52:24.927436+0000","last_peered":"2023-07-13T13:52:24.927436+0000","last_clean":"2023-07-13T13:52:24.927436+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T13:52:24.927436+0000","last_undegraded":"2023-07-13T13:52:24.927436+0000","last_fullsized":"2023-07-13T13:52:24.927436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:49:05.784529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927636+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T13:52:24.927636+0000","last_peered":"2023-07-13T13:52:24.927636+0000","last_clean":"2023-07-13T13:52:24.927636+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T13:52:24.927636+0000","last_undegraded":"2023-07-13T13:52:24.927636+0000","last_fullsized":"2023-07-13T13:52:24.927636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:16:16.297416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892883+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T13:52:24.892883+0000","last_peered":"2023-07-13T13:52:24.892883+0000","last_clean":"2023-07-13T13:52:24.892883+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T13:52:24.892883+0000","last_undegraded":"2023-07-13T13:52:24.892883+0000","last_fullsized":"2023-07-13T13:52:24.892883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:36:27.732091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927759+0000","last_change":"2023-07-13T13:52:16.631174+0000","last_active":"2023-07-13T13:52:24.927759+0000","last_peered":"2023-07-13T13:52:24.927759+0000","last_clean":"2023-07-13T13:52:24.927759+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T13:52:24.927759+0000","last_undegraded":"2023-07-13T13:52:24.927759+0000","last_fullsized":"2023-07-13T13:52:24.927759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:23:47.339702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.811375+0000","last_change":"2023-07-13T13:52:17.952450+0000","last_active":"2023-07-13T13:52:56.811375+0000","last_peered":"2023-07-13T13:52:56.811375+0000","last_clean":"2023-07-13T13:52:56.811375+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T13:52:56.811375+0000","last_undegraded":"2023-07-13T13:52:56.811375+0000","last_fullsized":"2023-07-13T13:52:56.811375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:11:25.398073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.824349+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T13:52:56.824349+0000","last_peered":"2023-07-13T13:52:56.824349+0000","last_clean":"2023-07-13T13:52:56.824349+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T13:52:56.824349+0000","last_undegraded":"2023-07-13T13:52:56.824349+0000","last_fullsized":"2023-07-13T13:52:56.824349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:22:11.643832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832000+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T13:52:56.832000+0000","last_peered":"2023-07-13T13:52:56.832000+0000","last_clean":"2023-07-13T13:52:56.832000+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T13:52:56.832000+0000","last_undegraded":"2023-07-13T13:52:56.832000+0000","last_fullsized":"2023-07-13T13:52:56.832000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:27:44.759139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928459+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T13:52:24.928459+0000","last_peered":"2023-07-13T13:52:24.928459+0000","last_clean":"2023-07-13T13:52:24.928459+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T13:52:24.928459+0000","last_undegraded":"2023-07-13T13:52:24.928459+0000","last_fullsized":"2023-07-13T13:52:24.928459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:32:17.932880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832299+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T13:52:56.832299+0000","last_peered":"2023-07-13T13:52:56.832299+0000","last_clean":"2023-07-13T13:52:56.832299+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T13:52:56.832299+0000","last_undegraded":"2023-07-13T13:52:56.832299+0000","last_fullsized":"2023-07-13T13:52:56.832299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:32:20.016081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-13T13:52:56.832186+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T13:52:56.832186+0000","last_peered":"2023-07-13T13:52:56.832186+0000","last_clean":"2023-07-13T13:52:56.832186+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T13:52:56.832186+0000","last_undegraded":"2023-07-13T13:52:56.832186+0000","last_fullsized":"2023-07-13T13:52:56.832186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:25.198839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927870+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T13:52:24.927870+0000","last_peered":"2023-07-13T13:52:24.927870+0000","last_clean":"2023-07-13T13:52:24.927870+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T13:52:24.927870+0000","last_undegraded":"2023-07-13T13:52:24.927870+0000","last_fullsized":"2023-07-13T13:52:24.927870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:04:57.309588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927014+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T13:52:24.927014+0000","last_peered":"2023-07-13T13:52:24.927014+0000","last_clean":"2023-07-13T13:52:24.927014+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T13:52:24.927014+0000","last_undegraded":"2023-07-13T13:52:24.927014+0000","last_fullsized":"2023-07-13T13:52:24.927014+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:02.313280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879724+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T13:52:24.879724+0000","last_peered":"2023-07-13T13:52:24.879724+0000","last_clean":"2023-07-13T13:52:24.879724+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T13:52:24.879724+0000","last_undegraded":"2023-07-13T13:52:24.879724+0000","last_fullsized":"2023-07-13T13:52:24.879724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:16:20.785254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879350+0000","last_change":"2023-07-13T13:52:17.925281+0000","last_active":"2023-07-13T13:52:24.879350+0000","last_peered":"2023-07-13T13:52:24.879350+0000","last_clean":"2023-07-13T13:52:24.879350+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T13:52:24.879350+0000","last_undegraded":"2023-07-13T13:52:24.879350+0000","last_fullsized":"2023-07-13T13:52:24.879350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:02.191186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.891831+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T13:52:24.891831+0000","last_peered":"2023-07-13T13:52:24.891831+0000","last_clean":"2023-07-13T13:52:24.891831+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T13:52:24.891831+0000","last_undegraded":"2023-07-13T13:52:24.891831+0000","last_fullsized":"2023-07-13T13:52:24.891831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:35:42.802232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927618+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T13:52:24.927618+0000","last_peered":"2023-07-13T13:52:24.927618+0000","last_clean":"2023-07-13T13:52:24.927618+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T13:52:24.927618+0000","last_undegraded":"2023-07-13T13:52:24.927618+0000","last_fullsized":"2023-07-13T13:52:24.927618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:38.871196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927419+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T13:52:24.927419+0000","last_peered":"2023-07-13T13:52:24.927419+0000","last_clean":"2023-07-13T13:52:24.927419+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T13:52:24.927419+0000","last_undegraded":"2023-07-13T13:52:24.927419+0000","last_fullsized":"2023-07-13T13:52:24.927419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:37:29.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.927179+0000","last_change":"2023-07-13T13:52:17.933894+0000","last_active":"2023-07-13T13:52:24.927179+0000","last_peered":"2023-07-13T13:52:24.927179+0000","last_clean":"2023-07-13T13:52:24.927179+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T13:52:24.927179+0000","last_undegraded":"2023-07-13T13:52:24.927179+0000","last_fullsized":"2023-07-13T13:52:24.927179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:55:58.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879592+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T13:52:24.879592+0000","last_peered":"2023-07-13T13:52:24.879592+0000","last_clean":"2023-07-13T13:52:24.879592+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T13:52:24.879592+0000","last_undegraded":"2023-07-13T13:52:24.879592+0000","last_fullsized":"2023-07-13T13:52:24.879592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:05:06.705721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.928085+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T13:52:24.928085+0000","last_peered":"2023-07-13T13:52:24.928085+0000","last_clean":"2023-07-13T13:52:24.928085+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T13:52:24.928085+0000","last_undegraded":"2023-07-13T13:52:24.928085+0000","last_fullsized":"2023-07-13T13:52:24.928085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:03:23.227917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.879302+0000","last_change":"2023-07-13T13:52:17.838377+0000","last_active":"2023-07-13T13:52:24.879302+0000","last_peered":"2023-07-13T13:52:24.879302+0000","last_clean":"2023-07-13T13:52:24.879302+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T13:52:24.879302+0000","last_undegraded":"2023-07-13T13:52:24.879302+0000","last_fullsized":"2023-07-13T13:52:24.879302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:37.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-13T13:52:24.892135+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T13:52:24.892135+0000","last_peered":"2023-07-13T13:52:24.892135+0000","last_clean":"2023-07-13T13:52:24.892135+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T13:52:24.892135+0000","last_undegraded":"2023-07-13T13:52:24.892135+0000","last_fullsized":"2023-07-13T13:52:24.892135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:34:06.937251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":722199,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":718771,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 13:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":127821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":127911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.439}]},{"osd":2,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.372}]},{"osd":4,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.621},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.503}]},{"osd":7,"last update":"Thu Jul 13 13:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.84299999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":131671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":128473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T13:52:59.359 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-13T13:52:59.360 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-13T13:52:59.360 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-13T13:52:59.361 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-13T13:52:59.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.533+0000 7f1d0d093700 1 Processor -- start 2023-07-13T13:52:59.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.533+0000 7f1d0d093700 1 -- start start 2023-07-13T13:52:59.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.534+0000 7f1d0d093700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d08152720 0x7f1d080c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:59.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.534+0000 7f1d0d093700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d080c60b0 0x7f1d080c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:59.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.534+0000 7f1d0d093700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d080c6b50 con 0x7f1d080c6d50 2023-07-13T13:52:59.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.534+0000 7f1d0d093700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d08158820 con 0x7f1d080c60b0 2023-07-13T13:52:59.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.534+0000 7f1d0d093700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d080c85f0 con 0x7f1d08152720 2023-07-13T13:52:59.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.535+0000 7f1d0659c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d080c60b0 0x7f1d080c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:59.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.535+0000 7f1d0759e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1d080c6d50 0x7f1d08158c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43018/0 (socket says 172.21.15.118:43018) 2023-07-13T13:52:59.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.535+0000 7f1d0759e700 1 -- 172.21.15.118:0/2597841111 learned_addr learned my addr 172.21.15.118:0/2597841111 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:52:59.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.535+0000 7f1d06d9d700 1 --2- 172.21.15.118:0/2597841111 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d08152720 0x7f1d080c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:59.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.538+0000 7f1d0659c700 1 -- 172.21.15.118:0/2597841111 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d08152720 msgr2=0x7f1d080c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:52:59.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.538+0000 7f1d0659c700 1 --2- 172.21.15.118:0/2597841111 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d08152720 0x7f1d080c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.538+0000 7f1d0659c700 1 -- 172.21.15.118:0/2597841111 >> v1:172.21.15.123:6789/0 conn(0x7f1d080c6d50 legacy=0x7f1d08158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:59.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.538+0000 7f1d0659c700 1 -- 172.21.15.118:0/2597841111 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0815c6b0 con 0x7f1d080c60b0 2023-07-13T13:52:59.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.539+0000 7f1d0659c700 1 --2- 172.21.15.118:0/2597841111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d080c60b0 0x7f1d080c55b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009840 tx=0x7f1cf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb926e7fc6e290a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:59.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.542+0000 7f1d05d9b700 1 -- 172.21.15.118:0/2597841111 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8011830 con 0x7f1d080c60b0 2023-07-13T13:52:59.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.544+0000 7f1d05d9b700 1 -- 172.21.15.118:0/2597841111 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf8011990 con 0x7f1d080c60b0 2023-07-13T13:52:59.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.544+0000 7f1d05d9b700 1 -- 172.21.15.118:0/2597841111 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8011d20 con 0x7f1d080c60b0 2023-07-13T13:52:59.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.545+0000 7f1d0d093700 1 -- 172.21.15.118:0/2597841111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d080c60b0 msgr2=0x7f1d080c55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:59.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.545+0000 7f1d0d093700 1 --2- 172.21.15.118:0/2597841111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d080c60b0 0x7f1d080c55b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009840 tx=0x7f1cf8009b50 comp rx=0 tx=0).stop 2023-07-13T13:52:59.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.545+0000 7f1d0d093700 1 -- 172.21.15.118:0/2597841111 shutdown_connections 2023-07-13T13:52:59.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.545+0000 7f1d0d093700 1 --2- 172.21.15.118:0/2597841111 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d08152720 0x7f1d080c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.545+0000 7f1d0d093700 1 --2- 172.21.15.118:0/2597841111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d080c60b0 0x7f1d080c55b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.545+0000 7f1d0d093700 1 -- 172.21.15.118:0/2597841111 >> 172.21.15.118:0/2597841111 conn(0x7f1d080cb880 msgr2=0x7f1d080c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:52:59.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.545+0000 7f1d0d093700 1 -- 172.21.15.118:0/2597841111 shutdown_connections 2023-07-13T13:52:59.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.545+0000 7f1d0d093700 1 -- 172.21.15.118:0/2597841111 wait complete. 2023-07-13T13:52:59.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.546+0000 7f1d0d093700 1 Processor -- start 2023-07-13T13:52:59.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.546+0000 7f1d0d093700 1 -- start start 2023-07-13T13:52:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.547+0000 7f1d0d093700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d080c60b0 0x7f1d08159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.547+0000 7f1d0d093700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d080c6d50 0x7f1d0814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.547+0000 7f1d0d093700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d08152720 0x7f1d081ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.547+0000 7f1d0d093700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0814d290 con 0x7f1d08152720 2023-07-13T13:52:59.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.547+0000 7f1d0d093700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d081f1350 con 0x7f1d080c6d50 2023-07-13T13:52:59.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.547+0000 7f1d0d093700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0815a3b0 con 0x7f1d080c60b0 2023-07-13T13:52:59.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.548+0000 7f1d0659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d080c6d50 0x7f1d0814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:59.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.548+0000 7f1d06d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d080c60b0 0x7f1d08159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:59.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.548+0000 7f1d06d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d080c60b0 0x7f1d08159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:34870/0 (socket says 172.21.15.118:34870) 2023-07-13T13:52:59.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.548+0000 7f1d06d9d700 1 -- 172.21.15.118:0/236617413 learned_addr learned my addr 172.21.15.118:0/236617413 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:52:59.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.550+0000 7f1d0759e700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d08152720 0x7f1d081ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:59.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.552+0000 7f1d06d9d700 1 -- 172.21.15.118:0/236617413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d080c6d50 msgr2=0x7f1d0814acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:59.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.552+0000 7f1d06d9d700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d080c6d50 0x7f1d0814acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.552+0000 7f1d06d9d700 1 -- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d08152720 msgr2=0x7f1d081ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:52:59.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.552+0000 7f1d06d9d700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d08152720 0x7f1d081ed580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:52:59.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.552+0000 7f1d06d9d700 1 -- 172.21.15.118:0/236617413 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80094a0 con 0x7f1d080c60b0 2023-07-13T13:52:59.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.554+0000 7f1d06d9d700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d080c60b0 0x7f1d08159740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000e870 tx=0x7f1cf000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:59.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.557+0000 7f1cff7fe700 1 -- 172.21.15.118:0/236617413 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0009590 con 0x7f1d080c60b0 2023-07-13T13:52:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.557+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d080c36d0 con 0x7f1d080c60b0 2023-07-13T13:52:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.557+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0815a0d0 con 0x7f1d080c60b0 2023-07-13T13:52:59.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.558+0000 7f1cff7fe700 1 -- 172.21.15.118:0/236617413 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0005a20 con 0x7f1d080c60b0 2023-07-13T13:52:59.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.558+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d080743c0 con 0x7f1d080c60b0 2023-07-13T13:52:59.530 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.558+0000 7f1cff7fe700 1 -- 172.21.15.118:0/236617413 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0005d90 con 0x7f1d080c60b0 2023-07-13T13:52:59.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.809+0000 7f1cff7fe700 1 -- 172.21.15.118:0/236617413 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cf0013680 con 0x7f1d080c60b0 2023-07-13T13:52:59.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.810+0000 7f1cff7fe700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ce806ace0 0x7f1ce806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:52:59.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.810+0000 7f1d0659c700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ce806ace0 0x7f1ce806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:52:59.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.810+0000 7f1d0659c700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ce806ace0 0x7f1ce806d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009840 tx=0x7f1cf801c040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:52:59.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.815+0000 7f1cff7fe700 1 -- 172.21.15.118:0/236617413 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1cf005c360 con 0x7f1d080c60b0 2023-07-13T13:52:59.796 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:52:59.824+0000 7f1cff7fe700 1 -- 172.21.15.118:0/236617413 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1cf00546e0 con 0x7f1d080c60b0 2023-07-13T13:53:00.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.065+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1d080c36d0 con 0x7f1d080c60b0 2023-07-13T13:53:00.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.072+0000 7f1cff7fe700 1 -- 172.21.15.118:0/236617413 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1d080c36d0 con 0x7f1d080c60b0 2023-07-13T13:53:00.044 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:53:00.044 INFO:teuthology.orchestra.run.smithi118.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-13T13:53:00.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ce806ace0 msgr2=0x7f1ce806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ce806ace0 0x7f1ce806d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009840 tx=0x7f1cf801c040 comp rx=0 tx=0).stop 2023-07-13T13:53:00.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d080c60b0 msgr2=0x7f1d08159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d080c60b0 0x7f1d08159740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000e870 tx=0x7f1cf000eb80 comp rx=0 tx=0).stop 2023-07-13T13:53:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 shutdown_connections 2023-07-13T13:53:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1ce806ace0 0x7f1ce806d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d08152720 0x7f1d081ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d080c60b0 0x7f1d08159740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 --2- 172.21.15.118:0/236617413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d080c6d50 0x7f1d0814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 >> 172.21.15.118:0/236617413 conn(0x7f1d080cb880 msgr2=0x7f1d0806b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:00.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 shutdown_connections 2023-07-13T13:53:00.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.074+0000 7f1d0d093700 1 -- 172.21.15.118:0/236617413 wait complete. 2023-07-13T13:53:00.058 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-13T13:53:00.059 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T13:53:00.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.207+0000 7f1557647700 1 Processor -- start 2023-07-13T13:53:00.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.207+0000 7f1557647700 1 -- start start 2023-07-13T13:53:00.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.208+0000 7f1557647700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1550152720 0x7f15500c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.208+0000 7f1557647700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500c6b50 con 0x7f15500c60b0 2023-07-13T13:53:00.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.208+0000 7f1557647700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15500c85f0 con 0x7f15500c6d50 2023-07-13T13:53:00.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.208+0000 7f1557647700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1550158820 con 0x7f1550152720 2023-07-13T13:53:00.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.208+0000 7f1554be2700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f15500c60b0 0x7f15500c55b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48204/0 (socket says 172.21.15.118:48204) 2023-07-13T13:53:00.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.208+0000 7f1554be2700 1 -- 172.21.15.118:0/3491640782 learned_addr learned my addr 172.21.15.118:0/3491640782 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:53:00.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.208+0000 7f15553e3700 1 --2- 172.21.15.118:0/3491640782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1550152720 0x7f15500c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.212+0000 7f1547fff700 1 -- 172.21.15.118:0/3491640782 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892451710 0 0) 0x7f15500c85f0 con 0x7f15500c6d50 2023-07-13T13:53:00.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.212+0000 7f1547fff700 1 -- 172.21.15.118:0/3491640782 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c0035b0 con 0x7f15500c6d50 2023-07-13T13:53:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.212+0000 7f1547fff700 1 -- 172.21.15.118:0/3491640782 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180719161 0 0) 0x7f15500c6b50 con 0x7f15500c60b0 2023-07-13T13:53:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.212+0000 7f1547fff700 1 -- 172.21.15.118:0/3491640782 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15500c85f0 con 0x7f15500c60b0 2023-07-13T13:53:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.212+0000 7f15553e3700 1 -- 172.21.15.118:0/3491640782 >> v1:172.21.15.123:6789/0 conn(0x7f15500c6d50 legacy=0x7f1550158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.185 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.212+0000 7f15553e3700 1 -- 172.21.15.118:0/3491640782 >> v1:172.21.15.118:6789/0 conn(0x7f15500c60b0 legacy=0x7f15500c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.212+0000 7f15553e3700 1 -- 172.21.15.118:0/3491640782 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155015c6b0 con 0x7f1550152720 2023-07-13T13:53:00.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.214+0000 7f15553e3700 1 --2- 172.21.15.118:0/3491640782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1550152720 0x7f15500c6610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f154c009870 tx=0x7f154c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9113183db4eedaa1 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:00.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.218+0000 7f1547fff700 1 -- 172.21.15.118:0/3491640782 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c011830 con 0x7f1550152720 2023-07-13T13:53:00.190 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.218+0000 7f1547fff700 1 -- 172.21.15.118:0/3491640782 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c011990 con 0x7f1550152720 2023-07-13T13:53:00.191 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.218+0000 7f1547fff700 1 -- 172.21.15.118:0/3491640782 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c011d20 con 0x7f1550152720 2023-07-13T13:53:00.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.219+0000 7f1557647700 1 -- 172.21.15.118:0/3491640782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1550152720 msgr2=0x7f15500c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.219+0000 7f1557647700 1 --2- 172.21.15.118:0/3491640782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1550152720 0x7f15500c6610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f154c009870 tx=0x7f154c009b80 comp rx=0 tx=0).stop 2023-07-13T13:53:00.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.219+0000 7f1557647700 1 -- 172.21.15.118:0/3491640782 shutdown_connections 2023-07-13T13:53:00.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.219+0000 7f1557647700 1 --2- 172.21.15.118:0/3491640782 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1550152720 0x7f15500c6610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.219+0000 7f1557647700 1 -- 172.21.15.118:0/3491640782 >> 172.21.15.118:0/3491640782 conn(0x7f15500cb880 msgr2=0x7f15500c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:00.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.219+0000 7f1557647700 1 -- 172.21.15.118:0/3491640782 shutdown_connections 2023-07-13T13:53:00.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.219+0000 7f1557647700 1 -- 172.21.15.118:0/3491640782 wait complete. 2023-07-13T13:53:00.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.220+0000 7f1557647700 1 Processor -- start 2023-07-13T13:53:00.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.220+0000 7f1557647700 1 -- start start 2023-07-13T13:53:00.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.221+0000 7f1557647700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f15500c60b0 0x7f1550157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.221+0000 7f1557647700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15500c6d50 0x7f155014bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.221+0000 7f1557647700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1550152720 0x7f155014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.221+0000 7f1557647700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155014bb30 con 0x7f15500c6d50 2023-07-13T13:53:00.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.221+0000 7f1557647700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155014d520 con 0x7f1550152720 2023-07-13T13:53:00.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.221+0000 7f1557647700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15500c3980 con 0x7f15500c60b0 2023-07-13T13:53:00.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.222+0000 7f1554be2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15500c6d50 0x7f155014bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.222+0000 7f15553e3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f15500c60b0 0x7f1550157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.222+0000 7f1555be4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1550152720 0x7f155014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.222+0000 7f1554be2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15500c6d50 0x7f155014bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43568/0 (socket says 172.21.15.118:43568) 2023-07-13T13:53:00.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.222+0000 7f1554be2700 1 -- 172.21.15.118:0/2158573056 learned_addr learned my addr 172.21.15.118:0/2158573056 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:00.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.226+0000 7f1554be2700 1 -- 172.21.15.118:0/2158573056 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f15500c60b0 msgr2=0x7f1550157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.226+0000 7f1554be2700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f15500c60b0 0x7f1550157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.226+0000 7f1554be2700 1 -- 172.21.15.118:0/2158573056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1550152720 msgr2=0x7f155014c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.226+0000 7f1554be2700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1550152720 0x7f155014c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.226+0000 7f1554be2700 1 -- 172.21.15.118:0/2158573056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0094a0 con 0x7f15500c6d50 2023-07-13T13:53:00.201 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.228+0000 7f1554be2700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15500c6d50 0x7f155014bf50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f154000c430 tx=0x7f154000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:00.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.230+0000 7f1545ffb700 1 -- 172.21.15.118:0/2158573056 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540005b70 con 0x7f15500c6d50 2023-07-13T13:53:00.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.230+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155014d7f0 con 0x7f15500c6d50 2023-07-13T13:53:00.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.231+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15500c3bd0 con 0x7f15500c6d50 2023-07-13T13:53:00.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.231+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155014b890 con 0x7f15500c6d50 2023-07-13T13:53:00.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.232+0000 7f1545ffb700 1 -- 172.21.15.118:0/2158573056 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1540005cd0 con 0x7f15500c6d50 2023-07-13T13:53:00.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.232+0000 7f1545ffb700 1 -- 172.21.15.118:0/2158573056 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540007270 con 0x7f15500c6d50 2023-07-13T13:53:00.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.491+0000 7f1545ffb700 1 -- 172.21.15.118:0/2158573056 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15400073d0 con 0x7f15500c6d50 2023-07-13T13:53:00.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.491+0000 7f1545ffb700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f153406ad10 0x7f153406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.492+0000 7f1545ffb700 1 -- 172.21.15.118:0/2158573056 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f15400890d0 con 0x7f15500c6d50 2023-07-13T13:53:00.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.492+0000 7f15553e3700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f153406ad10 0x7f153406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.492+0000 7f15553e3700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f153406ad10 0x7f153406d1c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f154c000c00 tx=0x7f154c01d040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:00.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.500+0000 7f1545ffb700 1 -- 172.21.15.118:0/2158573056 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1540053f40 con 0x7f15500c6d50 2023-07-13T13:53:00.658 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.686+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15500743c0 con 0x7f15500c6d50 2023-07-13T13:53:00.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.742+0000 7f1545ffb700 1 -- 172.21.15.118:0/2158573056 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f1540057560 con 0x7f15500c6d50 2023-07-13T13:53:00.715 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:53:00.716 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:57.795549+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.35","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T13:53:00.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f153406ad10 msgr2=0x7f153406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f153406ad10 0x7f153406d1c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f154c000c00 tx=0x7f154c01d040 comp rx=0 tx=0).stop 2023-07-13T13:53:00.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15500c6d50 msgr2=0x7f155014bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15500c6d50 0x7f155014bf50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f154000c430 tx=0x7f154000c740 comp rx=0 tx=0).stop 2023-07-13T13:53:00.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 shutdown_connections 2023-07-13T13:53:00.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f153406ad10 0x7f153406d1c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1550152720 0x7f155014c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f15500c60b0 0x7f1550157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 --2- 172.21.15.118:0/2158573056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15500c6d50 0x7f155014bf50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 >> 172.21.15.118:0/2158573056 conn(0x7f15500cb880 msgr2=0x7f15500c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:00.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 shutdown_connections 2023-07-13T13:53:00.721 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.745+0000 7f1557647700 1 -- 172.21.15.118:0/2158573056 wait complete. 2023-07-13T13:53:00.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-13T13:51:55.327381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-13T13:51:57.354158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-13T13:52:15.149076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-13T13:52:16.169659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-13T13:52:21.744112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-13T13:53:00.730 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-13T13:53:00.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.882+0000 7ff3d0331700 1 Processor -- start 2023-07-13T13:53:00.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.882+0000 7ff3d0331700 1 -- start start 2023-07-13T13:53:00.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.883+0000 7ff3d0331700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8152970 0x7ff3c8071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.883+0000 7ff3d0331700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3c8158640 0x7ff3c80c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.883+0000 7ff3d0331700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c8158b80 con 0x7ff3c8070dd0 2023-07-13T13:53:00.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.883+0000 7ff3d0331700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c8158e60 con 0x7ff3c8158640 2023-07-13T13:53:00.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.883+0000 7ff3d0331700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8159140 con 0x7ff3c8152970 2023-07-13T13:53:00.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.884+0000 7ff3ce8ce700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3c8158640 0x7ff3c80c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.884+0000 7ff3cd8cc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff3c8070dd0 0x7ff3c8069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43024/0 (socket says 172.21.15.118:43024) 2023-07-13T13:53:00.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.884+0000 7ff3cd8cc700 1 -- 172.21.15.118:0/2466783121 learned_addr learned my addr 172.21.15.118:0/2466783121 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:53:00.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.884+0000 7ff3ce0cd700 1 --2- 172.21.15.118:0/2466783121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8152970 0x7ff3c8071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.887+0000 7ff3ce0cd700 1 -- 172.21.15.118:0/2466783121 >> v2:172.21.15.118:3300/0 conn(0x7ff3c8158640 msgr2=0x7ff3c80c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:00.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.887+0000 7ff3ce0cd700 1 --2- 172.21.15.118:0/2466783121 >> v2:172.21.15.118:3300/0 conn(0x7ff3c8158640 0x7ff3c80c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.887+0000 7ff3ce0cd700 1 -- 172.21.15.118:0/2466783121 >> v1:172.21.15.123:6789/0 conn(0x7ff3c8070dd0 legacy=0x7ff3c8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.887+0000 7ff3ce0cd700 1 -- 172.21.15.118:0/2466783121 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c8159420 con 0x7ff3c8152970 2023-07-13T13:53:00.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.887+0000 7ff3ce8ce700 1 --2- 172.21.15.118:0/2466783121 >> v2:172.21.15.118:3300/0 conn(0x7ff3c8158640 0x7ff3c80c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:53:00.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.889+0000 7ff3ce0cd700 1 --2- 172.21.15.118:0/2466783121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8152970 0x7ff3c8071c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009820 tx=0x7ff3b8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18ef686637a0fc5c server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:00.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.893+0000 7ff3cd0cb700 1 -- 172.21.15.118:0/2466783121 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8005e30 con 0x7ff3c8152970 2023-07-13T13:53:00.865 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3cd0cb700 1 -- 172.21.15.118:0/2466783121 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8006030 con 0x7ff3c8152970 2023-07-13T13:53:00.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3cd0cb700 1 -- 172.21.15.118:0/2466783121 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80063c0 con 0x7ff3c8152970 2023-07-13T13:53:00.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3d0331700 1 -- 172.21.15.118:0/2466783121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8152970 msgr2=0x7ff3c8071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.866 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3d0331700 1 --2- 172.21.15.118:0/2466783121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8152970 0x7ff3c8071c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009820 tx=0x7ff3b8009b30 comp rx=0 tx=0).stop 2023-07-13T13:53:00.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3d0331700 1 -- 172.21.15.118:0/2466783121 shutdown_connections 2023-07-13T13:53:00.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3d0331700 1 --2- 172.21.15.118:0/2466783121 >> v2:172.21.15.118:3300/0 conn(0x7ff3c8158640 0x7ff3c80c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3d0331700 1 --2- 172.21.15.118:0/2466783121 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8152970 0x7ff3c8071c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3d0331700 1 -- 172.21.15.118:0/2466783121 >> 172.21.15.118:0/2466783121 conn(0x7ff3c806cf60 msgr2=0x7ff3c806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:00.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3d0331700 1 -- 172.21.15.118:0/2466783121 shutdown_connections 2023-07-13T13:53:00.867 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.894+0000 7ff3d0331700 1 -- 172.21.15.118:0/2466783121 wait complete. 2023-07-13T13:53:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.896+0000 7ff3d0331700 1 Processor -- start 2023-07-13T13:53:00.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.896+0000 7ff3d0331700 1 -- start start 2023-07-13T13:53:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.897+0000 7ff3d0331700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8070dd0 0x7ff3c814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.897+0000 7ff3d0331700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c8152970 0x7ff3c8153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.897+0000 7ff3d0331700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c8158640 0x7ff3c814b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.897+0000 7ff3d0331700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c8cf0 con 0x7ff3c8152970 2023-07-13T13:53:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.897+0000 7ff3d0331700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c814ea60 con 0x7ff3c8158640 2023-07-13T13:53:00.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.897+0000 7ff3d0331700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c814ecb0 con 0x7ff3c8070dd0 2023-07-13T13:53:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.897+0000 7ff3cd8cc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c8152970 0x7ff3c8153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.897+0000 7ff3ce0cd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8070dd0 0x7ff3c814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.898+0000 7ff3ce8ce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c8158640 0x7ff3c814b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.870 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.898+0000 7ff3cd8cc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c8152970 0x7ff3c8153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37320/0 (socket says 172.21.15.118:37320) 2023-07-13T13:53:00.871 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.898+0000 7ff3cd8cc700 1 -- 172.21.15.118:0/3164393025 learned_addr learned my addr 172.21.15.118:0/3164393025 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:00.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.902+0000 7ff3ce0cd700 1 -- 172.21.15.118:0/3164393025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c8158640 msgr2=0x7ff3c814b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.902+0000 7ff3ce0cd700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c8158640 0x7ff3c814b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.902+0000 7ff3ce0cd700 1 -- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c8152970 msgr2=0x7ff3c8153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:00.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.902+0000 7ff3ce0cd700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c8152970 0x7ff3c8153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:00.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.902+0000 7ff3ce0cd700 1 -- 172.21.15.118:0/3164393025 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0009a70 con 0x7ff3c8070dd0 2023-07-13T13:53:00.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.904+0000 7ff3ce0cd700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8070dd0 0x7ff3c814dfa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80c8f90 tx=0x7ff3b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:00.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.908+0000 7ff3beffd700 1 -- 172.21.15.118:0/3164393025 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8004050 con 0x7ff3c8070dd0 2023-07-13T13:53:00.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.908+0000 7ff3beffd700 1 -- 172.21.15.118:0/3164393025 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b80041d0 con 0x7ff3c8070dd0 2023-07-13T13:53:00.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.908+0000 7ff3beffd700 1 -- 172.21.15.118:0/3164393025 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8004580 con 0x7ff3c8070dd0 2023-07-13T13:53:00.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.908+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b8009430 con 0x7ff3c8070dd0 2023-07-13T13:53:00.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.908+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c81f1f30 con 0x7ff3c8070dd0 2023-07-13T13:53:00.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.909+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c804e280 con 0x7ff3c8070dd0 2023-07-13T13:53:00.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.929+0000 7ff3beffd700 1 -- 172.21.15.118:0/3164393025 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3b8022070 con 0x7ff3c8070dd0 2023-07-13T13:53:00.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.929+0000 7ff3beffd700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff3ac06ad30 0x7ff3ac06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:00.901 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.930+0000 7ff3cd8cc700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff3ac06ad30 0x7ff3ac06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:00.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:00.930+0000 7ff3cd8cc700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff3ac06ad30 0x7ff3ac06d1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff3c81521d0 tx=0x7ff3c4001120 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:01.133 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.161+0000 7ff3beffd700 1 -- 172.21.15.118:0/3164393025 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff3b805dfa0 con 0x7ff3c8070dd0 2023-07-13T13:53:01.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.171+0000 7ff3beffd700 1 -- 172.21.15.118:0/3164393025 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3b8056320 con 0x7ff3c8070dd0 2023-07-13T13:53:01.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.372+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3c80cc050 con 0x7ff3c8070dd0 2023-07-13T13:53:01.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.381+0000 7ff3beffd700 1 -- 172.21.15.118:0/3164393025 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3b8059940 con 0x7ff3c8070dd0 2023-07-13T13:53:01.353 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-07-13T13:53:01.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff3ac06ad30 msgr2=0x7ff3ac06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:01.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff3ac06ad30 0x7ff3ac06d1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff3c81521d0 tx=0x7ff3c4001120 comp rx=0 tx=0).stop 2023-07-13T13:53:01.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8070dd0 msgr2=0x7ff3c814dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:01.355 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8070dd0 0x7ff3c814dfa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80c8f90 tx=0x7ff3b8004750 comp rx=0 tx=0).stop 2023-07-13T13:53:01.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 shutdown_connections 2023-07-13T13:53:01.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff3ac06ad30 0x7ff3ac06d1e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c8158640 0x7ff3c814b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3c8070dd0 0x7ff3c814dfa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 --2- 172.21.15.118:0/3164393025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c8152970 0x7ff3c8153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 >> 172.21.15.118:0/3164393025 conn(0x7ff3c806cf60 msgr2=0x7ff3c814fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:01.356 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 shutdown_connections 2023-07-13T13:53:01.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.383+0000 7ff3d0331700 1 -- 172.21.15.118:0/3164393025 wait complete. 2023-07-13T13:53:01.367 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-13T13:53:01.491 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.519+0000 7f0f20518700 1 Processor -- start 2023-07-13T13:53:01.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.519+0000 7f0f20518700 1 -- start start 2023-07-13T13:53:01.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.520+0000 7f0f20518700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f180710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:01.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.520+0000 7f0f20518700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0f1814ecc0 0x7f0f18070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:01.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.520+0000 7f0f20518700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f180c7040 con 0x7f0f1806abc0 2023-07-13T13:53:01.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.520+0000 7f0f20518700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f18070e80 con 0x7f0f1814ecc0 2023-07-13T13:53:01.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.520+0000 7f0f20518700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c7320 con 0x7f0f18070570 2023-07-13T13:53:01.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.521+0000 7f0f1dab3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0f1814ecc0 0x7f0f18070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:01.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.521+0000 7f0f1e2b4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f180710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.521+0000 7f0f1eab5700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0f1806abc0 0x7f0f18154cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43026/0 (socket says 172.21.15.118:43026) 2023-07-13T13:53:01.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.521+0000 7f0f1eab5700 1 -- 172.21.15.118:0/2002590836 learned_addr learned my addr 172.21.15.118:0/2002590836 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:53:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.523+0000 7f0f1d2b2700 1 -- 172.21.15.118:0/2002590836 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102520707 0 0) 0x7f0f180c7040 con 0x7f0f1806abc0 2023-07-13T13:53:01.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.523+0000 7f0f1d2b2700 1 -- 172.21.15.118:0/2002590836 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f040035b0 con 0x7f0f1806abc0 2023-07-13T13:53:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.524+0000 7f0f1e2b4700 1 -- 172.21.15.118:0/2002590836 >> v2:172.21.15.118:3300/0 conn(0x7f0f1814ecc0 msgr2=0x7f0f18070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.524+0000 7f0f1e2b4700 1 --2- 172.21.15.118:0/2002590836 >> v2:172.21.15.118:3300/0 conn(0x7f0f1814ecc0 0x7f0f18070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.524+0000 7f0f1e2b4700 1 -- 172.21.15.118:0/2002590836 >> v1:172.21.15.123:6789/0 conn(0x7f0f1806abc0 legacy=0x7f0f18154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:01.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.524+0000 7f0f1e2b4700 1 -- 172.21.15.118:0/2002590836 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180c7600 con 0x7f0f18070570 2023-07-13T13:53:01.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.526+0000 7f0f1e2b4700 1 --2- 172.21.15.118:0/2002590836 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f180710b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009840 tx=0x7f0f08009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b320f02da5b3bb server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:01.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f1d2b2700 1 -- 172.21.15.118:0/2002590836 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08011830 con 0x7f0f18070570 2023-07-13T13:53:01.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f1d2b2700 1 -- 172.21.15.118:0/2002590836 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08011990 con 0x7f0f18070570 2023-07-13T13:53:01.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f1d2b2700 1 -- 172.21.15.118:0/2002590836 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08011d20 con 0x7f0f18070570 2023-07-13T13:53:01.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f20518700 1 -- 172.21.15.118:0/2002590836 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 msgr2=0x7f0f180710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:01.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f20518700 1 --2- 172.21.15.118:0/2002590836 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f180710b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009840 tx=0x7f0f08009b50 comp rx=0 tx=0).stop 2023-07-13T13:53:01.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f20518700 1 -- 172.21.15.118:0/2002590836 shutdown_connections 2023-07-13T13:53:01.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f20518700 1 --2- 172.21.15.118:0/2002590836 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f180710b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f20518700 1 --2- 172.21.15.118:0/2002590836 >> v2:172.21.15.118:3300/0 conn(0x7f0f1814ecc0 0x7f0f18070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.530+0000 7f0f20518700 1 -- 172.21.15.118:0/2002590836 >> 172.21.15.118:0/2002590836 conn(0x7f0f1806bac0 msgr2=0x7f0f1806bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:01.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.531+0000 7f0f20518700 1 -- 172.21.15.118:0/2002590836 shutdown_connections 2023-07-13T13:53:01.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.531+0000 7f0f20518700 1 -- 172.21.15.118:0/2002590836 wait complete. 2023-07-13T13:53:01.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.532+0000 7f0f20518700 1 Processor -- start 2023-07-13T13:53:01.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.532+0000 7f0f20518700 1 -- start start 2023-07-13T13:53:01.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.532+0000 7f0f20518700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1806abc0 0x7f0f18151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:01.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.532+0000 7f0f20518700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f18149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:01.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.532+0000 7f0f20518700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f1814ecc0 0x7f0f180c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:01.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.532+0000 7f0f20518700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1814cc00 con 0x7f0f1806abc0 2023-07-13T13:53:01.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.532+0000 7f0f20518700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180c9020 con 0x7f0f1814ecc0 2023-07-13T13:53:01.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.532+0000 7f0f20518700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1814a3d0 con 0x7f0f18070570 2023-07-13T13:53:01.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.533+0000 7f0f1e2b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1806abc0 0x7f0f18151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:01.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.533+0000 7f0f1eab5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f1814ecc0 0x7f0f180c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:01.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.533+0000 7f0f1dab3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f18149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:01.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.533+0000 7f0f1e2b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1806abc0 0x7f0f18151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37332/0 (socket says 172.21.15.118:37332) 2023-07-13T13:53:01.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.533+0000 7f0f1e2b4700 1 -- 172.21.15.118:0/750309972 learned_addr learned my addr 172.21.15.118:0/750309972 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:01.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.537+0000 7f0f1dab3700 1 -- 172.21.15.118:0/750309972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f1814ecc0 msgr2=0x7f0f180c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:01.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.537+0000 7f0f1dab3700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f1814ecc0 0x7f0f180c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.537+0000 7f0f1dab3700 1 -- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1806abc0 msgr2=0x7f0f18151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:01.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.537+0000 7f0f1dab3700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1806abc0 0x7f0f18151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.537+0000 7f0f1dab3700 1 -- 172.21.15.118:0/750309972 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f080094a0 con 0x7f0f18070570 2023-07-13T13:53:01.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.539+0000 7f0f1dab3700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f18149e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400e840 tx=0x7f0f1400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:01.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.543+0000 7f0f0effd700 1 -- 172.21.15.118:0/750309972 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14013680 con 0x7f0f18070570 2023-07-13T13:53:01.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.543+0000 7f0f0effd700 1 -- 172.21.15.118:0/750309972 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f140137e0 con 0x7f0f18070570 2023-07-13T13:53:01.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.543+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1814c640 con 0x7f0f18070570 2023-07-13T13:53:01.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.543+0000 7f0f0effd700 1 -- 172.21.15.118:0/750309972 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14013b50 con 0x7f0f18070570 2023-07-13T13:53:01.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.543+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f180c8cb0 con 0x7f0f18070570 2023-07-13T13:53:01.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.544+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1804e280 con 0x7f0f18070570 2023-07-13T13:53:01.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.564+0000 7f0f0effd700 1 -- 172.21.15.118:0/750309972 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f14013cb0 con 0x7f0f18070570 2023-07-13T13:53:01.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.564+0000 7f0f0effd700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0efc06ad30 0x7f0efc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:01.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.565+0000 7f0f1e2b4700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0efc06ad30 0x7f0efc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:01.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.565+0000 7f0f1e2b4700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0efc06ad30 0x7f0efc06d1e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009b90 tx=0x7f0f08008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.783+0000 7f0f0effd700 1 -- 172.21.15.118:0/750309972 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f1405c700 con 0x7f0f18070570 2023-07-13T13:53:01.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.802+0000 7f0f0effd700 1 -- 172.21.15.118:0/750309972 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f14058510 con 0x7f0f18070570 2023-07-13T13:53:01.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.989+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0f1814a5c0 con 0x7f0f18070570 2023-07-13T13:53:01.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.997+0000 7f0f0effd700 1 -- 172.21.15.118:0/750309972 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0f14021020 con 0x7f0f18070570 2023-07-13T13:53:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-07-13T13:53:01.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0efc06ad30 msgr2=0x7f0efc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:01.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0efc06ad30 0x7f0efc06d1e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009b90 tx=0x7f0f08008030 comp rx=0 tx=0).stop 2023-07-13T13:53:01.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 msgr2=0x7f0f18149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:01.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f18149e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400e840 tx=0x7f0f1400eb50 comp rx=0 tx=0).stop 2023-07-13T13:53:01.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 shutdown_connections 2023-07-13T13:53:01.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0efc06ad30 0x7f0efc06d1e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f1814ecc0 0x7f0f180c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f1806abc0 0x7f0f18151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 --2- 172.21.15.118:0/750309972 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0f18070570 0x7f0f18149e90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:01.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 >> 172.21.15.118:0/750309972 conn(0x7f0f1806bac0 msgr2=0x7f0f18154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:01.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 shutdown_connections 2023-07-13T13:53:01.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:01.999+0000 7f0f20518700 1 -- 172.21.15.118:0/750309972 wait complete. 2023-07-13T13:53:01.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-13T13:53:02.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.135+0000 7f053462c700 1 Processor -- start 2023-07-13T13:53:02.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.135+0000 7f053462c700 1 -- start start 2023-07-13T13:53:02.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.136+0000 7f053462c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f052c1502c0 0x7f052c0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.136+0000 7f053462c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c0c7d40 0x7f052c0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.136+0000 7f053462c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c156e40 con 0x7f052c0c2970 2023-07-13T13:53:02.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.136+0000 7f053462c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c06b950 con 0x7f052c1502c0 2023-07-13T13:53:02.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.136+0000 7f053462c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c156250 con 0x7f052c0c7d40 2023-07-13T13:53:02.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.137+0000 7f05323c8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f052c1502c0 0x7f052c0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.137+0000 7f0531bc7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c0c7d40 0x7f052c0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.109 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.137+0000 7f0531bc7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c0c7d40 0x7f052c0c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:52152/0 (socket says 172.21.15.118:52152) 2023-07-13T13:53:02.110 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.137+0000 7f0531bc7700 1 -- 172.21.15.118:0/246347541 learned_addr learned my addr 172.21.15.118:0/246347541 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:02.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.140+0000 7f0531bc7700 1 -- 172.21.15.118:0/246347541 >> v2:172.21.15.118:3300/0 conn(0x7f052c1502c0 msgr2=0x7f052c0c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:02.111 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.140+0000 7f0531bc7700 1 --2- 172.21.15.118:0/246347541 >> v2:172.21.15.118:3300/0 conn(0x7f052c1502c0 0x7f052c0c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.140+0000 7f0531bc7700 1 -- 172.21.15.118:0/246347541 >> v1:172.21.15.118:6789/0 conn(0x7f052c0c2970 legacy=0x7f052c0c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.112 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.140+0000 7f0531bc7700 1 -- 172.21.15.118:0/246347541 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c06c8f0 con 0x7f052c0c7d40 2023-07-13T13:53:02.113 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.141+0000 7f0531bc7700 1 --2- 172.21.15.118:0/246347541 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c0c7d40 0x7f052c0c6750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05280098f0 tx=0x7f0528009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=666720325f4a95bc server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:02.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.145+0000 7f05313c6700 1 -- 172.21.15.118:0/246347541 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528011830 con 0x7f052c0c7d40 2023-07-13T13:53:02.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.145+0000 7f05313c6700 1 -- 172.21.15.118:0/246347541 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528011990 con 0x7f052c0c7d40 2023-07-13T13:53:02.117 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.145+0000 7f05313c6700 1 -- 172.21.15.118:0/246347541 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528011d20 con 0x7f052c0c7d40 2023-07-13T13:53:02.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.146+0000 7f053462c700 1 -- 172.21.15.118:0/246347541 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c0c7d40 msgr2=0x7f052c0c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.146+0000 7f053462c700 1 --2- 172.21.15.118:0/246347541 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c0c7d40 0x7f052c0c6750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05280098f0 tx=0x7f0528009c00 comp rx=0 tx=0).stop 2023-07-13T13:53:02.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.146+0000 7f053462c700 1 -- 172.21.15.118:0/246347541 shutdown_connections 2023-07-13T13:53:02.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.146+0000 7f053462c700 1 --2- 172.21.15.118:0/246347541 >> v2:172.21.15.118:3300/0 conn(0x7f052c1502c0 0x7f052c0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.146+0000 7f053462c700 1 --2- 172.21.15.118:0/246347541 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c0c7d40 0x7f052c0c6750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.146+0000 7f053462c700 1 -- 172.21.15.118:0/246347541 >> 172.21.15.118:0/246347541 conn(0x7f052c0cb800 msgr2=0x7f052c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:02.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.146+0000 7f053462c700 1 -- 172.21.15.118:0/246347541 shutdown_connections 2023-07-13T13:53:02.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.146+0000 7f053462c700 1 -- 172.21.15.118:0/246347541 wait complete. 2023-07-13T13:53:02.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.147+0000 7f053462c700 1 Processor -- start 2023-07-13T13:53:02.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.147+0000 7f053462c700 1 -- start start 2023-07-13T13:53:02.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.148+0000 7f053462c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f052c0c2970 0x7f052c1edac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.148+0000 7f053462c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f052c0c7d40 0x7f052c14db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.148+0000 7f053462c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c1502c0 0x7f052c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.148+0000 7f053462c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c1f1fc0 con 0x7f052c0c7d40 2023-07-13T13:53:02.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.148+0000 7f053462c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c1f1440 con 0x7f052c0c2970 2023-07-13T13:53:02.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.148+0000 7f053462c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c1f1720 con 0x7f052c1502c0 2023-07-13T13:53:02.121 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.148+0000 7f0531bc7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f052c0c7d40 0x7f052c14db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.149+0000 7f0532bc9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c1502c0 0x7f052c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.149+0000 7f05323c8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f052c0c2970 0x7f052c1edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.149+0000 7f0531bc7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f052c0c7d40 0x7f052c14db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37356/0 (socket says 172.21.15.118:37356) 2023-07-13T13:53:02.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.149+0000 7f0531bc7700 1 -- 172.21.15.118:0/1241349740 learned_addr learned my addr 172.21.15.118:0/1241349740 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:02.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.152+0000 7f0531bc7700 1 -- 172.21.15.118:0/1241349740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c1502c0 msgr2=0x7f052c14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.152+0000 7f0531bc7700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c1502c0 0x7f052c14c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.152+0000 7f0531bc7700 1 -- 172.21.15.118:0/1241349740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f052c0c2970 msgr2=0x7f052c1edac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.152+0000 7f0531bc7700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f052c0c2970 0x7f052c1edac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.125 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.152+0000 7f0531bc7700 1 -- 172.21.15.118:0/1241349740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009550 con 0x7f052c0c7d40 2023-07-13T13:53:02.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.155+0000 7f0531bc7700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f052c0c7d40 0x7f052c14db70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0528000c00 tx=0x7f0528004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:02.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.159+0000 7f0522ffd700 1 -- 172.21.15.118:0/1241349740 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528004400 con 0x7f052c0c7d40 2023-07-13T13:53:02.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.159+0000 7f0522ffd700 1 -- 172.21.15.118:0/1241349740 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052801f070 con 0x7f052c0c7d40 2023-07-13T13:53:02.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.159+0000 7f0522ffd700 1 -- 172.21.15.118:0/1241349740 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05280038e0 con 0x7f052c0c7d40 2023-07-13T13:53:02.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.159+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c1f1a00 con 0x7f052c0c7d40 2023-07-13T13:53:02.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.159+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c14c470 con 0x7f052c0c7d40 2023-07-13T13:53:02.132 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.160+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c0c3b80 con 0x7f052c0c7d40 2023-07-13T13:53:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.186+0000 7f0522ffd700 1 -- 172.21.15.118:0/1241349740 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0528021030 con 0x7f052c0c7d40 2023-07-13T13:53:02.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.187+0000 7f0522ffd700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f051006adb0 0x7f051006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.187+0000 7f0522ffd700 1 -- 172.21.15.118:0/1241349740 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f052808af10 con 0x7f052c0c7d40 2023-07-13T13:53:02.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.187+0000 7f05323c8700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f051006adb0 0x7f051006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.187+0000 7f05323c8700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f051006adb0 0x7f051006d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f051c009b40 tx=0x7f051c009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:02.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.429+0000 7f0522ffd700 1 -- 172.21.15.118:0/1241349740 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0528055db0 con 0x7f052c0c7d40 2023-07-13T13:53:02.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.620+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f052c1567d0 con 0x7f052c0c7d40 2023-07-13T13:53:02.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.628+0000 7f0522ffd700 1 -- 172.21.15.118:0/1241349740 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f052c1567d0 con 0x7f052c0c7d40 2023-07-13T13:53:02.600 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T13:53:02.602 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f051006adb0 msgr2=0x7f051006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f051006adb0 0x7f051006d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f051c009b40 tx=0x7f051c009210 comp rx=0 tx=0).stop 2023-07-13T13:53:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f052c0c7d40 msgr2=0x7f052c14db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f052c0c7d40 0x7f052c14db70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0528000c00 tx=0x7f0528004750 comp rx=0 tx=0).stop 2023-07-13T13:53:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 shutdown_connections 2023-07-13T13:53:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f051006adb0 0x7f051006d260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f052c0c2970 0x7f052c1edac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f052c1502c0 0x7f052c14c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 --2- 172.21.15.118:0/1241349740 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f052c0c7d40 0x7f052c14db70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 >> 172.21.15.118:0/1241349740 conn(0x7f052c0cb800 msgr2=0x7f052c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 shutdown_connections 2023-07-13T13:53:02.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.631+0000 7f053462c700 1 -- 172.21.15.118:0/1241349740 wait complete. 2023-07-13T13:53:02.614 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-13T13:53:02.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.767+0000 7fab5e850700 1 Processor -- start 2023-07-13T13:53:02.740 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.768+0000 7fab5e850700 1 -- start start 2023-07-13T13:53:02.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.769+0000 7fab5e850700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fab58152730 0x7fab5815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.769+0000 7fab5e850700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fab580c71c0 0x7fab58069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.769+0000 7fab5e850700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 0x7fab580707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.769+0000 7fab5e850700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab580c6d30 con 0x7fab580c71c0 2023-07-13T13:53:02.741 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.769+0000 7fab5e850700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5815c930 con 0x7fab58152730 2023-07-13T13:53:02.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.769+0000 7fab5e850700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab580c6440 con 0x7fab580703b0 2023-07-13T13:53:02.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.769+0000 7fab4ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fab580c71c0 0x7fab58069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.770+0000 7fab4ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fab580c71c0 0x7fab58069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37372/0 (socket says 172.21.15.118:37372) 2023-07-13T13:53:02.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.770+0000 7fab4ffff700 1 -- 172.21.15.118:0/190544567 learned_addr learned my addr 172.21.15.118:0/190544567 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:02.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.770+0000 7fab5cded700 1 --2- 172.21.15.118:0/190544567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 0x7fab580707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.771+0000 7fab57fff700 1 --2- 172.21.15.118:0/190544567 >> v2:172.21.15.123:3300/0 conn(0x7fab58152730 0x7fab5815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.773+0000 7fab4ffff700 1 -- 172.21.15.118:0/190544567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 msgr2=0x7fab580707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:02.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.773+0000 7fab4ffff700 1 --2- 172.21.15.118:0/190544567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 0x7fab580707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.773+0000 7fab4ffff700 1 -- 172.21.15.118:0/190544567 >> v2:172.21.15.123:3300/0 conn(0x7fab58152730 msgr2=0x7fab5815c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:02.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.773+0000 7fab4ffff700 1 --2- 172.21.15.118:0/190544567 >> v2:172.21.15.123:3300/0 conn(0x7fab58152730 0x7fab5815c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.773+0000 7fab4ffff700 1 -- 172.21.15.118:0/190544567 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab580c8160 con 0x7fab580c71c0 2023-07-13T13:53:02.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.777+0000 7fab4ffff700 1 --2- 172.21.15.118:0/190544567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab580c71c0 0x7fab58069f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fab5806f850 tx=0x7fab40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79293ba39f71edef server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:02.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.783+0000 7fab577fe700 1 -- 172.21.15.118:0/190544567 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40011830 con 0x7fab580c71c0 2023-07-13T13:53:02.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.783+0000 7fab577fe700 1 -- 172.21.15.118:0/190544567 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40011990 con 0x7fab580c71c0 2023-07-13T13:53:02.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.783+0000 7fab577fe700 1 -- 172.21.15.118:0/190544567 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40011d20 con 0x7fab580c71c0 2023-07-13T13:53:02.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 -- 172.21.15.118:0/190544567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab580c71c0 msgr2=0x7fab58069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 --2- 172.21.15.118:0/190544567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab580c71c0 0x7fab58069f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fab5806f850 tx=0x7fab40009bd0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 -- 172.21.15.118:0/190544567 shutdown_connections 2023-07-13T13:53:02.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 --2- 172.21.15.118:0/190544567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 0x7fab580707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 --2- 172.21.15.118:0/190544567 >> v2:172.21.15.123:3300/0 conn(0x7fab58152730 0x7fab5815c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 --2- 172.21.15.118:0/190544567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab580c71c0 0x7fab58069f30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 -- 172.21.15.118:0/190544567 >> 172.21.15.118:0/190544567 conn(0x7fab580cb800 msgr2=0x7fab580c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:02.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 -- 172.21.15.118:0/190544567 shutdown_connections 2023-07-13T13:53:02.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.784+0000 7fab5e850700 1 -- 172.21.15.118:0/190544567 wait complete. 2023-07-13T13:53:02.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.785+0000 7fab5e850700 1 Processor -- start 2023-07-13T13:53:02.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.785+0000 7fab5e850700 1 -- start start 2023-07-13T13:53:02.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab5e850700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 0x7fab580bce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab5e850700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab580c71c0 0x7fab5815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab5e850700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab58152730 0x7fab581e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab5e850700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab580bbb90 con 0x7fab58152730 2023-07-13T13:53:02.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab5e850700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab580c34f0 con 0x7fab580c71c0 2023-07-13T13:53:02.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab5e850700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab581ee9f0 con 0x7fab580703b0 2023-07-13T13:53:02.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab5cded700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab58152730 0x7fab581e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab4ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab580c71c0 0x7fab5815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.786+0000 7fab57fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 0x7fab580bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.787+0000 7fab5cded700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab58152730 0x7fab581e3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37378/0 (socket says 172.21.15.118:37378) 2023-07-13T13:53:02.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.787+0000 7fab5cded700 1 -- 172.21.15.118:0/2448346533 learned_addr learned my addr 172.21.15.118:0/2448346533 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:02.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.790+0000 7fab4ffff700 1 -- 172.21.15.118:0/2448346533 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 msgr2=0x7fab580bce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.790+0000 7fab4ffff700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 0x7fab580bce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.790+0000 7fab4ffff700 1 -- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab58152730 msgr2=0x7fab581e3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:02.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.790+0000 7fab4ffff700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab58152730 0x7fab581e3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:02.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.790+0000 7fab4ffff700 1 -- 172.21.15.118:0/2448346533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009550 con 0x7fab580c71c0 2023-07-13T13:53:02.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.792+0000 7fab4ffff700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab580c71c0 0x7fab5815b660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fab40016000 tx=0x7fab40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:02.768 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.796+0000 7fab557fa700 1 -- 172.21.15.118:0/2448346533 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40004450 con 0x7fab580c71c0 2023-07-13T13:53:02.769 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.796+0000 7fab557fa700 1 -- 172.21.15.118:0/2448346533 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4001e070 con 0x7fab580c71c0 2023-07-13T13:53:02.769 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.796+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab581eecd0 con 0x7fab580c71c0 2023-07-13T13:53:02.769 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.796+0000 7fab557fa700 1 -- 172.21.15.118:0/2448346533 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400038e0 con 0x7fab580c71c0 2023-07-13T13:53:02.769 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.796+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab580bc0c0 con 0x7fab580c71c0 2023-07-13T13:53:02.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.797+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5804e280 con 0x7fab580c71c0 2023-07-13T13:53:02.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.819+0000 7fab557fa700 1 -- 172.21.15.118:0/2448346533 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab40003a40 con 0x7fab580c71c0 2023-07-13T13:53:02.791 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.819+0000 7fab557fa700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fab3806ace0 0x7fab3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:02.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.820+0000 7fab57fff700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fab3806ace0 0x7fab3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:02.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.820+0000 7fab57fff700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fab3806ace0 0x7fab3806d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab48009b60 tx=0x7fab48009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:02.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:02.823+0000 7fab557fa700 1 -- 172.21.15.118:0/2448346533 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fab40010e90 con 0x7fab580c71c0 2023-07-13T13:53:03.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.065+0000 7fab557fa700 1 -- 172.21.15.118:0/2448346533 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab40055650 con 0x7fab580c71c0 2023-07-13T13:53:03.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.246+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab580c5670 con 0x7fab580c71c0 2023-07-13T13:53:03.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.254+0000 7fab557fa700 1 -- 172.21.15.118:0/2448346533 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab40058c70 con 0x7fab580c71c0 2023-07-13T13:53:03.226 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2023-07-13T13:53:03.227 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fab3806ace0 msgr2=0x7fab3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:03.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fab3806ace0 0x7fab3806d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab48009b60 tx=0x7fab48009210 comp rx=0 tx=0).stop 2023-07-13T13:53:03.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab580c71c0 msgr2=0x7fab5815b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:03.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab580c71c0 0x7fab5815b660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fab40016000 tx=0x7fab40004750 comp rx=0 tx=0).stop 2023-07-13T13:53:03.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 shutdown_connections 2023-07-13T13:53:03.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fab3806ace0 0x7fab3806d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab58152730 0x7fab581e3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fab580703b0 0x7fab580bce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 --2- 172.21.15.118:0/2448346533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab580c71c0 0x7fab5815b660 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 >> 172.21.15.118:0/2448346533 conn(0x7fab580cb800 msgr2=0x7fab580ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:03.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 shutdown_connections 2023-07-13T13:53:03.229 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.256+0000 7fab5e850700 1 -- 172.21.15.118:0/2448346533 wait complete. 2023-07-13T13:53:03.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-13T13:53:03.369 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.397+0000 7f540423e700 1 Processor -- start 2023-07-13T13:53:03.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.397+0000 7f540423e700 1 -- start start 2023-07-13T13:53:03.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.398+0000 7f540423e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f53fc1502c0 0x7f53fc0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.398+0000 7f540423e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc0c2970 0x7f53fc0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.398+0000 7f540423e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc156e40 con 0x7f53fc0c7d40 2023-07-13T13:53:03.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.398+0000 7f540423e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc06b950 con 0x7f53fc1502c0 2023-07-13T13:53:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.398+0000 7f540423e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc156250 con 0x7f53fc0c2970 2023-07-13T13:53:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.399+0000 7f5401fda700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f53fc1502c0 0x7f53fc0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:03.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.399+0000 7f54027db700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc0c2970 0x7f53fc0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.399+0000 7f54017d9700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f53fc0c7d40 0x7f53fc0c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43034/0 (socket says 172.21.15.118:43034) 2023-07-13T13:53:03.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.399+0000 7f54017d9700 1 -- 172.21.15.118:0/3965494966 learned_addr learned my addr 172.21.15.118:0/3965494966 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:53:03.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.402+0000 7f5400fd8700 1 -- 172.21.15.118:0/3965494966 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543008107 0 0) 0x7f53fc156e40 con 0x7f53fc0c7d40 2023-07-13T13:53:03.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.402+0000 7f5400fd8700 1 -- 172.21.15.118:0/3965494966 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e80035b0 con 0x7f53fc0c7d40 2023-07-13T13:53:03.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.402+0000 7f54027db700 1 -- 172.21.15.118:0/3965494966 >> v2:172.21.15.118:3300/0 conn(0x7f53fc1502c0 msgr2=0x7f53fc0c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:03.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.402+0000 7f54027db700 1 --2- 172.21.15.118:0/3965494966 >> v2:172.21.15.118:3300/0 conn(0x7f53fc1502c0 0x7f53fc0c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.402+0000 7f54027db700 1 -- 172.21.15.118:0/3965494966 >> v1:172.21.15.123:6789/0 conn(0x7f53fc0c7d40 legacy=0x7f53fc0c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:03.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.402+0000 7f54027db700 1 -- 172.21.15.118:0/3965494966 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc06c8f0 con 0x7f53fc0c2970 2023-07-13T13:53:03.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.404+0000 7f54027db700 1 --2- 172.21.15.118:0/3965494966 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc0c2970 0x7f53fc0c6750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009d90 tx=0x7f53f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1d74749f1ef90b server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:03.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.408+0000 7f5400fd8700 1 -- 172.21.15.118:0/3965494966 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400e070 con 0x7f53fc0c2970 2023-07-13T13:53:03.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.408+0000 7f5400fd8700 1 -- 172.21.15.118:0/3965494966 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f400bb20 con 0x7f53fc0c2970 2023-07-13T13:53:03.380 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.408+0000 7f5400fd8700 1 -- 172.21.15.118:0/3965494966 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4012430 con 0x7f53fc0c2970 2023-07-13T13:53:03.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.409+0000 7f540423e700 1 -- 172.21.15.118:0/3965494966 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc0c2970 msgr2=0x7f53fc0c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:03.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.409+0000 7f540423e700 1 --2- 172.21.15.118:0/3965494966 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc0c2970 0x7f53fc0c6750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009d90 tx=0x7f53f400b330 comp rx=0 tx=0).stop 2023-07-13T13:53:03.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.409+0000 7f540423e700 1 -- 172.21.15.118:0/3965494966 shutdown_connections 2023-07-13T13:53:03.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.409+0000 7f540423e700 1 --2- 172.21.15.118:0/3965494966 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc0c2970 0x7f53fc0c6750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.409+0000 7f540423e700 1 --2- 172.21.15.118:0/3965494966 >> v2:172.21.15.118:3300/0 conn(0x7f53fc1502c0 0x7f53fc0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.409+0000 7f540423e700 1 -- 172.21.15.118:0/3965494966 >> 172.21.15.118:0/3965494966 conn(0x7f53fc0cb800 msgr2=0x7f53fc0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:03.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.409+0000 7f540423e700 1 -- 172.21.15.118:0/3965494966 shutdown_connections 2023-07-13T13:53:03.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.409+0000 7f540423e700 1 -- 172.21.15.118:0/3965494966 wait complete. 2023-07-13T13:53:03.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.410+0000 7f540423e700 1 Processor -- start 2023-07-13T13:53:03.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.410+0000 7f540423e700 1 -- start start 2023-07-13T13:53:03.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.411+0000 7f540423e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc0c2970 0x7f53fc1efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:03.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.411+0000 7f540423e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0c7d40 0x7f53fc1e1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:03.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.411+0000 7f540423e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc1502c0 0x7f53fc0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:03.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.411+0000 7f540423e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1575a0 con 0x7f53fc0c2970 2023-07-13T13:53:03.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.411+0000 7f540423e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1f0090 con 0x7f53fc0c7d40 2023-07-13T13:53:03.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.411+0000 7f540423e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0c8a40 con 0x7f53fc1502c0 2023-07-13T13:53:03.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.411+0000 7f5401fda700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc0c2970 0x7f53fc1efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:03.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.412+0000 7f54027db700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc1502c0 0x7f53fc0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:03.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.412+0000 7f54017d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0c7d40 0x7f53fc1e1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:03.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.412+0000 7f54027db700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc1502c0 0x7f53fc0c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:52212/0 (socket says 172.21.15.118:52212) 2023-07-13T13:53:03.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.412+0000 7f54027db700 1 -- 172.21.15.118:0/597673165 learned_addr learned my addr 172.21.15.118:0/597673165 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:03.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.416+0000 7f5401fda700 1 -- 172.21.15.118:0/597673165 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc1502c0 msgr2=0x7f53fc0c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:03.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.416+0000 7f5401fda700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc1502c0 0x7f53fc0c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.416+0000 7f5401fda700 1 -- 172.21.15.118:0/597673165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0c7d40 msgr2=0x7f53fc1e1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:03.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.416+0000 7f5401fda700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0c7d40 0x7f53fc1e1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.416+0000 7f5401fda700 1 -- 172.21.15.118:0/597673165 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4009a70 con 0x7f53fc0c2970 2023-07-13T13:53:03.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.418+0000 7f5401fda700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc0c2970 0x7f53fc1efb50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00e870 tx=0x7f53ec00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:03.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.422+0000 7f53f27fc700 1 -- 172.21.15.118:0/597673165 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec013680 con 0x7f53fc0c2970 2023-07-13T13:53:03.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.422+0000 7f53f27fc700 1 -- 172.21.15.118:0/597673165 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec0137e0 con 0x7f53fc0c2970 2023-07-13T13:53:03.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.422+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc14b770 con 0x7f53fc0c2970 2023-07-13T13:53:03.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.422+0000 7f53f27fc700 1 -- 172.21.15.118:0/597673165 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec013b90 con 0x7f53fc0c2970 2023-07-13T13:53:03.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.422+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc0c8c90 con 0x7f53fc0c2970 2023-07-13T13:53:03.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.423+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc0c3b80 con 0x7f53fc0c2970 2023-07-13T13:53:03.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.650+0000 7f53f27fc700 1 -- 172.21.15.118:0/597673165 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53ec013cf0 con 0x7f53fc0c2970 2023-07-13T13:53:03.622 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.651+0000 7f53f27fc700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f53e006ad60 0x7f53e006d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:03.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.651+0000 7f54017d9700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f53e006ad60 0x7f53e006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:03.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.651+0000 7f54017d9700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f53e006ad60 0x7f53e006d210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53fc1e2660 tx=0x7f53f8009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:03.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.684+0000 7f53f27fc700 1 -- 172.21.15.118:0/597673165 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f53ec05c720 con 0x7f53fc0c2970 2023-07-13T13:53:03.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.684+0000 7f53f27fc700 1 -- 172.21.15.118:0/597673165 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f53ec054aa0 con 0x7f53fc0c2970 2023-07-13T13:53:03.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.882+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f53fc04e280 con 0x7f53fc0c2970 2023-07-13T13:53:03.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.889+0000 7f53f27fc700 1 -- 172.21.15.118:0/597673165 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f53ec0170a0 con 0x7f53fc0c2970 2023-07-13T13:53:03.861 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T13:53:03.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f53e006ad60 msgr2=0x7f53e006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:03.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f53e006ad60 0x7f53e006d210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f53fc1e2660 tx=0x7f53f8009040 comp rx=0 tx=0).stop 2023-07-13T13:53:03.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc0c2970 msgr2=0x7f53fc1efb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:03.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc0c2970 0x7f53fc1efb50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00e870 tx=0x7f53ec00eb80 comp rx=0 tx=0).stop 2023-07-13T13:53:03.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 shutdown_connections 2023-07-13T13:53:03.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f53e006ad60 0x7f53e006d210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f53fc1502c0 0x7f53fc0c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53fc0c2970 0x7f53fc1efb50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 --2- 172.21.15.118:0/597673165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53fc0c7d40 0x7f53fc1e1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:03.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 >> 172.21.15.118:0/597673165 conn(0x7f53fc0cb800 msgr2=0x7f53fc14ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:03.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 shutdown_connections 2023-07-13T13:53:03.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:03.891+0000 7f540423e700 1 -- 172.21.15.118:0/597673165 wait complete. 2023-07-13T13:53:03.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T13:53:03.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.023+0000 7f05ac30f700 1 Processor -- start 2023-07-13T13:53:03.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.023+0000 7f05ac30f700 1 -- start start 2023-07-13T13:53:03.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.024+0000 7f05ac30f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05a40c90c0 0x7f05a40c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:03.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.024+0000 7f05ac30f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f05a4158390 0x7f05a4162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:03.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.024+0000 7f05ac30f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a40c8b40 con 0x7f05a40c99c0 2023-07-13T13:53:03.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.024+0000 7f05ac30f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a406c080 con 0x7f05a4158390 2023-07-13T13:53:03.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.024+0000 7f05ac30f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a40ca910 con 0x7f05a40c90c0 2023-07-13T13:53:03.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.025+0000 7f05a98aa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05a40c90c0 0x7f05a40c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:03.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.025+0000 7f05aa8ac700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f05a4158390 0x7f05a4162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:03.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.025+0000 7f05a98aa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05a40c90c0 0x7f05a40c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:53310/0 (socket says 172.21.15.118:53310) 2023-07-13T13:53:03.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.025+0000 7f05a98aa700 1 -- 172.21.15.118:0/3189727763 learned_addr learned my addr 172.21.15.118:0/3189727763 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.028+0000 7f05a98aa700 1 -- 172.21.15.118:0/3189727763 >> v2:172.21.15.118:3300/0 conn(0x7f05a4158390 msgr2=0x7f05a4162cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.028+0000 7f05a98aa700 1 --2- 172.21.15.118:0/3189727763 >> v2:172.21.15.118:3300/0 conn(0x7f05a4158390 0x7f05a4162cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.028+0000 7f05a98aa700 1 -- 172.21.15.118:0/3189727763 >> v1:172.21.15.118:6789/0 conn(0x7f05a40c99c0 legacy=0x7f05a40c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:04.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.028+0000 7f05a98aa700 1 -- 172.21.15.118:0/3189727763 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a40ca2d0 con 0x7f05a40c90c0 2023-07-13T13:53:04.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.030+0000 7f05a98aa700 1 --2- 172.21.15.118:0/3189727763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 0x7f05a40c9d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f05a406a2b0 tx=0x7f0594009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e864c6e4beec2c10 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:04.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.034+0000 7f05a90a9700 1 -- 172.21.15.118:0/3189727763 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594011830 con 0x7f05a40c90c0 2023-07-13T13:53:04.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.034+0000 7f05a90a9700 1 -- 172.21.15.118:0/3189727763 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0594011990 con 0x7f05a40c90c0 2023-07-13T13:53:04.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.034+0000 7f05a90a9700 1 -- 172.21.15.118:0/3189727763 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594011d20 con 0x7f05a40c90c0 2023-07-13T13:53:04.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.035+0000 7f05ac30f700 1 -- 172.21.15.118:0/3189727763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 msgr2=0x7f05a40c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:04.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.035+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3189727763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 0x7f05a40c9d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f05a406a2b0 tx=0x7f0594009bd0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.035+0000 7f05ac30f700 1 -- 172.21.15.118:0/3189727763 shutdown_connections 2023-07-13T13:53:04.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.035+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3189727763 >> v2:172.21.15.118:3300/0 conn(0x7f05a4158390 0x7f05a4162cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.035+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3189727763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 0x7f05a40c9d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.035+0000 7f05ac30f700 1 -- 172.21.15.118:0/3189727763 >> 172.21.15.118:0/3189727763 conn(0x7f05a406c750 msgr2=0x7f05a406cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:04.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.035+0000 7f05ac30f700 1 -- 172.21.15.118:0/3189727763 shutdown_connections 2023-07-13T13:53:04.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.035+0000 7f05ac30f700 1 -- 172.21.15.118:0/3189727763 wait complete. 2023-07-13T13:53:04.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.036+0000 7f05ac30f700 1 Processor -- start 2023-07-13T13:53:04.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.036+0000 7f05ac30f700 1 -- start start 2023-07-13T13:53:04.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.037+0000 7f05ac30f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 0x7f05a4159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:04.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.037+0000 7f05ac30f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a40c99c0 0x7f05a414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:04.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.037+0000 7f05ac30f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05a4158390 0x7f05a41e3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:04.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.037+0000 7f05ac30f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a41eea10 con 0x7f05a40c99c0 2023-07-13T13:53:04.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.037+0000 7f05ac30f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a41517d0 con 0x7f05a40c90c0 2023-07-13T13:53:04.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.037+0000 7f05ac30f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4157d00 con 0x7f05a4158390 2023-07-13T13:53:04.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.037+0000 7f05a98aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a40c99c0 0x7f05a414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:04.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.037+0000 7f05aa8ac700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05a4158390 0x7f05a41e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:04.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.038+0000 7f05aa0ab700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 0x7f05a4159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:04.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.038+0000 7f05a98aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a40c99c0 0x7f05a414f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37422/0 (socket says 172.21.15.118:37422) 2023-07-13T13:53:04.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.038+0000 7f05a98aa700 1 -- 172.21.15.118:0/3885316801 learned_addr learned my addr 172.21.15.118:0/3885316801 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:04.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.041+0000 7f05a98aa700 1 -- 172.21.15.118:0/3885316801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05a4158390 msgr2=0x7f05a41e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:04.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.041+0000 7f05a98aa700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05a4158390 0x7f05a41e3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.041+0000 7f05a98aa700 1 -- 172.21.15.118:0/3885316801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 msgr2=0x7f05a4159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:04.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.041+0000 7f05a98aa700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 0x7f05a4159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.041+0000 7f05a98aa700 1 -- 172.21.15.118:0/3885316801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594009550 con 0x7f05a40c99c0 2023-07-13T13:53:04.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.044+0000 7f05a98aa700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a40c99c0 0x7f05a414f7d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0594009c10 tx=0x7f0594004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:04.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.048+0000 7f059affd700 1 -- 172.21.15.118:0/3885316801 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594004380 con 0x7f05a40c99c0 2023-07-13T13:53:04.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.048+0000 7f059affd700 1 -- 172.21.15.118:0/3885316801 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059401f070 con 0x7f05a40c99c0 2023-07-13T13:53:04.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.048+0000 7f059affd700 1 -- 172.21.15.118:0/3885316801 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05940036a0 con 0x7f05a40c99c0 2023-07-13T13:53:04.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.048+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a414ec80 con 0x7f05a40c99c0 2023-07-13T13:53:04.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.048+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a4158190 con 0x7f05a40c99c0 2023-07-13T13:53:04.020 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.049+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a40cf240 con 0x7f05a40c99c0 2023-07-13T13:53:04.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.067+0000 7f059affd700 1 -- 172.21.15.118:0/3885316801 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0594021030 con 0x7f05a40c99c0 2023-07-13T13:53:04.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.068+0000 7f059affd700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f058806ad30 0x7f058806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:04.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.068+0000 7f05aa0ab700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f058806ad30 0x7f058806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:04.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.068+0000 7f05aa0ab700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f058806ad30 0x7f058806d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f05a0007fd0 tx=0x7f05a0009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:04.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.311+0000 7f059affd700 1 -- 172.21.15.118:0/3885316801 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0594010380 con 0x7f05a40c99c0 2023-07-13T13:53:04.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.311+0000 7f059affd700 1 -- 172.21.15.118:0/3885316801 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0594055c50 con 0x7f05a40c99c0 2023-07-13T13:53:04.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.536+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05a40743c0 con 0x7f05a40c99c0 2023-07-13T13:53:04.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.553+0000 7f059affd700 1 -- 172.21.15.118:0/3885316801 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6197 (secure 0 0 0) 0x7f0594015020 con 0x7f05a40c99c0 2023-07-13T13:53:04.524 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T13:53:04.525 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1760692596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1760692596},{"type":"v1","addr":"172.21.15.118:6835","nonce":1760692596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3512155037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3512155037},{"type":"v1","addr":"172.21.15.123:6833","nonce":3512155037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/439561314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":439561314},{"type":"v1","addr":"172.21.15.123:6835","nonce":439561314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2359037201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359037201},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359037201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3040631544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3040631544},{"type":"v1","addr":"172.21.15.118:6839","nonce":3040631544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-13T13:52:17.418144+0000","modified":"2023-07-13T13:52:47.871510+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/3588922803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":3588922803},{"type":"v1","addr":"172.21.15.118:6837","nonce":3588922803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-13T13:53:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f058806ad30 msgr2=0x7f058806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f058806ad30 0x7f058806d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f05a0007fd0 tx=0x7f05a0009040 comp rx=0 tx=0).stop 2023-07-13T13:53:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a40c99c0 msgr2=0x7f05a414f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a40c99c0 0x7f05a414f7d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0594009c10 tx=0x7f0594004750 comp rx=0 tx=0).stop 2023-07-13T13:53:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 shutdown_connections 2023-07-13T13:53:04.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f058806ad30 0x7f058806d1e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a40c90c0 0x7f05a4159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f05a4158390 0x7f05a41e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 --2- 172.21.15.118:0/3885316801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f05a40c99c0 0x7f05a414f7d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:04.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 >> 172.21.15.118:0/3885316801 conn(0x7f05a406c750 msgr2=0x7f05a4158760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:04.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 shutdown_connections 2023-07-13T13:53:04.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:04.555+0000 7f05ac30f700 1 -- 172.21.15.118:0/3885316801 wait complete. 2023-07-13T13:53:04.529 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 10 2023-07-13T13:53:05.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-13T13:52:17.418144+0000', 'modified': '2023-07-13T13:52:47.871510+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4321': {'gid': 4321, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.118:6837/3588922803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6836', 'nonce': 3588922803}, {'type': 'v1', 'addr': '172.21.15.118:6837', 'nonce': 3588922803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-13T13:53:05.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-13T13:53:05.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-07-13T13:53:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.294+0000 7f6875bbf700 1 Processor -- start 2023-07-13T13:53:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.294+0000 7f6875bbf700 1 -- start start 2023-07-13T13:53:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.295+0000 7f6875bbf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68700cc7e0 0x7f687015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.295+0000 7f6875bbf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f687015f050 0x7f6870161430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.295+0000 7f6875bbf700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700c78f0 con 0x7f68700cc410 2023-07-13T13:53:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.295+0000 7f6875bbf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687006dad0 con 0x7f687015f050 2023-07-13T13:53:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.295+0000 7f6875bbf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6870156770 con 0x7f68700cc7e0 2023-07-13T13:53:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.296+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68700cc7e0 0x7f687015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.296+0000 7f686ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f687015f050 0x7f6870161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.296+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68700cc7e0 0x7f687015eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:52234/0 (socket says 172.21.15.118:52234) 2023-07-13T13:53:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.296+0000 7f686effd700 1 -- 172.21.15.118:0/1795923871 learned_addr learned my addr 172.21.15.118:0/1795923871 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:05.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.299+0000 7f686ffff700 1 -- 172.21.15.118:0/1795923871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68700cc7e0 msgr2=0x7f687015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.299+0000 7f686ffff700 1 --2- 172.21.15.118:0/1795923871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68700cc7e0 0x7f687015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.299+0000 7f686ffff700 1 -- 172.21.15.118:0/1795923871 >> v1:172.21.15.123:6789/0 conn(0x7f68700cc410 legacy=0x7f6870156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.299+0000 7f686ffff700 1 -- 172.21.15.118:0/1795923871 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700c7650 con 0x7f687015f050 2023-07-13T13:53:05.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.299+0000 7f686effd700 1 --2- 172.21.15.118:0/1795923871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68700cc7e0 0x7f687015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:53:05.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.303+0000 7f686ffff700 1 --2- 172.21.15.118:0/1795923871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687015f050 0x7f6870161430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f686800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c027be63e1ed074 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f686e7fc700 1 -- 172.21.15.118:0/1795923871 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800e070 con 0x7f687015f050 2023-07-13T13:53:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f686e7fc700 1 -- 172.21.15.118:0/1795923871 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686800bae0 con 0x7f687015f050 2023-07-13T13:53:05.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f686e7fc700 1 -- 172.21.15.118:0/1795923871 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800be90 con 0x7f687015f050 2023-07-13T13:53:05.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f6875bbf700 1 -- 172.21.15.118:0/1795923871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687015f050 msgr2=0x7f6870161430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1795923871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687015f050 0x7f6870161430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f686800b330 comp rx=0 tx=0).stop 2023-07-13T13:53:05.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f6875bbf700 1 -- 172.21.15.118:0/1795923871 shutdown_connections 2023-07-13T13:53:05.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1795923871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f687015f050 0x7f6870161430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1795923871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68700cc7e0 0x7f687015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f6875bbf700 1 -- 172.21.15.118:0/1795923871 >> 172.21.15.118:0/1795923871 conn(0x7f6870069f30 msgr2=0x7f687006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:05.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f6875bbf700 1 -- 172.21.15.118:0/1795923871 shutdown_connections 2023-07-13T13:53:05.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.308+0000 7f6875bbf700 1 -- 172.21.15.118:0/1795923871 wait complete. 2023-07-13T13:53:05.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.310+0000 7f6875bbf700 1 Processor -- start 2023-07-13T13:53:05.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.310+0000 7f6875bbf700 1 -- start start 2023-07-13T13:53:05.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f6875bbf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68700cc410 0x7f68700c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f6875bbf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68700cc7e0 0x7f68701524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f6875bbf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687015f050 0x7f68701529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f6875bbf700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701540d0 con 0x7f68700cc410 2023-07-13T13:53:05.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f6875bbf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870156090 con 0x7f68700cc7e0 2023-07-13T13:53:05.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f6875bbf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6870154320 con 0x7f687015f050 2023-07-13T13:53:05.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68700cc7e0 0x7f68701524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f686ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687015f050 0x7f68701529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.311+0000 7f686f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68700cc410 0x7f68700c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.312+0000 7f686ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687015f050 0x7f68701529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:52250/0 (socket says 172.21.15.118:52250) 2023-07-13T13:53:05.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.312+0000 7f686ffff700 1 -- 172.21.15.118:0/1301872847 learned_addr learned my addr 172.21.15.118:0/1301872847 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.316+0000 7f686effd700 1 -- 172.21.15.118:0/1301872847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687015f050 msgr2=0x7f68701529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.316+0000 7f686effd700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687015f050 0x7f68701529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.316+0000 7f686effd700 1 -- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68700cc410 msgr2=0x7f68700c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.316+0000 7f686effd700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68700cc410 0x7f68700c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.288 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.316+0000 7f686effd700 1 -- 172.21.15.118:0/1301872847 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860009550 con 0x7f68700cc7e0 2023-07-13T13:53:05.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.319+0000 7f686effd700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68700cc7e0 0x7f68701524a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f686000e9a0 tx=0x7f686000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.323+0000 7f6867fff700 1 -- 172.21.15.118:0/1301872847 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860004030 con 0x7f68700cc7e0 2023-07-13T13:53:05.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.323+0000 7f6867fff700 1 -- 172.21.15.118:0/1301872847 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6860004190 con 0x7f68700cc7e0 2023-07-13T13:53:05.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.323+0000 7f6875bbf700 1 -- 172.21.15.118:0/1301872847 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6868009a70 con 0x7f68700cc7e0 2023-07-13T13:53:05.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.323+0000 7f6867fff700 1 -- 172.21.15.118:0/1301872847 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860004500 con 0x7f68700cc7e0 2023-07-13T13:53:05.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.323+0000 7f6875bbf700 1 -- 172.21.15.118:0/1301872847 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68701548e0 con 0x7f68700cc7e0 2023-07-13T13:53:05.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.326+0000 7f6881d5ab80 1 Processor -- start 2023-07-13T13:53:05.298 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.326+0000 7f6881d5ab80 1 -- start start 2023-07-13T13:53:05.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.327+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459e44d0 0x5617459de630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.327+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.327+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a0d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.327+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745958ea0 con 0x5617459deb70 2023-07-13T13:53:05.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.327+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617458cc600 con 0x5617459e44d0 2023-07-13T13:53:05.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.327+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x56174593b910 con 0x5617459e48a0 2023-07-13T13:53:05.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.328+0000 7f686f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.300 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.328+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a0d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.328+0000 7f686f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37440/0 (socket says 172.21.15.118:37440) 2023-07-13T13:53:05.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.328+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a0d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:52266/0 (socket says 172.21.15.118:52266) 2023-07-13T13:53:05.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.328+0000 7f686f7fe700 1 -- 172.21.15.118:0/339226425 learned_addr learned my addr 172.21.15.118:0/339226425 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:05.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.331+0000 7f686f7fe700 1 -- 172.21.15.118:0/339226425 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 msgr2=0x561745a0d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.331+0000 7f686f7fe700 1 --2- 172.21.15.118:0/339226425 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a0d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.331+0000 7f686f7fe700 1 -- 172.21.15.118:0/339226425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459e44d0 msgr2=0x5617459de630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.331+0000 7f686f7fe700 1 --2- 172.21.15.118:0/339226425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459e44d0 0x5617459de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.331+0000 7f686f7fe700 1 -- 172.21.15.118:0/339226425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561745728790 con 0x5617459deb70 2023-07-13T13:53:05.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.331+0000 7f686effd700 1 --2- 172.21.15.118:0/339226425 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a0d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:53:05.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.333+0000 7f686f7fe700 1 --2- 172.21.15.118:0/339226425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0cc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6858001980 tx=0x7f6858007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5d3c18b4b6420d server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f68657fa700 1 -- 172.21.15.118:0/339226425 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858001450 con 0x5617459deb70 2023-07-13T13:53:05.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f68657fa700 1 -- 172.21.15.118:0/339226425 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580052e0 con 0x5617459deb70 2023-07-13T13:53:05.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f68657fa700 1 -- 172.21.15.118:0/339226425 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858003680 con 0x5617459deb70 2023-07-13T13:53:05.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f6881d5ab80 1 -- 172.21.15.118:0/339226425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 msgr2=0x561745a0cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/339226425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0cc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6858001980 tx=0x7f6858007ea0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f6881d5ab80 1 -- 172.21.15.118:0/339226425 shutdown_connections 2023-07-13T13:53:05.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/339226425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459e44d0 0x5617459de630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/339226425 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a0d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/339226425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0cc30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.337+0000 7f6881d5ab80 1 -- 172.21.15.118:0/339226425 >> 172.21.15.118:0/339226425 conn(0x5617459d9320 msgr2=0x5617459e1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:05.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.338+0000 7f6881d5ab80 1 -- 172.21.15.118:0/339226425 shutdown_connections 2023-07-13T13:53:05.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.338+0000 7f6881d5ab80 1 -- 172.21.15.118:0/339226425 wait complete. 2023-07-13T13:53:05.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.338+0000 7f6881d5ab80 1 -- start start 2023-07-13T13:53:05.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.338+0000 7f6881d5ab80 1 Processor -- start 2023-07-13T13:53:05.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.339+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.339+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459e44d0 0x561745a22420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.339+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a10310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.339+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745934be0 con 0x5617459deb70 2023-07-13T13:53:05.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.340+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617458f25b0 con 0x5617459e44d0 2023-07-13T13:53:05.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.340+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617458d8910 con 0x5617459e48a0 2023-07-13T13:53:05.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.340+0000 7f6881d5ab80 10 client.0 _ll_register_callbacks cb 0x5617458f0b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-13T13:53:05.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.340+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a10310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.340+0000 7f686ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.341+0000 7f686ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37448/0 (socket says 172.21.15.118:37448) 2023-07-13T13:53:05.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.341+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a10310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:52274/0 (socket says 172.21.15.118:52274) 2023-07-13T13:53:05.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.341+0000 7f686ffff700 1 -- 172.21.15.118:0/866700685 learned_addr learned my addr 172.21.15.118:0/866700685 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:05.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.344+0000 7f686effd700 1 -- 172.21.15.118:0/866700685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459e44d0 msgr2=0x561745a22420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.315 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.344+0000 7f686effd700 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459e44d0 0x561745a22420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.344+0000 7f686effd700 1 -- 172.21.15.118:0/866700685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 msgr2=0x561745a0f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.344+0000 7f686effd700 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.344+0000 7f686effd700 1 -- 172.21.15.118:0/866700685 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68701548e0 con 0x5617459e48a0 2023-07-13T13:53:05.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.344+0000 7f6867fff700 1 -- 172.21.15.118:0/1301872847 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6860013470 con 0x7f68700cc7e0 2023-07-13T13:53:05.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.345+0000 7f6867fff700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f685006ac50 0x7f685006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.345+0000 7f686ffff700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f685006ac50 0x7f685006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.345+0000 7f686ffff700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f685006ac50 0x7f685006d100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f686800d010 tx=0x7f6868010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.346+0000 7f686effd700 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a10310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6860018000 tx=0x7f6860011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91750f7df2c6552b server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.346+0000 7f684e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.123:3301/0 2023-07-13T13:53:05.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.350+0000 7f6867fff700 1 -- 172.21.15.118:0/1301872847 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f686005fef0 con 0x7f68700cc7e0 2023-07-13T13:53:05.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.352+0000 7f684e7fc700 1 -- 172.21.15.118:0/866700685 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686002c040 con 0x5617459e48a0 2023-07-13T13:53:05.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.352+0000 7f684e7fc700 1 -- 172.21.15.118:0/866700685 <== mon.2 v2:172.21.15.123:3301/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6860063f20 con 0x5617459e48a0 2023-07-13T13:53:05.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.352+0000 7f6881d5ab80 1 -- 172.21.15.118:0/866700685 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617459d6930 con 0x5617459e48a0 2023-07-13T13:53:05.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.354+0000 7f684e7fc700 1 -- 172.21.15.118:0/866700685 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f686005c230 con 0x5617459e48a0 2023-07-13T13:53:05.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.354+0000 7f6881d5ab80 10 client.4568 fetch_fsmap learned FSMap version 10 2023-07-13T13:53:05.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.354+0000 7f6881d5ab80 1 -- 172.21.15.118:0/866700685 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x7f68580015b0 con 0x5617459e48a0 2023-07-13T13:53:05.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.370+0000 7f684e7fc700 1 -- 172.21.15.118:0/866700685 <== mon.2 v2:172.21.15.123:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5617459d6930 con 0x5617459e48a0 2023-07-13T13:53:05.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.370+0000 7f684e7fc700 1 -- 172.21.15.118:0/866700685 <== mon.2 v2:172.21.15.123:3301/0 5 ==== fsmap(e 10) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f686005c600 con 0x5617459e48a0 2023-07-13T13:53:05.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.370+0000 7f6881d5ab80 10 client.4568 fetch_fsmap finished waiting for FSMap version 10 2023-07-13T13:53:05.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.370+0000 7f6881d5ab80 10 client.4568 resolve_mds: resolved name 'e' to daemon mds.e 2023-07-13T13:53:05.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.370+0000 7f6881d5ab80 20 client.4568 populate_metadata read hostname 'smithi118' 2023-07-13T13:53:05.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.370+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x561745a37740 0x561745a37b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.370+0000 7f6881d5ab80 4 client.4568 mds_command: new command op to 4321 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-13T13:53:05.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.370+0000 7f6881d5ab80 1 -- 172.21.15.118:0/866700685 --> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617459b30e0 con 0x561745a37740 2023-07-13T13:53:05.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.371+0000 7f686f7fe700 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x561745a37740 0x561745a37b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.374+0000 7f686f7fe700 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x561745a37740 0x561745a37b10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdfb3cef1ad14ddc server_cookie=450ded0a1653f052 in_seq=0 out_seq=0 2023-07-13T13:53:05.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.374+0000 7f684e7fc700 10 client.4568 ms_handle_connect on v2:172.21.15.118:6836/3588922803 2023-07-13T13:53:05.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.393+0000 7f684e7fc700 1 -- 172.21.15.118:0/866700685 <== mds.0 v2:172.21.15.118:6836/3588922803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5617459b30e0 con 0x561745a37740 2023-07-13T13:53:05.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.393+0000 7f684e7fc700 10 client.4568 handle_command_reply: tid=0 2023-07-13T13:53:05.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.393+0000 7f6881d5ab80 1 client.4568 shutdown 2023-07-13T13:53:05.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.393+0000 7f6881d5ab80 1 -- 172.21.15.118:0/866700685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 msgr2=0x561745a10310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.393+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a10310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6860018000 tx=0x7f6860011000 comp rx=0 tx=0).stop 2023-07-13T13:53:05.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.393+0000 7f6881d5ab80 1 -- 172.21.15.118:0/866700685 shutdown_connections 2023-07-13T13:53:05.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.393+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x561745a37740 0x561745a37b10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.394+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e48a0 0x561745a10310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.394+0000 7f684e7fc700 0 client.4568 ms_handle_reset on v2:172.21.15.118:6836/3588922803 2023-07-13T13:53:05.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.394+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459deb70 0x561745a0f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.394+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/866700685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459e44d0 0x561745a22420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.394+0000 7f6881d5ab80 1 -- 172.21.15.118:0/866700685 >> 172.21.15.118:0/866700685 conn(0x5617459d9320 msgr2=0x561745a23500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:05.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.394+0000 7f6881d5ab80 1 -- 172.21.15.118:0/866700685 shutdown_connections 2023-07-13T13:53:05.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.394+0000 7f6881d5ab80 1 -- 172.21.15.118:0/866700685 wait complete. 2023-07-13T13:53:05.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.394+0000 7f6881d5ab80 20 client.4568 trim_cache size 0 max 16384 2023-07-13T13:53:05.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.411+0000 7f6881d5ab80 1 Processor -- start 2023-07-13T13:53:05.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.411+0000 7f6881d5ab80 1 -- start start 2023-07-13T13:53:05.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.412+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a0cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.412+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 0x561745a22230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.412+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a22770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.412+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745729390 con 0x5617459e48a0 2023-07-13T13:53:05.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.412+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745a34900 con 0x5617459deb70 2023-07-13T13:53:05.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.412+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x561745a34480 con 0x5617459e44d0 2023-07-13T13:53:05.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.413+0000 7f686ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a22770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.413+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 0x561745a22230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.413+0000 7f686f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a0cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.413+0000 7f686ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a22770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:37464/0 (socket says 172.21.15.118:37464) 2023-07-13T13:53:05.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.413+0000 7f686ffff700 1 -- 172.21.15.118:0/1675096916 learned_addr learned my addr 172.21.15.118:0/1675096916 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:05.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.416+0000 7f686ffff700 1 -- 172.21.15.118:0/1675096916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 msgr2=0x561745a22230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.416+0000 7f686ffff700 1 --2- 172.21.15.118:0/1675096916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 0x561745a22230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.416+0000 7f686ffff700 1 -- 172.21.15.118:0/1675096916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 msgr2=0x561745a0cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.416+0000 7f686ffff700 1 --2- 172.21.15.118:0/1675096916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a0cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.416+0000 7f686ffff700 1 -- 172.21.15.118:0/1675096916 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617458150a0 con 0x5617459e48a0 2023-07-13T13:53:05.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.418+0000 7f686ffff700 1 --2- 172.21.15.118:0/1675096916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a22770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f68680042f0 tx=0x7f6868011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c0197854921c80 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.420+0000 7f6865ffb700 1 -- 172.21.15.118:0/1675096916 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868030430 con 0x5617459e48a0 2023-07-13T13:53:05.392 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.421+0000 7f6865ffb700 1 -- 172.21.15.118:0/1675096916 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686802b070 con 0x5617459e48a0 2023-07-13T13:53:05.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.421+0000 7f6865ffb700 1 -- 172.21.15.118:0/1675096916 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868030790 con 0x5617459e48a0 2023-07-13T13:53:05.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1675096916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 msgr2=0x561745a22770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1675096916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a22770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f68680042f0 tx=0x7f6868011000 comp rx=0 tx=0).stop 2023-07-13T13:53:05.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1675096916 shutdown_connections 2023-07-13T13:53:05.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1675096916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a0cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1675096916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a22770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1675096916 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 0x561745a22230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1675096916 >> 172.21.15.118:0/1675096916 conn(0x5617459d9320 msgr2=0x5617459da890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:05.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1675096916 shutdown_connections 2023-07-13T13:53:05.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1675096916 wait complete. 2023-07-13T13:53:05.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 -- start start 2023-07-13T13:53:05.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.422+0000 7f6881d5ab80 1 Processor -- start 2023-07-13T13:53:05.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.423+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a903f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.423+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 0x5617459df340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.423+0000 7f6881d5ab80 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a8a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.423+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745a0ece0 con 0x5617459e48a0 2023-07-13T13:53:05.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.423+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745a90dd0 con 0x5617459deb70 2023-07-13T13:53:05.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.423+0000 7f6881d5ab80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x561745a0e9f0 con 0x5617459e44d0 2023-07-13T13:53:05.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.423+0000 7f6881d5ab80 10 client.0 _ll_register_callbacks cb 0x7f6860003be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-13T13:53:05.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.424+0000 7f686ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a8a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.424+0000 7f686f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.424+0000 7f686effd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 0x5617459df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.424+0000 7f686f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:53376/0 (socket says 172.21.15.118:53376) 2023-07-13T13:53:05.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.424+0000 7f686f7fe700 1 -- 172.21.15.118:0/1262734731 learned_addr learned my addr 172.21.15.118:0/1262734731 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:05.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.427+0000 7f686ffff700 1 -- 172.21.15.118:0/1262734731 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 msgr2=0x5617459df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.427+0000 7f686ffff700 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 0x5617459df340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.427+0000 7f686ffff700 1 -- 172.21.15.118:0/1262734731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 msgr2=0x561745a903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.427+0000 7f686ffff700 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a903f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.427+0000 7f686ffff700 1 -- 172.21.15.118:0/1262734731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68700c7650 con 0x5617459e48a0 2023-07-13T13:53:05.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.429+0000 7f686ffff700 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a8a2a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f686802d000 tx=0x7f6868004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cde37e5eefe23f server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.429+0000 7f684e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2023-07-13T13:53:05.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.433+0000 7f684e7fc700 1 -- 172.21.15.118:0/1262734731 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868030430 con 0x5617459e48a0 2023-07-13T13:53:05.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.433+0000 7f684e7fc700 1 -- 172.21.15.118:0/1262734731 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6868030590 con 0x5617459e48a0 2023-07-13T13:53:05.405 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.433+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1262734731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68580052e0 con 0x5617459e48a0 2023-07-13T13:53:05.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.435+0000 7f684e7fc700 1 -- 172.21.15.118:0/1262734731 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6868030750 con 0x5617459e48a0 2023-07-13T13:53:05.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.435+0000 7f6881d5ab80 10 client.4659 fetch_fsmap learned FSMap version 10 2023-07-13T13:53:05.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.435+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1262734731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x5617458fab10 con 0x5617459e48a0 2023-07-13T13:53:05.413 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.441+0000 7f684e7fc700 1 -- 172.21.15.118:0/1262734731 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580052e0 con 0x5617459e48a0 2023-07-13T13:53:05.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.445+0000 7f684e7fc700 1 -- 172.21.15.118:0/1262734731 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 10) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f686803f020 con 0x5617459e48a0 2023-07-13T13:53:05.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.445+0000 7f6881d5ab80 10 client.4659 fetch_fsmap finished waiting for FSMap version 10 2023-07-13T13:53:05.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.445+0000 7f6881d5ab80 10 client.4659 resolve_mds: resolved name 'e' to daemon mds.e 2023-07-13T13:53:05.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.445+0000 7f6881d5ab80 20 client.4659 populate_metadata read hostname 'smithi118' 2023-07-13T13:53:05.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.445+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x561745a37740 0x561745a8a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.445+0000 7f6881d5ab80 4 client.4659 mds_command: new command op to 4321 tid=0[{"prefix": "status"}] 2023-07-13T13:53:05.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.445+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1262734731 --> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56174592dd20 con 0x561745a37740 2023-07-13T13:53:05.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.446+0000 7f686f7fe700 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x561745a37740 0x561745a8a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.448+0000 7f684e7fc700 10 client.4659 ms_handle_connect on v2:172.21.15.118:6836/3588922803 2023-07-13T13:53:05.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.448+0000 7f686f7fe700 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x561745a37740 0x561745a8a7e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9539aedda755e16 server_cookie=8bd38819a9ccbed7 in_seq=0 out_seq=0 2023-07-13T13:53:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f684e7fc700 1 -- 172.21.15.118:0/1262734731 <== mds.0 v2:172.21.15.118:6836/3588922803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56174592dd20 con 0x561745a37740 2023-07-13T13:53:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f684e7fc700 10 client.4659 handle_command_reply: tid=0 2023-07-13T13:53:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 client.4659 shutdown 2023-07-13T13:53:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1262734731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 msgr2=0x561745a8a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a8a2a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f686802d000 tx=0x7f6868004b40 comp rx=0 tx=0).stop 2023-07-13T13:53:05.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1262734731 shutdown_connections 2023-07-13T13:53:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.118:6836/3588922803,v1:172.21.15.118:6837/3588922803] conn(0x561745a37740 0x561745a8a7e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5617459deb70 0x561745a903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f684e7fc700 0 client.4659 ms_handle_reset on v2:172.21.15.118:6836/3588922803 2023-07-13T13:53:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5617459e48a0 0x561745a8a2a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 --2- 172.21.15.118:0/1262734731 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x5617459e44d0 0x5617459df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1262734731 >> 172.21.15.118:0/1262734731 conn(0x5617459d9320 msgr2=0x561745a22000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:05.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1262734731 shutdown_connections 2023-07-13T13:53:05.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 1 -- 172.21.15.118:0/1262734731 wait complete. 2023-07-13T13:53:05.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.452+0000 7f6881d5ab80 20 client.4659 trim_cache size 0 max 16384 2023-07-13T13:53:05.426 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T13:53:05.426 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "1835fe1d-409c-4aad-9a14-d592cbe8c9c2", 2023-07-13T13:53:05.426 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2023-07-13T13:53:05.427 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4321, 2023-07-13T13:53:05.427 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2023-07-13T13:53:05.427 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2023-07-13T13:53:05.427 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2023-07-13T13:53:05.427 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 47.219467838, 2023-07-13T13:53:05.427 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 10, 2023-07-13T13:53:05.427 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 31, 2023-07-13T13:53:05.427 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 29, 2023-07-13T13:53:05.428 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 56.251118376000001 2023-07-13T13:53:05.428 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T13:53:05.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 -- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f685006ac50 msgr2=0x7f685006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f685006ac50 0x7f685006d100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f686800d010 tx=0x7f6868010000 comp rx=0 tx=0).stop 2023-07-13T13:53:05.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 -- 172.21.15.118:0/1301872847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68700cc7e0 msgr2=0x7f68701524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68700cc7e0 0x7f68701524a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f686000e9a0 tx=0x7f686000ecb0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 -- 172.21.15.118:0/1301872847 shutdown_connections 2023-07-13T13:53:05.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f685006ac50 0x7f685006d100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687015f050 0x7f68701529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f68700cc410 0x7f68700c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 --2- 172.21.15.118:0/1301872847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68700cc7e0 0x7f68701524a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 -- 172.21.15.118:0/1301872847 >> 172.21.15.118:0/1301872847 conn(0x7f6870069f30 msgr2=0x7f6870148210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 -- 172.21.15.118:0/1301872847 shutdown_connections 2023-07-13T13:53:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.453+0000 7f6875bbf700 1 -- 172.21.15.118:0/1301872847 wait complete. 2023-07-13T13:53:05.436 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-13T13:53:05.447 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-13T13:53:05.447 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-07-13T13:53:05.448 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-07-13T13:53:05.448 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-13T13:53:05.448 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:05.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:05.449 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-07-13T13:53:05.466 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-13T13:53:05.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:05.467 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-13T13:53:05.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:05.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-07-13T13:53:05.638 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-13T13:53:05.639 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-13T13:53:05.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.788+0000 7f5dd67f4700 1 Processor -- start 2023-07-13T13:53:05.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.788+0000 7f5dd67f4700 1 -- start start 2023-07-13T13:53:05.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.789+0000 7f5dd67f4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd014ed20 0x7f5dd00c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.789+0000 7f5dd67f4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c5f20 0x7f5dd0154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.789+0000 7f5dd67f4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd0070fb0 con 0x7f5dd00caf30 2023-07-13T13:53:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.789+0000 7f5dd67f4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00c1ab0 con 0x7f5dd00c5f20 2023-07-13T13:53:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.789+0000 7f5dd67f4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd006fc70 con 0x7f5dd014ed20 2023-07-13T13:53:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.790+0000 7f5dd4d91700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c5f20 0x7f5dd0154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.790+0000 7f5dcffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd014ed20 0x7f5dd00c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.790+0000 7f5dcf7fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5dd00caf30 0x7f5dd0070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43050/0 (socket says 172.21.15.118:43050) 2023-07-13T13:53:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.790+0000 7f5dcf7fe700 1 -- 172.21.15.118:0/3741157269 learned_addr learned my addr 172.21.15.118:0/3741157269 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T13:53:05.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.793+0000 7f5dcffff700 1 -- 172.21.15.118:0/3741157269 >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c5f20 msgr2=0x7f5dd0154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T13:53:05.764 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.793+0000 7f5dcffff700 1 --2- 172.21.15.118:0/3741157269 >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c5f20 0x7f5dd0154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.793+0000 7f5dcffff700 1 -- 172.21.15.118:0/3741157269 >> v1:172.21.15.123:6789/0 conn(0x7f5dd00caf30 legacy=0x7f5dd0070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.793+0000 7f5dcffff700 1 -- 172.21.15.118:0/3741157269 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd014f0f0 con 0x7f5dd014ed20 2023-07-13T13:53:05.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.793+0000 7f5dd4d91700 1 --2- 172.21.15.118:0/3741157269 >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c5f20 0x7f5dd0154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T13:53:05.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.794+0000 7f5dcffff700 1 --2- 172.21.15.118:0/3741157269 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd014ed20 0x7f5dd00c4400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009840 tx=0x7f5dc4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3dfd13426c2eb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dceffd700 1 -- 172.21.15.118:0/3741157269 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4011830 con 0x7f5dd014ed20 2023-07-13T13:53:05.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dceffd700 1 -- 172.21.15.118:0/3741157269 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4011990 con 0x7f5dd014ed20 2023-07-13T13:53:05.770 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dceffd700 1 -- 172.21.15.118:0/3741157269 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4011d20 con 0x7f5dd014ed20 2023-07-13T13:53:05.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dd67f4700 1 -- 172.21.15.118:0/3741157269 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd014ed20 msgr2=0x7f5dd00c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.771 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/3741157269 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd014ed20 0x7f5dd00c4400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009840 tx=0x7f5dc4009b50 comp rx=0 tx=0).stop 2023-07-13T13:53:05.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dd67f4700 1 -- 172.21.15.118:0/3741157269 shutdown_connections 2023-07-13T13:53:05.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/3741157269 >> v2:172.21.15.118:3300/0 conn(0x7f5dd00c5f20 0x7f5dd0154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/3741157269 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd014ed20 0x7f5dd00c4400 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dd67f4700 1 -- 172.21.15.118:0/3741157269 >> 172.21.15.118:0/3741157269 conn(0x7f5dd006d830 msgr2=0x7f5dd006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:05.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dd67f4700 1 -- 172.21.15.118:0/3741157269 shutdown_connections 2023-07-13T13:53:05.772 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.799+0000 7f5dd67f4700 1 -- 172.21.15.118:0/3741157269 wait complete. 2023-07-13T13:53:05.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.801+0000 7f5dd67f4700 1 Processor -- start 2023-07-13T13:53:05.773 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.801+0000 7f5dd67f4700 1 -- start start 2023-07-13T13:53:05.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.802+0000 7f5dd67f4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd00c5f20 0x7f5dd00c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.802+0000 7f5dd67f4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd00caf30 0x7f5dd0134e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.802+0000 7f5dd67f4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dd014ed20 0x7f5dd015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.802+0000 7f5dd67f4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00c24d0 con 0x7f5dd00c5f20 2023-07-13T13:53:05.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.802+0000 7f5dd67f4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00c82d0 con 0x7f5dd014ed20 2023-07-13T13:53:05.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.802+0000 7f5dd67f4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00c8b70 con 0x7f5dd00caf30 2023-07-13T13:53:05.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.802+0000 7f5dd4d91700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dd014ed20 0x7f5dd015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.803+0000 7f5dcffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd00c5f20 0x7f5dd00c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.803+0000 7f5dd4d91700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dd014ed20 0x7f5dd015f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:53384/0 (socket says 172.21.15.118:53384) 2023-07-13T13:53:05.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.803+0000 7f5dd4d91700 1 -- 172.21.15.118:0/2772306400 learned_addr learned my addr 172.21.15.118:0/2772306400 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T13:53:05.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.804+0000 7f5dcf7fe700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd00caf30 0x7f5dd0134e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.778 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.807+0000 7f5dd4d91700 1 -- 172.21.15.118:0/2772306400 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd00caf30 msgr2=0x7f5dd0134e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.778 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.807+0000 7f5dd4d91700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd00caf30 0x7f5dd0134e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.807+0000 7f5dd4d91700 1 -- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd00c5f20 msgr2=0x7f5dd00c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:05.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.807+0000 7f5dd4d91700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd00c5f20 0x7f5dd00c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:05.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.807+0000 7f5dd4d91700 1 -- 172.21.15.118:0/2772306400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8009a70 con 0x7f5dd014ed20 2023-07-13T13:53:05.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.809+0000 7f5dd4d91700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dd014ed20 0x7f5dd015f150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800efc0 tx=0x7f5dc800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.813+0000 7f5dccff9700 1 -- 172.21.15.118:0/2772306400 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800ca90 con 0x7f5dd014ed20 2023-07-13T13:53:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.813+0000 7f5dccff9700 1 -- 172.21.15.118:0/2772306400 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc800f040 con 0x7f5dd014ed20 2023-07-13T13:53:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.813+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc40094a0 con 0x7f5dd014ed20 2023-07-13T13:53:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.813+0000 7f5dccff9700 1 -- 172.21.15.118:0/2772306400 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800ce10 con 0x7f5dd014ed20 2023-07-13T13:53:05.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.813+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd00c9540 con 0x7f5dd014ed20 2023-07-13T13:53:05.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.814+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd00c8d00 con 0x7f5dd014ed20 2023-07-13T13:53:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.834+0000 7f5dccff9700 1 -- 172.21.15.118:0/2772306400 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5dc8003a20 con 0x7f5dd014ed20 2023-07-13T13:53:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.834+0000 7f5dccff9700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5dbc06ad10 0x7f5dbc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T13:53:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.835+0000 7f5dcffff700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5dbc06ad10 0x7f5dbc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T13:53:05.807 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.835+0000 7f5dcffff700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5dbc06ad10 0x7f5dbc06d1c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4000c00 tx=0x7f5dc401c040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T13:53:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:05.838+0000 7f5dccff9700 1 -- 172.21.15.118:0/2772306400 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5dc805d320 con 0x7f5dd014ed20 2023-07-13T13:53:06.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.082+0000 7f5dccff9700 1 -- 172.21.15.118:0/2772306400 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5dc8059130 con 0x7f5dd014ed20 2023-07-13T13:53:06.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.315+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5dd00743c0 con 0x7f5dd014ed20 2023-07-13T13:53:06.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.328+0000 7f5dccff9700 1 -- 172.21.15.118:0/2772306400 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5dc8018070 con 0x7f5dd014ed20 2023-07-13T13:53:06.300 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-13T13:53:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5dbc06ad10 msgr2=0x7f5dbc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5dbc06ad10 0x7f5dbc06d1c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4000c00 tx=0x7f5dc401c040 comp rx=0 tx=0).stop 2023-07-13T13:53:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dd014ed20 msgr2=0x7f5dd015f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T13:53:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dd014ed20 0x7f5dd015f150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800efc0 tx=0x7f5dc800c3a0 comp rx=0 tx=0).stop 2023-07-13T13:53:06.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 shutdown_connections 2023-07-13T13:53:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f5dbc06ad10 0x7f5dbc06d1c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dd014ed20 0x7f5dd015f150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5dd00c5f20 0x7f5dd00c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 --2- 172.21.15.118:0/2772306400 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5dd00caf30 0x7f5dd0134e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T13:53:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 >> 172.21.15.118:0/2772306400 conn(0x7f5dd006d830 msgr2=0x7f5dd0070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T13:53:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 shutdown_connections 2023-07-13T13:53:06.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T13:53:06.330+0000 7f5dd67f4700 1 -- 172.21.15.118:0/2772306400 wait complete. 2023-07-13T13:53:06.314 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-13T13:53:06.314 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-13T13:53:06.315 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2023-07-13T13:53:06.315 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-13T13:53:06.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:06.316 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-13T13:53:06.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-13T13:53:06.317 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-13T13:53:06.317 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-13T13:53:06.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.319 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2023-07-13T13:53:06.337 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-13T13:53:06.338 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-13T13:53:06.338 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2023-07-13T13:53:06.338 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-07-13T13:53:06.338 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2023-07-13T13:53:06.338 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-07-13T13:53:06.339 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-13T13:53:06.339 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2023-07-13T13:53:06.339 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2023-07-13T13:53:06.339 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-13T13:53:06.339 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2023-07-13T13:53:06.339 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2023-07-13T13:53:06.339 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-13T13:53:06.339 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2023-07-13T13:53:06.340 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-13T13:53:06.340 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2023-07-13T13:53:06.340 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-13T13:53:06.340 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 38798sec preferred_lft 38798sec 2023-07-13T13:53:06.340 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2023-07-13T13:53:06.340 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2023-07-13T13:53:06.341 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-13T13:53:06.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.341 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:53:06.341 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:53:06.342 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2023-07-13T13:53:06.342 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2023-07-13T13:53:06.343 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2023-07-13T13:53:06.343 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-13T13:53:06.343 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:53:06.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.453 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-13T13:53:06.480 INFO:teuthology.orchestra.run.smithi118.stdout:1 2023-07-13T13:53:06.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.482 DEBUG:teuthology.orchestra.run.smithi118:> route 2023-07-13T13:53:06.541 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2023-07-13T13:53:06.542 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-13T13:53:06.542 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-13T13:53:06.542 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-13T13:53:06.542 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-13T13:53:06.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.543 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:53:06.543 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:53:06.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-13T13:53:06.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-13T13:53:06.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-13T13:53:06.544 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:53:06.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.646 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-07-13T13:53:06.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.664 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2023-07-13T13:53:06.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.723 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:53:06.723 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:53:06.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-13T13:53:06.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-13T13:53:06.724 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:53:06.817 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-13T13:53:06.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:06.818 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:53:06.818 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:53:06.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-13T13:53:06.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-13T13:53:06.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-13T13:53:06.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-13T13:53:06.819 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-13T13:53:06.820 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:53:07.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:07.016 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2023-07-13T13:53:07.017 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2023-07-13T13:53:07.017 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2023-07-13T13:53:07.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2023-07-13T13:53:07.018 DEBUG:teuthology.orchestra.run.smithi118:> ') 2023-07-13T13:53:07.115 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-07-13T13:53:07.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-13T13:53:07.116 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:07.134 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-13T13:53:07.134 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-13T13:53:07.134 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:07.191 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-07-13T13:53:07.191 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:07.259 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:07.260 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:07.326 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:07.327 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:07.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:07.328 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:07.385 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-13T13:53:07.385 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-13T13:53:07.428 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:07.453 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:07.453 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:07.521 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:07.522 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:07.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:07.523 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:08.682 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:08.711 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:08.711 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:08.778 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:08.778 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:08.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:08.779 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:09.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:09.965 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:09.966 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:10.033 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:10.033 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:10.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:10.034 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:11.193 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:11.221 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:11.221 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:11.287 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:11.288 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:11.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:11.289 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:12.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:12.475 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:12.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:12.541 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:12.542 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:12.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:12.543 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:13.701 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:13.728 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:13.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:13.795 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:13.796 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:13.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:13.797 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:14.508 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:2023-07-13T13:53:14.437+0000 404b700 -1 init, newargv = 0xec18790 newargc=15 2023-07-13T13:53:14.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[156918]: starting ceph client 2023-07-13T13:53:14.954 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:14.982 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:14.982 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:15.049 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:15.050 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:15.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:15.051 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:15.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[156918]: starting fuse 2023-07-13T13:53:16.210 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2023-07-13T13:53:16.242 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-13T13:53:16.242 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-13T13:53:16.310 INFO:teuthology.orchestra.run.smithi118.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-13T13:53:16.311 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-13T13:53:16.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:16.312 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2023-07-13T13:53:16.371 INFO:teuthology.orchestra.run.smithi118.stdout:46 2023-07-13T13:53:16.371 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-07-13T13:53:16.372 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-13T13:53:16.372 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2023-07-13T13:53:16.372 DEBUG:teuthology.orchestra.run.smithi118:> import re 2023-07-13T13:53:16.372 DEBUG:teuthology.orchestra.run.smithi118:> import os 2023-07-13T13:53:16.373 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2023-07-13T13:53:16.373 DEBUG:teuthology.orchestra.run.smithi118:> 2023-07-13T13:53:16.373 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2023-07-13T13:53:16.373 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-13T13:53:16.373 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2023-07-13T13:53:16.374 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-13T13:53:16.374 DEBUG:teuthology.orchestra.run.smithi118:> 2023-07-13T13:53:16.374 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2023-07-13T13:53:16.374 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2023-07-13T13:53:16.375 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2023-07-13T13:53:16.375 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2023-07-13T13:53:16.375 DEBUG:teuthology.orchestra.run.smithi118:> 2023-07-13T13:53:16.375 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2023-07-13T13:53:16.375 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-13T13:53:16.376 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-13T13:53:16.376 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-13T13:53:16.376 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2023-07-13T13:53:16.376 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2023-07-13T13:53:16.377 DEBUG:teuthology.orchestra.run.smithi118:> return f 2023-07-13T13:53:16.377 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-13T13:53:16.377 DEBUG:teuthology.orchestra.run.smithi118:> 2023-07-13T13:53:16.377 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.0")) 2023-07-13T13:53:16.378 DEBUG:teuthology.orchestra.run.smithi118:> ' 2023-07-13T13:53:16.499 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.0.156918.asok 2023-07-13T13:53:16.680 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.156918.asok 2023-07-13T13:53:16.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:16.681 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.156918.asok status 2023-07-13T13:53:16.957 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T13:53:16.957 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2023-07-13T13:53:16.957 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "f0b380e693e28c35a89e7c2062b0976b7def7973", 2023-07-13T13:53:16.958 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 18.0.0-4842-gf0b380e6 (f0b380e693e28c35a89e7c2062b0976b7def7973) reef (dev)", 2023-07-13T13:53:16.958 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "0", 2023-07-13T13:53:16.958 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2023-07-13T13:53:16.958 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-13T13:53:16.958 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "156918", 2023-07-13T13:53:16.958 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2023-07-13T13:53:16.958 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:53:16.959 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2023-07-13T13:53:16.959 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2023-07-13T13:53:16.959 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4671, 2023-07-13T13:53:16.959 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2023-07-13T13:53:16.959 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2023-07-13T13:53:16.959 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2023-07-13T13:53:16.959 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4671 2023-07-13T13:53:16.959 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:53:16.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-07-13T13:53:16.960 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-07-13T13:53:16.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:0", 2023-07-13T13:53:16.960 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 194404658 2023-07-13T13:53:16.960 INFO:teuthology.orchestra.run.smithi118.stdout: } 2023-07-13T13:53:16.960 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:53:16.960 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2023-07-13T13:53:16.961 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2023-07-13T13:53:16.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "172.21.15.118:0", 2023-07-13T13:53:16.961 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 194404658 2023-07-13T13:53:16.961 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2023-07-13T13:53:16.961 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4671 172.21.15.118:0/194404658", 2023-07-13T13:53:16.961 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "172.21.15.118:0/194404658", 2023-07-13T13:53:16.961 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2023-07-13T13:53:16.961 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 10, 2023-07-13T13:53:16.962 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 31, 2023-07-13T13:53:16.962 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2023-07-13T13:53:16.962 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2023-07-13T13:53:16.962 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2023-07-13T13:53:16.962 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T13:53:16.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:16.967 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2023-07-13T13:53:16.968 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:17.014 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2023-07-13T13:53:17.014 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:17.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T13:53:17.014 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:17.057 INFO:teuthology.run_tasks:Running task workunit... 2023-07-13T13:53:17.069 INFO:tasks.workunit:Pulling workunits from ref 68df405e530cc8317c62abf2bfc4458a41023b59 2023-07-13T13:53:17.070 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-07-13T13:53:17.070 INFO:tasks.workunit:timeout=3h 2023-07-13T13:53:17.070 INFO:tasks.workunit:cleanup=True 2023-07-13T13:53:17.071 DEBUG:teuthology.orchestra.run.smithi118:> stat -- /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:17.116 INFO:teuthology.orchestra.run.smithi118.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:17.116 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-07-13T13:53:17.116 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 2eh/46d Inode: 1 Links: 2 2023-07-13T13:53:17.116 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T13:53:17.116 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:fusefs_t:s0 2023-07-13T13:53:17.116 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-07-13T13:53:17.117 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-07-13 13:52:18.581030602 +0000 2023-07-13T13:53:17.117 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-07-13 13:52:33.599657153 +0000 2023-07-13T13:53:17.117 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-07-13T13:53:17.117 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-07-13T13:53:17.117 DEBUG:teuthology.orchestra.run.smithi118:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-07-13T13:53:17.541 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 68df405e530cc8317c62abf2bfc4458a41023b59 2023-07-13T13:53:17.559 INFO:tasks.workunit.client.0.smithi118.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-07-13T13:53:21.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:53:21.081 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:53:51.160 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:53:51.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:54:12.951 INFO:tasks.workunit.client.0.smithi118.stderr:Updating files: 98% (11484/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-07-13T13:54:13.556 INFO:tasks.workunit.client.0.smithi118.stderr:Note: switching to '68df405e530cc8317c62abf2bfc4458a41023b59'. 2023-07-13T13:54:13.556 INFO:tasks.workunit.client.0.smithi118.stderr: 2023-07-13T13:54:13.556 INFO:tasks.workunit.client.0.smithi118.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-13T13:54:13.557 INFO:tasks.workunit.client.0.smithi118.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-13T13:54:13.557 INFO:tasks.workunit.client.0.smithi118.stderr:state without impacting any branches by switching back to a branch. 2023-07-13T13:54:13.557 INFO:tasks.workunit.client.0.smithi118.stderr: 2023-07-13T13:54:13.557 INFO:tasks.workunit.client.0.smithi118.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-13T13:54:13.557 INFO:tasks.workunit.client.0.smithi118.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-13T13:54:13.557 INFO:tasks.workunit.client.0.smithi118.stderr: 2023-07-13T13:54:13.557 INFO:tasks.workunit.client.0.smithi118.stderr: git switch -c 2023-07-13T13:54:13.557 INFO:tasks.workunit.client.0.smithi118.stderr: 2023-07-13T13:54:13.558 INFO:tasks.workunit.client.0.smithi118.stderr:Or undo this operation with: 2023-07-13T13:54:13.558 INFO:tasks.workunit.client.0.smithi118.stderr: 2023-07-13T13:54:13.558 INFO:tasks.workunit.client.0.smithi118.stderr: git switch - 2023-07-13T13:54:13.558 INFO:tasks.workunit.client.0.smithi118.stderr: 2023-07-13T13:54:13.558 INFO:tasks.workunit.client.0.smithi118.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-13T13:54:13.558 INFO:tasks.workunit.client.0.smithi118.stderr: 2023-07-13T13:54:13.558 INFO:tasks.workunit.client.0.smithi118.stderr:HEAD is now at 68df405e530 Merge pull request #50660 from zdover23/wip-doc-2023-03-25-rados-operations-bluestore-migration-prompt-fix 2023-07-13T13:54:13.559 DEBUG:teuthology.orchestra.run.smithi118:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-07-13T13:54:13.603 INFO:tasks.workunit.client.0.smithi118.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-07-13T13:54:13.605 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-13T13:54:13.605 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-07-13T13:54:14.250 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-07-13T13:54:14.321 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-07-13T13:54:14.359 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-13T13:54:14.360 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-13T13:54:14.361 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-07-13T13:54:14.397 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-13T13:54:14.400 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T13:54:14.400 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-07-13T13:54:14.418 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-07-13T13:54:14.419 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-07-13T13:54:14.419 DEBUG:teuthology.orchestra.run.smithi118:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=68df405e530cc8317c62abf2bfc4458a41023b59 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-07-13T13:54:14.717 INFO:tasks.workunit.client.0.smithi118.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-07-13T13:54:14.718 INFO:tasks.workunit.client.0.smithi118.stdout: 2023-07-13T13:54:14.718 INFO:tasks.workunit.client.0.smithi118.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-07-13T13:54:14.725 INFO:tasks.workunit.client.0.smithi118.stdout:0 of 1 processes prepared for launch 0 sec 2023-07-13T13:54:14.825 INFO:tasks.workunit.client.0.smithi118.stdout:1 of 1 processes prepared for launch 0 sec 2023-07-13T13:54:14.826 INFO:tasks.workunit.client.0.smithi118.stdout:releasing clients 2023-07-13T13:54:15.825 INFO:tasks.workunit.client.0.smithi118.stdout: 0 12 0.00 MB/sec warmup 1 sec latency 131.724 ms 2023-07-13T13:54:16.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 91 2.10 MB/sec warmup 2 sec latency 258.085 ms 2023-07-13T13:54:17.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 137 2.01 MB/sec warmup 3 sec latency 203.473 ms 2023-07-13T13:54:18.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 173 1.77 MB/sec warmup 4 sec latency 214.157 ms 2023-07-13T13:54:19.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 207 1.62 MB/sec warmup 5 sec latency 210.027 ms 2023-07-13T13:54:20.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 247 1.57 MB/sec warmup 6 sec latency 202.791 ms 2023-07-13T13:54:21.296 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:54:21.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:54:21.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 279 1.49 MB/sec warmup 7 sec latency 204.886 ms 2023-07-13T13:54:22.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 313 1.44 MB/sec warmup 8 sec latency 242.956 ms 2023-07-13T13:54:23.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 341 1.36 MB/sec warmup 9 sec latency 287.240 ms 2023-07-13T13:54:24.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 365 1.30 MB/sec warmup 10 sec latency 379.700 ms 2023-07-13T13:54:25.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 397 1.28 MB/sec warmup 11 sec latency 439.629 ms 2023-07-13T13:54:26.825 INFO:tasks.workunit.client.0.smithi118.stdout: 1 429 1.26 MB/sec warmup 12 sec latency 351.830 ms 2023-07-13T13:54:27.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 461 1.24 MB/sec warmup 13 sec latency 353.146 ms 2023-07-13T13:54:28.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 493 1.23 MB/sec warmup 14 sec latency 290.801 ms 2023-07-13T13:54:29.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 513 1.18 MB/sec warmup 15 sec latency 290.200 ms 2023-07-13T13:54:30.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 605 1.31 MB/sec warmup 16 sec latency 289.972 ms 2023-07-13T13:54:31.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 614 1.23 MB/sec warmup 17 sec latency 464.120 ms 2023-07-13T13:54:32.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 645 1.17 MB/sec warmup 18 sec latency 480.443 ms 2023-07-13T13:54:33.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 653 1.11 MB/sec warmup 19 sec latency 469.130 ms 2023-07-13T13:54:34.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 671 1.06 MB/sec warmup 20 sec latency 489.334 ms 2023-07-13T13:54:35.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 684 1.01 MB/sec warmup 21 sec latency 454.113 ms 2023-07-13T13:54:36.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 711 0.96 MB/sec warmup 22 sec latency 373.389 ms 2023-07-13T13:54:37.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 744 0.93 MB/sec warmup 23 sec latency 212.026 ms 2023-07-13T13:54:38.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 769 0.89 MB/sec warmup 24 sec latency 416.141 ms 2023-07-13T13:54:39.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 798 0.86 MB/sec warmup 25 sec latency 260.692 ms 2023-07-13T13:54:40.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 813 0.83 MB/sec warmup 26 sec latency 380.419 ms 2023-07-13T13:54:41.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 823 0.80 MB/sec warmup 27 sec latency 434.456 ms 2023-07-13T13:54:42.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 856 0.77 MB/sec warmup 28 sec latency 374.543 ms 2023-07-13T13:54:43.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 864 0.74 MB/sec warmup 29 sec latency 415.746 ms 2023-07-13T13:54:44.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 892 0.72 MB/sec warmup 30 sec latency 361.854 ms 2023-07-13T13:54:45.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 925 0.70 MB/sec warmup 31 sec latency 283.596 ms 2023-07-13T13:54:46.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 929 0.68 MB/sec warmup 32 sec latency 384.885 ms 2023-07-13T13:54:47.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 937 0.66 MB/sec warmup 33 sec latency 392.326 ms 2023-07-13T13:54:48.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 964 0.64 MB/sec warmup 34 sec latency 379.815 ms 2023-07-13T13:54:49.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 992 0.63 MB/sec warmup 35 sec latency 276.374 ms 2023-07-13T13:54:50.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1027 0.64 MB/sec warmup 36 sec latency 419.126 ms 2023-07-13T13:54:51.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:54:51.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:54:51.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1041 0.62 MB/sec warmup 37 sec latency 370.497 ms 2023-07-13T13:54:52.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1048 0.60 MB/sec warmup 38 sec latency 379.379 ms 2023-07-13T13:54:53.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1064 0.59 MB/sec warmup 39 sec latency 351.795 ms 2023-07-13T13:54:54.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1088 0.57 MB/sec warmup 40 sec latency 528.779 ms 2023-07-13T13:54:55.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1113 0.56 MB/sec warmup 41 sec latency 655.370 ms 2023-07-13T13:54:56.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1134 0.55 MB/sec warmup 42 sec latency 368.990 ms 2023-07-13T13:54:57.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1157 0.54 MB/sec warmup 43 sec latency 315.988 ms 2023-07-13T13:54:58.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1169 0.52 MB/sec warmup 44 sec latency 482.299 ms 2023-07-13T13:54:59.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1177 0.51 MB/sec warmup 45 sec latency 378.694 ms 2023-07-13T13:55:00.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1204 0.50 MB/sec warmup 46 sec latency 180.384 ms 2023-07-13T13:55:01.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1231 0.49 MB/sec warmup 47 sec latency 370.029 ms 2023-07-13T13:55:02.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1248 0.48 MB/sec warmup 48 sec latency 359.917 ms 2023-07-13T13:55:03.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1278 0.47 MB/sec warmup 49 sec latency 420.654 ms 2023-07-13T13:55:04.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1281 0.46 MB/sec warmup 50 sec latency 400.260 ms 2023-07-13T13:55:05.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1376 0.51 MB/sec warmup 51 sec latency 661.284 ms 2023-07-13T13:55:06.826 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1381 0.50 MB/sec warmup 52 sec latency 369.593 ms 2023-07-13T13:55:07.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1393 0.49 MB/sec warmup 53 sec latency 404.772 ms 2023-07-13T13:55:08.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1410 0.48 MB/sec warmup 54 sec latency 392.071 ms 2023-07-13T13:55:09.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1428 0.47 MB/sec warmup 55 sec latency 392.905 ms 2023-07-13T13:55:10.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1448 0.46 MB/sec warmup 56 sec latency 362.467 ms 2023-07-13T13:55:11.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1468 0.46 MB/sec warmup 57 sec latency 399.129 ms 2023-07-13T13:55:12.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1490 0.45 MB/sec warmup 58 sec latency 372.199 ms 2023-07-13T13:55:13.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1512 0.44 MB/sec warmup 59 sec latency 413.268 ms 2023-07-13T13:55:14.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1526 0.43 MB/sec warmup 60 sec latency 365.079 ms 2023-07-13T13:55:15.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1552 0.43 MB/sec warmup 61 sec latency 514.154 ms 2023-07-13T13:55:16.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1570 0.42 MB/sec warmup 62 sec latency 379.963 ms 2023-07-13T13:55:17.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1589 0.42 MB/sec warmup 63 sec latency 276.292 ms 2023-07-13T13:55:18.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1610 0.41 MB/sec warmup 64 sec latency 378.224 ms 2023-07-13T13:55:19.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1617 0.40 MB/sec warmup 65 sec latency 367.071 ms 2023-07-13T13:55:20.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1644 0.40 MB/sec warmup 66 sec latency 433.216 ms 2023-07-13T13:55:21.520 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:55:21.522 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:55:21.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1662 0.39 MB/sec warmup 67 sec latency 427.150 ms 2023-07-13T13:55:22.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1698 0.39 MB/sec warmup 68 sec latency 345.487 ms 2023-07-13T13:55:23.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1707 0.38 MB/sec warmup 69 sec latency 358.395 ms 2023-07-13T13:55:24.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1770 0.38 MB/sec warmup 70 sec latency 372.295 ms 2023-07-13T13:55:25.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1801 0.37 MB/sec warmup 71 sec latency 392.514 ms 2023-07-13T13:55:26.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1820 0.37 MB/sec warmup 72 sec latency 385.858 ms 2023-07-13T13:55:27.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1830 0.36 MB/sec warmup 73 sec latency 383.672 ms 2023-07-13T13:55:28.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1855 0.36 MB/sec warmup 74 sec latency 356.575 ms 2023-07-13T13:55:29.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1862 0.35 MB/sec warmup 75 sec latency 365.404 ms 2023-07-13T13:55:30.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1881 0.35 MB/sec warmup 76 sec latency 502.036 ms 2023-07-13T13:55:31.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1903 0.34 MB/sec warmup 77 sec latency 360.891 ms 2023-07-13T13:55:32.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1920 0.34 MB/sec warmup 78 sec latency 373.418 ms 2023-07-13T13:55:33.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1973 0.33 MB/sec warmup 79 sec latency 368.383 ms 2023-07-13T13:55:34.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 1995 0.33 MB/sec warmup 80 sec latency 372.747 ms 2023-07-13T13:55:35.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2031 0.33 MB/sec warmup 81 sec latency 362.557 ms 2023-07-13T13:55:36.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2051 0.32 MB/sec warmup 82 sec latency 393.114 ms 2023-07-13T13:55:37.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2059 0.32 MB/sec warmup 83 sec latency 356.525 ms 2023-07-13T13:55:38.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2079 0.32 MB/sec warmup 84 sec latency 406.570 ms 2023-07-13T13:55:39.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2091 0.31 MB/sec warmup 85 sec latency 438.368 ms 2023-07-13T13:55:40.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2105 0.31 MB/sec warmup 86 sec latency 422.213 ms 2023-07-13T13:55:41.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2146 0.31 MB/sec warmup 87 sec latency 372.057 ms 2023-07-13T13:55:42.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2173 0.30 MB/sec warmup 88 sec latency 434.120 ms 2023-07-13T13:55:43.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2181 0.30 MB/sec warmup 89 sec latency 413.125 ms 2023-07-13T13:55:44.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2200 0.30 MB/sec warmup 90 sec latency 411.494 ms 2023-07-13T13:55:45.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2249 0.29 MB/sec warmup 91 sec latency 375.518 ms 2023-07-13T13:55:46.827 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2294 0.30 MB/sec warmup 92 sec latency 365.080 ms 2023-07-13T13:55:47.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2303 0.30 MB/sec warmup 93 sec latency 371.992 ms 2023-07-13T13:55:48.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2321 0.30 MB/sec warmup 94 sec latency 392.628 ms 2023-07-13T13:55:49.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2334 0.29 MB/sec warmup 95 sec latency 370.005 ms 2023-07-13T13:55:50.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2345 0.29 MB/sec warmup 96 sec latency 366.975 ms 2023-07-13T13:55:51.625 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:55:51.627 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:55:51.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2361 0.29 MB/sec warmup 97 sec latency 326.408 ms 2023-07-13T13:55:52.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2366 0.28 MB/sec warmup 98 sec latency 375.151 ms 2023-07-13T13:55:53.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2371 0.28 MB/sec warmup 99 sec latency 392.635 ms 2023-07-13T13:55:54.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2391 0.28 MB/sec warmup 100 sec latency 419.238 ms 2023-07-13T13:55:55.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2407 0.28 MB/sec warmup 101 sec latency 541.301 ms 2023-07-13T13:55:56.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2428 0.28 MB/sec warmup 102 sec latency 374.712 ms 2023-07-13T13:55:57.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2435 0.27 MB/sec warmup 103 sec latency 372.071 ms 2023-07-13T13:55:58.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2453 0.27 MB/sec warmup 104 sec latency 185.844 ms 2023-07-13T13:55:59.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2473 0.27 MB/sec warmup 105 sec latency 406.846 ms 2023-07-13T13:56:00.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2494 0.27 MB/sec warmup 106 sec latency 358.086 ms 2023-07-13T13:56:01.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2506 0.27 MB/sec warmup 107 sec latency 405.861 ms 2023-07-13T13:56:02.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2551 0.27 MB/sec warmup 108 sec latency 386.083 ms 2023-07-13T13:56:03.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2562 0.27 MB/sec warmup 109 sec latency 375.580 ms 2023-07-13T13:56:04.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2580 0.26 MB/sec warmup 110 sec latency 469.006 ms 2023-07-13T13:56:05.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2596 0.26 MB/sec warmup 111 sec latency 561.538 ms 2023-07-13T13:56:06.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2607 0.26 MB/sec warmup 112 sec latency 358.301 ms 2023-07-13T13:56:07.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2617 0.26 MB/sec warmup 113 sec latency 378.419 ms 2023-07-13T13:56:08.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2622 0.26 MB/sec warmup 114 sec latency 397.347 ms 2023-07-13T13:56:09.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2745 0.28 MB/sec warmup 115 sec latency 386.505 ms 2023-07-13T13:56:10.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2761 0.28 MB/sec warmup 116 sec latency 395.179 ms 2023-07-13T13:56:11.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2780 0.27 MB/sec warmup 117 sec latency 181.190 ms 2023-07-13T13:56:12.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2874 0.27 MB/sec warmup 118 sec latency 388.238 ms 2023-07-13T13:56:13.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2901 0.28 MB/sec warmup 119 sec latency 198.021 ms 2023-07-13T13:56:15.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2944 0.00 MB/sec execute 1 sec latency 366.794 ms 2023-07-13T13:56:16.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2974 0.01 MB/sec execute 2 sec latency 455.898 ms 2023-07-13T13:56:17.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 2989 0.01 MB/sec execute 3 sec latency 418.483 ms 2023-07-13T13:56:18.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3007 0.01 MB/sec execute 4 sec latency 352.596 ms 2023-07-13T13:56:19.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3024 0.01 MB/sec execute 5 sec latency 269.885 ms 2023-07-13T13:56:20.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3167 0.11 MB/sec execute 6 sec latency 352.111 ms 2023-07-13T13:56:21.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:56:21.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:56:21.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3188 0.11 MB/sec execute 7 sec latency 370.593 ms 2023-07-13T13:56:22.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3209 0.10 MB/sec execute 8 sec latency 377.881 ms 2023-07-13T13:56:23.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3268 0.21 MB/sec execute 9 sec latency 369.294 ms 2023-07-13T13:56:24.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3281 0.19 MB/sec execute 10 sec latency 403.358 ms 2023-07-13T13:56:25.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3283 0.17 MB/sec execute 11 sec latency 446.667 ms 2023-07-13T13:56:26.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3287 0.16 MB/sec execute 12 sec latency 446.360 ms 2023-07-13T13:56:27.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3291 0.14 MB/sec execute 13 sec latency 461.474 ms 2023-07-13T13:56:28.828 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3293 0.13 MB/sec execute 14 sec latency 402.140 ms 2023-07-13T13:56:29.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3297 0.12 MB/sec execute 15 sec latency 521.763 ms 2023-07-13T13:56:30.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3303 0.12 MB/sec execute 16 sec latency 428.856 ms 2023-07-13T13:56:31.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3307 0.11 MB/sec execute 17 sec latency 409.123 ms 2023-07-13T13:56:32.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3310 0.10 MB/sec execute 18 sec latency 356.937 ms 2023-07-13T13:56:33.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3313 0.10 MB/sec execute 19 sec latency 364.086 ms 2023-07-13T13:56:34.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3316 0.09 MB/sec execute 20 sec latency 361.480 ms 2023-07-13T13:56:35.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3319 0.09 MB/sec execute 21 sec latency 470.901 ms 2023-07-13T13:56:36.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3323 0.09 MB/sec execute 22 sec latency 358.363 ms 2023-07-13T13:56:37.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3325 0.08 MB/sec execute 23 sec latency 373.050 ms 2023-07-13T13:56:38.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3330 0.08 MB/sec execute 24 sec latency 361.399 ms 2023-07-13T13:56:39.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3333 0.08 MB/sec execute 25 sec latency 368.398 ms 2023-07-13T13:56:40.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3336 0.07 MB/sec execute 26 sec latency 389.403 ms 2023-07-13T13:56:41.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3343 0.07 MB/sec execute 27 sec latency 380.569 ms 2023-07-13T13:56:42.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3365 0.07 MB/sec execute 28 sec latency 174.058 ms 2023-07-13T13:56:43.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3390 0.07 MB/sec execute 29 sec latency 180.117 ms 2023-07-13T13:56:44.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3395 0.07 MB/sec execute 30 sec latency 430.226 ms 2023-07-13T13:56:45.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3494 0.16 MB/sec execute 31 sec latency 474.488 ms 2023-07-13T13:56:46.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3530 0.15 MB/sec execute 32 sec latency 136.256 ms 2023-07-13T13:56:47.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3548 0.15 MB/sec execute 33 sec latency 465.165 ms 2023-07-13T13:56:48.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3558 0.15 MB/sec execute 34 sec latency 366.401 ms 2023-07-13T13:56:49.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3573 0.14 MB/sec execute 35 sec latency 376.261 ms 2023-07-13T13:56:50.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3617 0.14 MB/sec execute 36 sec latency 398.969 ms 2023-07-13T13:56:51.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3641 0.14 MB/sec execute 37 sec latency 180.362 ms 2023-07-13T13:56:51.864 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:56:51.866 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:56:52.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3663 0.14 MB/sec execute 38 sec latency 460.872 ms 2023-07-13T13:56:53.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3673 0.13 MB/sec execute 39 sec latency 389.604 ms 2023-07-13T13:56:54.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3689 0.13 MB/sec execute 40 sec latency 346.927 ms 2023-07-13T13:56:55.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3709 0.13 MB/sec execute 41 sec latency 165.550 ms 2023-07-13T13:56:56.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3758 0.15 MB/sec execute 42 sec latency 180.185 ms 2023-07-13T13:56:57.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3773 0.15 MB/sec execute 43 sec latency 360.694 ms 2023-07-13T13:56:58.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3785 0.14 MB/sec execute 44 sec latency 203.652 ms 2023-07-13T13:56:59.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3792 0.14 MB/sec execute 45 sec latency 220.557 ms 2023-07-13T13:57:00.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3801 0.14 MB/sec execute 46 sec latency 245.446 ms 2023-07-13T13:57:01.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3815 0.13 MB/sec execute 47 sec latency 206.242 ms 2023-07-13T13:57:02.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3829 0.13 MB/sec execute 48 sec latency 202.359 ms 2023-07-13T13:57:03.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3843 0.13 MB/sec execute 49 sec latency 292.921 ms 2023-07-13T13:57:04.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3855 0.13 MB/sec execute 50 sec latency 186.448 ms 2023-07-13T13:57:05.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3869 0.12 MB/sec execute 51 sec latency 170.734 ms 2023-07-13T13:57:06.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3876 0.12 MB/sec execute 52 sec latency 377.037 ms 2023-07-13T13:57:07.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3896 0.12 MB/sec execute 53 sec latency 371.055 ms 2023-07-13T13:57:08.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3903 0.12 MB/sec execute 54 sec latency 383.788 ms 2023-07-13T13:57:09.829 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3922 0.12 MB/sec execute 55 sec latency 392.856 ms 2023-07-13T13:57:10.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3935 0.12 MB/sec execute 56 sec latency 215.732 ms 2023-07-13T13:57:11.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3943 0.12 MB/sec execute 57 sec latency 253.240 ms 2023-07-13T13:57:12.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3952 0.11 MB/sec execute 58 sec latency 244.535 ms 2023-07-13T13:57:13.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3967 0.11 MB/sec execute 59 sec latency 176.459 ms 2023-07-13T13:57:14.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3979 0.11 MB/sec execute 60 sec latency 194.401 ms 2023-07-13T13:57:15.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 3992 0.11 MB/sec execute 61 sec latency 180.244 ms 2023-07-13T13:57:16.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4006 0.11 MB/sec execute 62 sec latency 188.879 ms 2023-07-13T13:57:17.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4021 0.10 MB/sec execute 63 sec latency 195.105 ms 2023-07-13T13:57:18.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4028 0.10 MB/sec execute 64 sec latency 423.717 ms 2023-07-13T13:57:19.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4035 0.10 MB/sec execute 65 sec latency 377.313 ms 2023-07-13T13:57:20.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4047 0.10 MB/sec execute 66 sec latency 459.879 ms 2023-07-13T13:57:21.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4061 0.10 MB/sec execute 67 sec latency 380.833 ms 2023-07-13T13:57:22.013 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:57:22.015 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:57:22.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4082 0.10 MB/sec execute 68 sec latency 365.002 ms 2023-07-13T13:57:23.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4095 0.10 MB/sec execute 69 sec latency 361.846 ms 2023-07-13T13:57:24.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4116 0.09 MB/sec execute 70 sec latency 293.769 ms 2023-07-13T13:57:25.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4135 0.09 MB/sec execute 71 sec latency 237.901 ms 2023-07-13T13:57:26.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4153 0.09 MB/sec execute 72 sec latency 358.936 ms 2023-07-13T13:57:27.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4168 0.09 MB/sec execute 73 sec latency 493.040 ms 2023-07-13T13:57:28.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4176 0.09 MB/sec execute 74 sec latency 470.134 ms 2023-07-13T13:57:29.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4186 0.09 MB/sec execute 75 sec latency 466.525 ms 2023-07-13T13:57:30.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4217 0.09 MB/sec execute 76 sec latency 539.734 ms 2023-07-13T13:57:31.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4225 0.09 MB/sec execute 77 sec latency 375.387 ms 2023-07-13T13:57:32.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4252 0.09 MB/sec execute 78 sec latency 388.733 ms 2023-07-13T13:57:33.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4279 0.09 MB/sec execute 79 sec latency 359.848 ms 2023-07-13T13:57:34.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4309 0.09 MB/sec execute 80 sec latency 294.112 ms 2023-07-13T13:57:35.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4327 0.09 MB/sec execute 81 sec latency 379.200 ms 2023-07-13T13:57:36.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4351 0.09 MB/sec execute 82 sec latency 291.070 ms 2023-07-13T13:57:37.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4384 0.09 MB/sec execute 83 sec latency 377.340 ms 2023-07-13T13:57:38.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4391 0.08 MB/sec execute 84 sec latency 386.499 ms 2023-07-13T13:57:39.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4424 0.08 MB/sec execute 85 sec latency 459.987 ms 2023-07-13T13:57:40.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4432 0.08 MB/sec execute 86 sec latency 584.882 ms 2023-07-13T13:57:41.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4450 0.08 MB/sec execute 87 sec latency 377.458 ms 2023-07-13T13:57:42.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4480 0.08 MB/sec execute 88 sec latency 377.744 ms 2023-07-13T13:57:43.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4498 0.08 MB/sec execute 89 sec latency 407.062 ms 2023-07-13T13:57:44.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4501 0.08 MB/sec execute 90 sec latency 410.308 ms 2023-07-13T13:57:45.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4511 0.08 MB/sec execute 91 sec latency 394.116 ms 2023-07-13T13:57:46.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4540 0.08 MB/sec execute 92 sec latency 348.742 ms 2023-07-13T13:57:47.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4567 0.08 MB/sec execute 93 sec latency 429.777 ms 2023-07-13T13:57:48.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4602 0.09 MB/sec execute 94 sec latency 343.806 ms 2023-07-13T13:57:49.830 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4615 0.09 MB/sec execute 95 sec latency 375.094 ms 2023-07-13T13:57:50.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4627 0.09 MB/sec execute 96 sec latency 536.846 ms 2023-07-13T13:57:51.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4656 0.09 MB/sec execute 97 sec latency 167.900 ms 2023-07-13T13:57:52.133 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:57:52.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:57:52.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4668 0.09 MB/sec execute 98 sec latency 364.682 ms 2023-07-13T13:57:53.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4695 0.09 MB/sec execute 99 sec latency 372.149 ms 2023-07-13T13:57:54.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4724 0.09 MB/sec execute 100 sec latency 261.277 ms 2023-07-13T13:57:55.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4735 0.09 MB/sec execute 101 sec latency 383.433 ms 2023-07-13T13:57:56.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4739 0.08 MB/sec execute 102 sec latency 387.407 ms 2023-07-13T13:57:57.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4768 0.08 MB/sec execute 103 sec latency 215.690 ms 2023-07-13T13:57:58.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4789 0.08 MB/sec execute 104 sec latency 392.304 ms 2023-07-13T13:57:59.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4814 0.08 MB/sec execute 105 sec latency 257.024 ms 2023-07-13T13:58:00.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4840 0.08 MB/sec execute 106 sec latency 571.741 ms 2023-07-13T13:58:01.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4847 0.08 MB/sec execute 107 sec latency 402.036 ms 2023-07-13T13:58:02.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4862 0.08 MB/sec execute 108 sec latency 402.906 ms 2023-07-13T13:58:03.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4947 0.11 MB/sec execute 109 sec latency 350.078 ms 2023-07-13T13:58:04.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4957 0.11 MB/sec execute 110 sec latency 394.264 ms 2023-07-13T13:58:05.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4969 0.10 MB/sec execute 111 sec latency 400.899 ms 2023-07-13T13:58:06.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 4994 0.10 MB/sec execute 112 sec latency 370.269 ms 2023-07-13T13:58:07.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5014 0.10 MB/sec execute 113 sec latency 321.728 ms 2023-07-13T13:58:08.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5032 0.10 MB/sec execute 114 sec latency 389.527 ms 2023-07-13T13:58:09.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5055 0.10 MB/sec execute 115 sec latency 402.327 ms 2023-07-13T13:58:10.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5067 0.10 MB/sec execute 116 sec latency 549.460 ms 2023-07-13T13:58:11.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5092 0.10 MB/sec execute 117 sec latency 183.331 ms 2023-07-13T13:58:12.831 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5118 0.10 MB/sec execute 118 sec latency 379.564 ms 2023-07-13T13:58:13.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5133 0.10 MB/sec execute 119 sec latency 360.266 ms 2023-07-13T13:58:14.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5154 0.10 MB/sec execute 120 sec latency 199.531 ms 2023-07-13T13:58:15.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5175 0.10 MB/sec execute 121 sec latency 374.472 ms 2023-07-13T13:58:16.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5182 0.10 MB/sec execute 122 sec latency 357.208 ms 2023-07-13T13:58:17.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5208 0.10 MB/sec execute 123 sec latency 402.602 ms 2023-07-13T13:58:18.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5227 0.10 MB/sec execute 124 sec latency 392.270 ms 2023-07-13T13:58:19.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5257 0.09 MB/sec execute 125 sec latency 307.177 ms 2023-07-13T13:58:20.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5272 0.09 MB/sec execute 126 sec latency 359.497 ms 2023-07-13T13:58:21.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5335 0.09 MB/sec execute 127 sec latency 369.257 ms 2023-07-13T13:58:22.280 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:58:22.283 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:58:22.832 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5364 0.09 MB/sec execute 128 sec latency 372.770 ms 2023-07-13T13:58:23.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5385 0.09 MB/sec execute 129 sec latency 403.461 ms 2023-07-13T13:58:24.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5391 0.09 MB/sec execute 130 sec latency 373.249 ms 2023-07-13T13:58:25.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5406 0.09 MB/sec execute 131 sec latency 384.384 ms 2023-07-13T13:58:26.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5427 0.09 MB/sec execute 132 sec latency 367.900 ms 2023-07-13T13:58:27.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5434 0.09 MB/sec execute 133 sec latency 411.688 ms 2023-07-13T13:58:28.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5468 0.09 MB/sec execute 134 sec latency 403.415 ms 2023-07-13T13:58:29.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5485 0.09 MB/sec execute 135 sec latency 365.368 ms 2023-07-13T13:58:30.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5533 0.09 MB/sec execute 136 sec latency 488.922 ms 2023-07-13T13:58:31.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5553 0.09 MB/sec execute 137 sec latency 366.369 ms 2023-07-13T13:58:32.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5594 0.09 MB/sec execute 138 sec latency 337.008 ms 2023-07-13T13:58:33.833 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5605 0.09 MB/sec execute 139 sec latency 354.905 ms 2023-07-13T13:58:34.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5619 0.09 MB/sec execute 140 sec latency 386.573 ms 2023-07-13T13:58:35.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5641 0.09 MB/sec execute 141 sec latency 402.291 ms 2023-07-13T13:58:36.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5651 0.09 MB/sec execute 142 sec latency 438.749 ms 2023-07-13T13:58:37.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5665 0.09 MB/sec execute 143 sec latency 424.501 ms 2023-07-13T13:58:38.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5703 0.09 MB/sec execute 144 sec latency 361.514 ms 2023-07-13T13:58:39.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5735 0.09 MB/sec execute 145 sec latency 411.365 ms 2023-07-13T13:58:40.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5742 0.08 MB/sec execute 146 sec latency 412.063 ms 2023-07-13T13:58:41.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5762 0.08 MB/sec execute 147 sec latency 359.503 ms 2023-07-13T13:58:42.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5812 0.08 MB/sec execute 148 sec latency 388.807 ms 2023-07-13T13:58:43.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5854 0.09 MB/sec execute 149 sec latency 359.516 ms 2023-07-13T13:58:44.834 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5863 0.09 MB/sec execute 150 sec latency 391.404 ms 2023-07-13T13:58:45.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5881 0.09 MB/sec execute 151 sec latency 424.703 ms 2023-07-13T13:58:46.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5894 0.09 MB/sec execute 152 sec latency 379.346 ms 2023-07-13T13:58:47.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5905 0.09 MB/sec execute 153 sec latency 368.337 ms 2023-07-13T13:58:48.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5921 0.09 MB/sec execute 154 sec latency 488.817 ms 2023-07-13T13:58:49.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5926 0.09 MB/sec execute 155 sec latency 389.391 ms 2023-07-13T13:58:50.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5931 0.09 MB/sec execute 156 sec latency 520.196 ms 2023-07-13T13:58:51.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5951 0.09 MB/sec execute 157 sec latency 387.081 ms 2023-07-13T13:58:52.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:58:52.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:58:52.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5966 0.09 MB/sec execute 158 sec latency 380.489 ms 2023-07-13T13:58:53.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5988 0.09 MB/sec execute 159 sec latency 450.130 ms 2023-07-13T13:58:54.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 5994 0.09 MB/sec execute 160 sec latency 379.055 ms 2023-07-13T13:58:55.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6009 0.09 MB/sec execute 161 sec latency 185.966 ms 2023-07-13T13:58:56.835 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6030 0.09 MB/sec execute 162 sec latency 285.379 ms 2023-07-13T13:58:57.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6052 0.09 MB/sec execute 163 sec latency 376.372 ms 2023-07-13T13:58:58.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6064 0.09 MB/sec execute 164 sec latency 404.487 ms 2023-07-13T13:58:59.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6109 0.09 MB/sec execute 165 sec latency 378.109 ms 2023-07-13T13:59:00.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6118 0.09 MB/sec execute 166 sec latency 364.654 ms 2023-07-13T13:59:01.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6138 0.09 MB/sec execute 167 sec latency 369.142 ms 2023-07-13T13:59:02.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6152 0.09 MB/sec execute 168 sec latency 404.296 ms 2023-07-13T13:59:03.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6162 0.09 MB/sec execute 169 sec latency 370.762 ms 2023-07-13T13:59:04.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6175 0.09 MB/sec execute 170 sec latency 378.118 ms 2023-07-13T13:59:05.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6179 0.09 MB/sec execute 171 sec latency 392.892 ms 2023-07-13T13:59:06.836 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6302 0.10 MB/sec execute 172 sec latency 380.873 ms 2023-07-13T13:59:07.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6316 0.10 MB/sec execute 173 sec latency 378.392 ms 2023-07-13T13:59:08.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6335 0.10 MB/sec execute 174 sec latency 408.141 ms 2023-07-13T13:59:09.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6429 0.10 MB/sec execute 175 sec latency 367.350 ms 2023-07-13T13:59:10.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6452 0.10 MB/sec execute 176 sec latency 280.207 ms 2023-07-13T13:59:11.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6483 0.11 MB/sec execute 177 sec latency 166.064 ms 2023-07-13T13:59:12.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6498 0.11 MB/sec execute 178 sec latency 368.429 ms 2023-07-13T13:59:13.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6529 0.11 MB/sec execute 179 sec latency 492.490 ms 2023-07-13T13:59:14.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6540 0.11 MB/sec execute 180 sec latency 420.752 ms 2023-07-13T13:59:15.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6555 0.11 MB/sec execute 181 sec latency 378.974 ms 2023-07-13T13:59:16.837 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6578 0.11 MB/sec execute 182 sec latency 258.595 ms 2023-07-13T13:59:17.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6722 0.11 MB/sec execute 183 sec latency 368.283 ms 2023-07-13T13:59:18.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6743 0.11 MB/sec execute 184 sec latency 360.879 ms 2023-07-13T13:59:19.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6764 0.11 MB/sec execute 185 sec latency 368.078 ms 2023-07-13T13:59:20.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6820 0.11 MB/sec execute 186 sec latency 289.827 ms 2023-07-13T13:59:21.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6834 0.11 MB/sec execute 187 sec latency 386.621 ms 2023-07-13T13:59:22.518 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:59:22.520 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:59:22.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6837 0.11 MB/sec execute 188 sec latency 376.537 ms 2023-07-13T13:59:23.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6840 0.11 MB/sec execute 189 sec latency 450.991 ms 2023-07-13T13:59:24.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6844 0.11 MB/sec execute 190 sec latency 481.204 ms 2023-07-13T13:59:25.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6847 0.11 MB/sec execute 191 sec latency 459.987 ms 2023-07-13T13:59:26.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6849 0.11 MB/sec execute 192 sec latency 479.954 ms 2023-07-13T13:59:27.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6854 0.11 MB/sec execute 193 sec latency 436.804 ms 2023-07-13T13:59:28.838 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6862 0.11 MB/sec execute 194 sec latency 410.949 ms 2023-07-13T13:59:29.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6864 0.11 MB/sec execute 195 sec latency 378.180 ms 2023-07-13T13:59:30.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6867 0.11 MB/sec execute 196 sec latency 524.263 ms 2023-07-13T13:59:31.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6869 0.11 MB/sec execute 197 sec latency 365.064 ms 2023-07-13T13:59:32.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6873 0.11 MB/sec execute 198 sec latency 388.147 ms 2023-07-13T13:59:33.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6877 0.11 MB/sec execute 199 sec latency 382.162 ms 2023-07-13T13:59:34.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6879 0.11 MB/sec execute 200 sec latency 370.038 ms 2023-07-13T13:59:35.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6882 0.10 MB/sec execute 201 sec latency 370.381 ms 2023-07-13T13:59:36.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6887 0.10 MB/sec execute 202 sec latency 372.098 ms 2023-07-13T13:59:37.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6889 0.10 MB/sec execute 203 sec latency 364.418 ms 2023-07-13T13:59:38.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6892 0.10 MB/sec execute 204 sec latency 376.343 ms 2023-07-13T13:59:39.839 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6914 0.10 MB/sec execute 205 sec latency 356.297 ms 2023-07-13T13:59:40.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6931 0.10 MB/sec execute 206 sec latency 228.563 ms 2023-07-13T13:59:41.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6948 0.10 MB/sec execute 207 sec latency 404.333 ms 2023-07-13T13:59:42.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 6952 0.10 MB/sec execute 208 sec latency 403.555 ms 2023-07-13T13:59:43.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7066 0.11 MB/sec execute 209 sec latency 382.995 ms 2023-07-13T13:59:44.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7085 0.11 MB/sec execute 210 sec latency 378.754 ms 2023-07-13T13:59:45.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7108 0.11 MB/sec execute 211 sec latency 186.096 ms 2023-07-13T13:59:46.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7122 0.11 MB/sec execute 212 sec latency 395.590 ms 2023-07-13T13:59:47.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7135 0.11 MB/sec execute 213 sec latency 378.847 ms 2023-07-13T13:59:48.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7180 0.11 MB/sec execute 214 sec latency 348.414 ms 2023-07-13T13:59:49.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7190 0.11 MB/sec execute 215 sec latency 559.692 ms 2023-07-13T13:59:50.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7218 0.11 MB/sec execute 216 sec latency 206.300 ms 2023-07-13T13:59:51.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7230 0.11 MB/sec execute 217 sec latency 417.887 ms 2023-07-13T13:59:52.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:59:52.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T13:59:52.840 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7242 0.11 MB/sec execute 218 sec latency 370.268 ms 2023-07-13T13:59:53.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7266 0.11 MB/sec execute 219 sec latency 165.814 ms 2023-07-13T13:59:54.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7309 0.12 MB/sec execute 220 sec latency 391.555 ms 2023-07-13T13:59:55.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7324 0.11 MB/sec execute 221 sec latency 237.965 ms 2023-07-13T13:59:56.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7334 0.11 MB/sec execute 222 sec latency 221.694 ms 2023-07-13T13:59:57.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7341 0.11 MB/sec execute 223 sec latency 262.847 ms 2023-07-13T13:59:58.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7352 0.11 MB/sec execute 224 sec latency 278.715 ms 2023-07-13T13:59:59.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7365 0.11 MB/sec execute 225 sec latency 194.800 ms 2023-07-13T14:00:00.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7379 0.11 MB/sec execute 226 sec latency 156.539 ms 2023-07-13T14:00:01.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7391 0.11 MB/sec execute 227 sec latency 224.547 ms 2023-07-13T14:00:02.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7404 0.11 MB/sec execute 228 sec latency 171.693 ms 2023-07-13T14:00:03.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7414 0.11 MB/sec execute 229 sec latency 345.901 ms 2023-07-13T14:00:04.841 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7424 0.11 MB/sec execute 230 sec latency 397.972 ms 2023-07-13T14:00:05.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7440 0.11 MB/sec execute 231 sec latency 398.102 ms 2023-07-13T14:00:06.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7458 0.11 MB/sec execute 232 sec latency 398.979 ms 2023-07-13T14:00:07.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7467 0.11 MB/sec execute 233 sec latency 377.937 ms 2023-07-13T14:00:08.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7481 0.11 MB/sec execute 234 sec latency 211.171 ms 2023-07-13T14:00:09.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7488 0.11 MB/sec execute 235 sec latency 248.998 ms 2023-07-13T14:00:10.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7499 0.11 MB/sec execute 236 sec latency 246.962 ms 2023-07-13T14:00:11.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7512 0.11 MB/sec execute 237 sec latency 193.443 ms 2023-07-13T14:00:12.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7527 0.11 MB/sec execute 238 sec latency 180.266 ms 2023-07-13T14:00:13.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7539 0.11 MB/sec execute 239 sec latency 193.787 ms 2023-07-13T14:00:14.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7553 0.11 MB/sec execute 240 sec latency 211.580 ms 2023-07-13T14:00:15.842 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7566 0.11 MB/sec execute 241 sec latency 318.907 ms 2023-07-13T14:00:16.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7572 0.11 MB/sec execute 242 sec latency 398.712 ms 2023-07-13T14:00:17.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7579 0.11 MB/sec execute 243 sec latency 414.622 ms 2023-07-13T14:00:18.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7591 0.11 MB/sec execute 244 sec latency 343.660 ms 2023-07-13T14:00:19.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7608 0.10 MB/sec execute 245 sec latency 386.756 ms 2023-07-13T14:00:20.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7626 0.10 MB/sec execute 246 sec latency 371.006 ms 2023-07-13T14:00:21.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7642 0.10 MB/sec execute 247 sec latency 371.208 ms 2023-07-13T14:00:22.763 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:00:22.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:00:22.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7659 0.10 MB/sec execute 248 sec latency 306.152 ms 2023-07-13T14:00:23.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7683 0.10 MB/sec execute 249 sec latency 225.887 ms 2023-07-13T14:00:24.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7697 0.10 MB/sec execute 250 sec latency 467.763 ms 2023-07-13T14:00:25.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7712 0.10 MB/sec execute 251 sec latency 473.077 ms 2023-07-13T14:00:26.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7721 0.10 MB/sec execute 252 sec latency 412.719 ms 2023-07-13T14:00:27.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7728 0.10 MB/sec execute 253 sec latency 492.391 ms 2023-07-13T14:00:28.843 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7759 0.10 MB/sec execute 254 sec latency 426.806 ms 2023-07-13T14:00:29.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7768 0.10 MB/sec execute 255 sec latency 441.108 ms 2023-07-13T14:00:29.970 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:09:04.503 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.038 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:09:04.571 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.063 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:09:04.562 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.072 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:09:04.571 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.125 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:09:04.624 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.132 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:09:04.631 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.514 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:09:05.047 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.562 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:09:05.061 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.566 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:09:05.065 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:00:30.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7794 0.10 MB/sec execute 256 sec latency 322.031 ms 2023-07-13T14:00:31.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7820 0.10 MB/sec execute 257 sec latency 412.664 ms 2023-07-13T14:00:32.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7853 0.10 MB/sec execute 258 sec latency 263.215 ms 2023-07-13T14:00:33.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7870 0.10 MB/sec execute 259 sec latency 397.247 ms 2023-07-13T14:00:34.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7899 0.10 MB/sec execute 260 sec latency 278.294 ms 2023-07-13T14:00:35.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7925 0.10 MB/sec execute 261 sec latency 333.959 ms 2023-07-13T14:00:36.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7930 0.10 MB/sec execute 262 sec latency 440.043 ms 2023-07-13T14:00:37.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7966 0.10 MB/sec execute 263 sec latency 462.795 ms 2023-07-13T14:00:38.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7974 0.10 MB/sec execute 264 sec latency 388.154 ms 2023-07-13T14:00:39.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7992 0.10 MB/sec execute 265 sec latency 410.243 ms 2023-07-13T14:00:40.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8016 0.10 MB/sec execute 266 sec latency 356.361 ms 2023-07-13T14:00:41.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8040 0.10 MB/sec execute 267 sec latency 390.896 ms 2023-07-13T14:00:42.844 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8045 0.10 MB/sec execute 268 sec latency 385.874 ms 2023-07-13T14:00:43.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8053 0.10 MB/sec execute 269 sec latency 372.083 ms 2023-07-13T14:00:44.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8082 0.10 MB/sec execute 270 sec latency 385.894 ms 2023-07-13T14:00:45.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8105 0.10 MB/sec execute 271 sec latency 561.579 ms 2023-07-13T14:00:46.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8144 0.10 MB/sec execute 272 sec latency 631.860 ms 2023-07-13T14:00:47.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8157 0.10 MB/sec execute 273 sec latency 386.051 ms 2023-07-13T14:00:48.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8169 0.10 MB/sec execute 274 sec latency 385.730 ms 2023-07-13T14:00:49.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8198 0.10 MB/sec execute 275 sec latency 181.096 ms 2023-07-13T14:00:50.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8210 0.10 MB/sec execute 276 sec latency 387.815 ms 2023-07-13T14:00:51.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8237 0.10 MB/sec execute 277 sec latency 370.596 ms 2023-07-13T14:00:52.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8266 0.10 MB/sec execute 278 sec latency 234.928 ms 2023-07-13T14:00:52.901 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:00:52.903 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:00:53.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8277 0.10 MB/sec execute 279 sec latency 382.486 ms 2023-07-13T14:00:54.845 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8284 0.10 MB/sec execute 280 sec latency 369.779 ms 2023-07-13T14:00:55.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8308 0.10 MB/sec execute 281 sec latency 228.523 ms 2023-07-13T14:00:56.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8328 0.10 MB/sec execute 282 sec latency 391.989 ms 2023-07-13T14:00:57.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8356 0.10 MB/sec execute 283 sec latency 232.548 ms 2023-07-13T14:00:58.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8381 0.10 MB/sec execute 284 sec latency 485.876 ms 2023-07-13T14:00:59.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8390 0.10 MB/sec execute 285 sec latency 397.420 ms 2023-07-13T14:01:00.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8405 0.10 MB/sec execute 286 sec latency 512.838 ms 2023-07-13T14:01:01.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8489 0.11 MB/sec execute 287 sec latency 367.158 ms 2023-07-13T14:01:02.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8498 0.11 MB/sec execute 288 sec latency 378.114 ms 2023-07-13T14:01:03.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8512 0.11 MB/sec execute 289 sec latency 376.103 ms 2023-07-13T14:01:04.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8537 0.11 MB/sec execute 290 sec latency 393.730 ms 2023-07-13T14:01:05.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8557 0.11 MB/sec execute 291 sec latency 352.402 ms 2023-07-13T14:01:06.846 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8575 0.11 MB/sec execute 292 sec latency 401.494 ms 2023-07-13T14:01:07.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8595 0.11 MB/sec execute 293 sec latency 412.379 ms 2023-07-13T14:01:08.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8609 0.10 MB/sec execute 294 sec latency 405.934 ms 2023-07-13T14:01:09.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8635 0.10 MB/sec execute 295 sec latency 226.235 ms 2023-07-13T14:01:10.288 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:09:44.819 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.300 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:09:44.832 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.303 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:09:44.801 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.304 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:09:44.801 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.307 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:09:44.804 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.307 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:09:44.805 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.371 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:09:44.868 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.372 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:09:44.869 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.373 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:09:44.904 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:01:10.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8660 0.10 MB/sec execute 296 sec latency 393.379 ms 2023-07-13T14:01:11.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8670 0.10 MB/sec execute 297 sec latency 371.810 ms 2023-07-13T14:01:12.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8696 0.10 MB/sec execute 298 sec latency 125.518 ms 2023-07-13T14:01:13.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8714 0.10 MB/sec execute 299 sec latency 395.464 ms 2023-07-13T14:01:14.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8725 0.10 MB/sec execute 300 sec latency 378.229 ms 2023-07-13T14:01:15.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8749 0.10 MB/sec execute 301 sec latency 412.613 ms 2023-07-13T14:01:16.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8759 0.10 MB/sec execute 302 sec latency 519.131 ms 2023-07-13T14:01:17.847 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8794 0.10 MB/sec execute 303 sec latency 259.430 ms 2023-07-13T14:01:18.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8809 0.10 MB/sec execute 304 sec latency 288.311 ms 2023-07-13T14:01:19.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8860 0.10 MB/sec execute 305 sec latency 390.770 ms 2023-07-13T14:01:20.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8881 0.10 MB/sec execute 306 sec latency 370.909 ms 2023-07-13T14:01:21.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8914 0.10 MB/sec execute 307 sec latency 233.094 ms 2023-07-13T14:01:22.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8933 0.10 MB/sec execute 308 sec latency 422.804 ms 2023-07-13T14:01:22.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:01:22.985 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:01:23.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8948 0.10 MB/sec execute 309 sec latency 380.538 ms 2023-07-13T14:01:24.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8967 0.10 MB/sec execute 310 sec latency 358.825 ms 2023-07-13T14:01:25.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8976 0.10 MB/sec execute 311 sec latency 552.681 ms 2023-07-13T14:01:26.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9007 0.10 MB/sec execute 312 sec latency 382.551 ms 2023-07-13T14:01:27.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9019 0.10 MB/sec execute 313 sec latency 377.194 ms 2023-07-13T14:01:28.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9033 0.10 MB/sec execute 314 sec latency 374.476 ms 2023-07-13T14:01:29.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9084 0.10 MB/sec execute 315 sec latency 303.593 ms 2023-07-13T14:01:30.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9106 0.10 MB/sec execute 316 sec latency 366.079 ms 2023-07-13T14:01:31.848 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9141 0.10 MB/sec execute 317 sec latency 362.751 ms 2023-07-13T14:01:32.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9159 0.10 MB/sec execute 318 sec latency 373.472 ms 2023-07-13T14:01:33.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9167 0.10 MB/sec execute 319 sec latency 350.586 ms 2023-07-13T14:01:34.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9187 0.10 MB/sec execute 320 sec latency 441.651 ms 2023-07-13T14:01:35.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9199 0.10 MB/sec execute 321 sec latency 442.148 ms 2023-07-13T14:01:36.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9244 0.10 MB/sec execute 322 sec latency 500.249 ms 2023-07-13T14:01:37.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9252 0.10 MB/sec execute 323 sec latency 367.561 ms 2023-07-13T14:01:38.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9281 0.10 MB/sec execute 324 sec latency 443.282 ms 2023-07-13T14:01:39.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9288 0.10 MB/sec execute 325 sec latency 397.740 ms 2023-07-13T14:01:40.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9322 0.10 MB/sec execute 326 sec latency 401.452 ms 2023-07-13T14:01:41.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9367 0.10 MB/sec execute 327 sec latency 405.921 ms 2023-07-13T14:01:42.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9400 0.10 MB/sec execute 328 sec latency 475.104 ms 2023-07-13T14:01:43.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9410 0.10 MB/sec execute 329 sec latency 392.789 ms 2023-07-13T14:01:44.849 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9428 0.10 MB/sec execute 330 sec latency 385.126 ms 2023-07-13T14:01:45.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9439 0.10 MB/sec execute 331 sec latency 364.195 ms 2023-07-13T14:01:46.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9457 0.10 MB/sec execute 332 sec latency 380.778 ms 2023-07-13T14:01:47.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9465 0.10 MB/sec execute 333 sec latency 351.283 ms 2023-07-13T14:01:48.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9470 0.10 MB/sec execute 334 sec latency 395.301 ms 2023-07-13T14:01:49.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9479 0.10 MB/sec execute 335 sec latency 398.265 ms 2023-07-13T14:01:50.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9498 0.10 MB/sec execute 336 sec latency 394.738 ms 2023-07-13T14:01:51.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9514 0.10 MB/sec execute 337 sec latency 265.621 ms 2023-07-13T14:01:52.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9535 0.10 MB/sec execute 338 sec latency 412.116 ms 2023-07-13T14:01:53.123 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:01:53.125 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:01:53.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9540 0.10 MB/sec execute 339 sec latency 376.828 ms 2023-07-13T14:01:54.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9557 0.10 MB/sec execute 340 sec latency 182.899 ms 2023-07-13T14:01:55.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9574 0.10 MB/sec execute 341 sec latency 514.558 ms 2023-07-13T14:01:56.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9598 0.10 MB/sec execute 342 sec latency 516.962 ms 2023-07-13T14:01:57.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9608 0.10 MB/sec execute 343 sec latency 367.037 ms 2023-07-13T14:01:58.850 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9655 0.10 MB/sec execute 344 sec latency 386.107 ms 2023-07-13T14:01:59.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9664 0.10 MB/sec execute 345 sec latency 368.125 ms 2023-07-13T14:02:00.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9682 0.10 MB/sec execute 346 sec latency 421.737 ms 2023-07-13T14:02:01.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9698 0.10 MB/sec execute 347 sec latency 445.283 ms 2023-07-13T14:02:02.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9710 0.10 MB/sec execute 348 sec latency 378.386 ms 2023-07-13T14:02:03.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9719 0.10 MB/sec execute 349 sec latency 388.440 ms 2023-07-13T14:02:04.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9724 0.10 MB/sec execute 350 sec latency 435.619 ms 2023-07-13T14:02:05.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9846 0.10 MB/sec execute 351 sec latency 527.206 ms 2023-07-13T14:02:06.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9860 0.10 MB/sec execute 352 sec latency 368.904 ms 2023-07-13T14:02:07.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9879 0.10 MB/sec execute 353 sec latency 379.982 ms 2023-07-13T14:02:08.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9971 0.10 MB/sec execute 354 sec latency 348.929 ms 2023-07-13T14:02:09.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 9997 0.11 MB/sec execute 355 sec latency 375.844 ms 2023-07-13T14:02:10.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10027 0.11 MB/sec execute 356 sec latency 173.201 ms 2023-07-13T14:02:11.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10042 0.11 MB/sec execute 357 sec latency 349.288 ms 2023-07-13T14:02:12.851 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10073 0.11 MB/sec execute 358 sec latency 389.960 ms 2023-07-13T14:02:13.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10088 0.11 MB/sec execute 359 sec latency 416.663 ms 2023-07-13T14:02:14.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10102 0.11 MB/sec execute 360 sec latency 379.549 ms 2023-07-13T14:02:15.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10122 0.11 MB/sec execute 361 sec latency 257.947 ms 2023-07-13T14:02:16.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10266 0.11 MB/sec execute 362 sec latency 409.066 ms 2023-07-13T14:02:17.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10286 0.11 MB/sec execute 363 sec latency 385.701 ms 2023-07-13T14:02:18.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10308 0.11 MB/sec execute 364 sec latency 392.675 ms 2023-07-13T14:02:19.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10365 0.11 MB/sec execute 365 sec latency 285.289 ms 2023-07-13T14:02:20.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10379 0.11 MB/sec execute 366 sec latency 375.866 ms 2023-07-13T14:02:21.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10382 0.11 MB/sec execute 367 sec latency 393.960 ms 2023-07-13T14:02:22.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10385 0.11 MB/sec execute 368 sec latency 372.116 ms 2023-07-13T14:02:23.237 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:02:23.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:02:23.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10390 0.11 MB/sec execute 369 sec latency 474.563 ms 2023-07-13T14:02:24.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10392 0.11 MB/sec execute 370 sec latency 489.383 ms 2023-07-13T14:02:25.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10394 0.11 MB/sec execute 371 sec latency 671.912 ms 2023-07-13T14:02:26.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10398 0.11 MB/sec execute 372 sec latency 456.747 ms 2023-07-13T14:02:27.852 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10405 0.11 MB/sec execute 373 sec latency 385.277 ms 2023-07-13T14:02:28.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10408 0.11 MB/sec execute 374 sec latency 378.954 ms 2023-07-13T14:02:29.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10411 0.11 MB/sec execute 375 sec latency 366.300 ms 2023-07-13T14:02:30.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10415 0.11 MB/sec execute 376 sec latency 382.656 ms 2023-07-13T14:02:31.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10418 0.11 MB/sec execute 377 sec latency 370.246 ms 2023-07-13T14:02:32.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10421 0.11 MB/sec execute 378 sec latency 366.921 ms 2023-07-13T14:02:33.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10424 0.11 MB/sec execute 379 sec latency 380.131 ms 2023-07-13T14:02:34.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10429 0.11 MB/sec execute 380 sec latency 368.075 ms 2023-07-13T14:02:35.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10431 0.11 MB/sec execute 381 sec latency 458.156 ms 2023-07-13T14:02:36.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10434 0.11 MB/sec execute 382 sec latency 374.493 ms 2023-07-13T14:02:37.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10438 0.10 MB/sec execute 383 sec latency 373.208 ms 2023-07-13T14:02:38.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10460 0.10 MB/sec execute 384 sec latency 175.466 ms 2023-07-13T14:02:39.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10477 0.10 MB/sec execute 385 sec latency 182.009 ms 2023-07-13T14:02:40.853 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10492 0.10 MB/sec execute 386 sec latency 470.278 ms 2023-07-13T14:02:41.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10589 0.11 MB/sec execute 387 sec latency 391.235 ms 2023-07-13T14:02:42.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10621 0.11 MB/sec execute 388 sec latency 145.420 ms 2023-07-13T14:02:43.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10636 0.11 MB/sec execute 389 sec latency 361.602 ms 2023-07-13T14:02:44.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10653 0.11 MB/sec execute 390 sec latency 392.171 ms 2023-07-13T14:02:45.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10668 0.11 MB/sec execute 391 sec latency 482.900 ms 2023-07-13T14:02:46.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10680 0.11 MB/sec execute 392 sec latency 465.753 ms 2023-07-13T14:02:47.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10725 0.11 MB/sec execute 393 sec latency 369.866 ms 2023-07-13T14:02:48.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10736 0.11 MB/sec execute 394 sec latency 455.508 ms 2023-07-13T14:02:49.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10763 0.11 MB/sec execute 395 sec latency 229.409 ms 2023-07-13T14:02:50.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10776 0.11 MB/sec execute 396 sec latency 389.929 ms 2023-07-13T14:02:51.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10792 0.11 MB/sec execute 397 sec latency 347.893 ms 2023-07-13T14:02:52.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10813 0.11 MB/sec execute 398 sec latency 183.546 ms 2023-07-13T14:02:53.402 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:02:53.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:02:53.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10857 0.11 MB/sec execute 399 sec latency 384.363 ms 2023-07-13T14:02:54.854 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10870 0.11 MB/sec execute 400 sec latency 221.284 ms 2023-07-13T14:02:55.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10879 0.11 MB/sec execute 401 sec latency 397.162 ms 2023-07-13T14:02:56.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10887 0.11 MB/sec execute 402 sec latency 461.532 ms 2023-07-13T14:02:57.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10898 0.11 MB/sec execute 403 sec latency 207.033 ms 2023-07-13T14:02:58.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10913 0.11 MB/sec execute 404 sec latency 204.255 ms 2023-07-13T14:02:59.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10926 0.11 MB/sec execute 405 sec latency 178.380 ms 2023-07-13T14:03:00.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10938 0.11 MB/sec execute 406 sec latency 206.913 ms 2023-07-13T14:03:01.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10952 0.11 MB/sec execute 407 sec latency 221.413 ms 2023-07-13T14:03:02.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10961 0.11 MB/sec execute 408 sec latency 383.530 ms 2023-07-13T14:03:03.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10973 0.11 MB/sec execute 409 sec latency 417.192 ms 2023-07-13T14:03:04.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 10988 0.11 MB/sec execute 410 sec latency 389.545 ms 2023-07-13T14:03:05.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11004 0.11 MB/sec execute 411 sec latency 359.368 ms 2023-07-13T14:03:06.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11016 0.11 MB/sec execute 412 sec latency 561.502 ms 2023-07-13T14:03:07.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11027 0.11 MB/sec execute 413 sec latency 219.436 ms 2023-07-13T14:03:08.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11034 0.11 MB/sec execute 414 sec latency 255.191 ms 2023-07-13T14:03:09.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11045 0.11 MB/sec execute 415 sec latency 237.524 ms 2023-07-13T14:03:10.855 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11059 0.11 MB/sec execute 416 sec latency 200.376 ms 2023-07-13T14:03:11.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11073 0.11 MB/sec execute 417 sec latency 192.962 ms 2023-07-13T14:03:12.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11085 0.11 MB/sec execute 418 sec latency 198.230 ms 2023-07-13T14:03:13.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11099 0.11 MB/sec execute 419 sec latency 190.874 ms 2023-07-13T14:03:14.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11112 0.11 MB/sec execute 420 sec latency 176.363 ms 2023-07-13T14:03:15.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11121 0.11 MB/sec execute 421 sec latency 389.168 ms 2023-07-13T14:03:16.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11126 0.11 MB/sec execute 422 sec latency 438.834 ms 2023-07-13T14:03:17.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11137 0.11 MB/sec execute 423 sec latency 382.372 ms 2023-07-13T14:03:18.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11155 0.11 MB/sec execute 424 sec latency 395.000 ms 2023-07-13T14:03:19.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11172 0.11 MB/sec execute 425 sec latency 362.824 ms 2023-07-13T14:03:20.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11192 0.11 MB/sec execute 426 sec latency 364.938 ms 2023-07-13T14:03:21.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11207 0.11 MB/sec execute 427 sec latency 239.846 ms 2023-07-13T14:03:22.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11234 0.10 MB/sec execute 428 sec latency 266.075 ms 2023-07-13T14:03:23.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:03:23.559 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:03:23.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11246 0.10 MB/sec execute 429 sec latency 507.505 ms 2023-07-13T14:03:24.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11262 0.10 MB/sec execute 430 sec latency 282.639 ms 2023-07-13T14:03:25.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11269 0.10 MB/sec execute 431 sec latency 436.919 ms 2023-07-13T14:03:26.856 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11277 0.10 MB/sec execute 432 sec latency 467.373 ms 2023-07-13T14:03:27.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11310 0.10 MB/sec execute 433 sec latency 385.334 ms 2023-07-13T14:03:28.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11325 0.10 MB/sec execute 434 sec latency 421.422 ms 2023-07-13T14:03:29.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11343 0.10 MB/sec execute 435 sec latency 358.157 ms 2023-07-13T14:03:30.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11372 0.10 MB/sec execute 436 sec latency 348.416 ms 2023-07-13T14:03:31.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11404 0.10 MB/sec execute 437 sec latency 309.818 ms 2023-07-13T14:03:32.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11438 0.10 MB/sec execute 438 sec latency 377.543 ms 2023-07-13T14:03:33.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11470 0.10 MB/sec execute 439 sec latency 270.049 ms 2023-07-13T14:03:34.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11475 0.10 MB/sec execute 440 sec latency 378.055 ms 2023-07-13T14:03:35.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11512 0.10 MB/sec execute 441 sec latency 367.108 ms 2023-07-13T14:03:36.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11516 0.10 MB/sec execute 442 sec latency 538.340 ms 2023-07-13T14:03:37.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11532 0.10 MB/sec execute 443 sec latency 398.813 ms 2023-07-13T14:03:38.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11561 0.10 MB/sec execute 444 sec latency 352.240 ms 2023-07-13T14:03:39.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11586 0.10 MB/sec execute 445 sec latency 305.990 ms 2023-07-13T14:03:40.857 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11589 0.10 MB/sec execute 446 sec latency 364.201 ms 2023-07-13T14:03:41.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11595 0.10 MB/sec execute 447 sec latency 371.926 ms 2023-07-13T14:03:42.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11627 0.10 MB/sec execute 448 sec latency 382.522 ms 2023-07-13T14:03:43.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11652 0.10 MB/sec execute 449 sec latency 278.732 ms 2023-07-13T14:03:44.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11686 0.10 MB/sec execute 450 sec latency 460.409 ms 2023-07-13T14:03:45.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11703 0.10 MB/sec execute 451 sec latency 378.341 ms 2023-07-13T14:03:46.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11705 0.10 MB/sec execute 452 sec latency 592.636 ms 2023-07-13T14:03:47.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11721 0.10 MB/sec execute 453 sec latency 364.819 ms 2023-07-13T14:03:48.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11756 0.10 MB/sec execute 454 sec latency 369.120 ms 2023-07-13T14:03:49.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11770 0.10 MB/sec execute 455 sec latency 363.920 ms 2023-07-13T14:03:50.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11803 0.10 MB/sec execute 456 sec latency 391.724 ms 2023-07-13T14:03:51.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11824 0.10 MB/sec execute 457 sec latency 369.940 ms 2023-07-13T14:03:52.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11826 0.10 MB/sec execute 458 sec latency 383.614 ms 2023-07-13T14:03:53.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:03:53.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:03:53.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11837 0.10 MB/sec execute 459 sec latency 496.978 ms 2023-07-13T14:03:54.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11867 0.10 MB/sec execute 460 sec latency 412.551 ms 2023-07-13T14:03:55.858 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11891 0.10 MB/sec execute 461 sec latency 254.481 ms 2023-07-13T14:03:56.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11908 0.10 MB/sec execute 462 sec latency 363.398 ms 2023-07-13T14:03:57.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11936 0.10 MB/sec execute 463 sec latency 408.635 ms 2023-07-13T14:03:58.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 11940 0.10 MB/sec execute 464 sec latency 393.041 ms 2023-07-13T14:03:59.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12033 0.11 MB/sec execute 465 sec latency 391.714 ms 2023-07-13T14:04:00.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12041 0.11 MB/sec execute 466 sec latency 366.271 ms 2023-07-13T14:04:01.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12053 0.11 MB/sec execute 467 sec latency 408.057 ms 2023-07-13T14:04:02.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12074 0.11 MB/sec execute 468 sec latency 392.172 ms 2023-07-13T14:04:03.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12102 0.11 MB/sec execute 469 sec latency 215.414 ms 2023-07-13T14:04:04.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12121 0.11 MB/sec execute 470 sec latency 356.988 ms 2023-07-13T14:04:05.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12141 0.11 MB/sec execute 471 sec latency 416.226 ms 2023-07-13T14:04:06.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12148 0.11 MB/sec execute 472 sec latency 475.943 ms 2023-07-13T14:04:07.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12179 0.11 MB/sec execute 473 sec latency 188.512 ms 2023-07-13T14:04:08.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12186 0.11 MB/sec execute 474 sec latency 356.153 ms 2023-07-13T14:04:09.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12211 0.11 MB/sec execute 475 sec latency 377.621 ms 2023-07-13T14:04:10.859 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12241 0.11 MB/sec execute 476 sec latency 88.308 ms 2023-07-13T14:04:11.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12261 0.10 MB/sec execute 477 sec latency 375.626 ms 2023-07-13T14:04:12.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12271 0.10 MB/sec execute 478 sec latency 385.454 ms 2023-07-13T14:04:13.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12296 0.10 MB/sec execute 479 sec latency 409.878 ms 2023-07-13T14:04:14.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12308 0.10 MB/sec execute 480 sec latency 397.248 ms 2023-07-13T14:04:15.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12341 0.10 MB/sec execute 481 sec latency 251.096 ms 2023-07-13T14:04:16.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12356 0.10 MB/sec execute 482 sec latency 316.863 ms 2023-07-13T14:04:17.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12412 0.10 MB/sec execute 483 sec latency 380.162 ms 2023-07-13T14:04:18.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12430 0.10 MB/sec execute 484 sec latency 356.932 ms 2023-07-13T14:04:19.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12462 0.10 MB/sec execute 485 sec latency 282.010 ms 2023-07-13T14:04:20.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12482 0.10 MB/sec execute 486 sec latency 392.743 ms 2023-07-13T14:04:21.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12496 0.10 MB/sec execute 487 sec latency 363.357 ms 2023-07-13T14:04:22.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12514 0.10 MB/sec execute 488 sec latency 369.174 ms 2023-07-13T14:04:23.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:04:23.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:04:23.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12526 0.10 MB/sec execute 489 sec latency 426.938 ms 2023-07-13T14:04:24.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12556 0.10 MB/sec execute 490 sec latency 414.463 ms 2023-07-13T14:04:25.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12569 0.10 MB/sec execute 491 sec latency 357.125 ms 2023-07-13T14:04:26.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12578 0.10 MB/sec execute 492 sec latency 500.657 ms 2023-07-13T14:04:27.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12633 0.10 MB/sec execute 493 sec latency 357.376 ms 2023-07-13T14:04:28.860 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12655 0.10 MB/sec execute 494 sec latency 348.110 ms 2023-07-13T14:04:29.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12690 0.10 MB/sec execute 495 sec latency 362.355 ms 2023-07-13T14:04:30.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12707 0.10 MB/sec execute 496 sec latency 386.304 ms 2023-07-13T14:04:31.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12716 0.10 MB/sec execute 497 sec latency 369.674 ms 2023-07-13T14:04:32.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12736 0.10 MB/sec execute 498 sec latency 409.684 ms 2023-07-13T14:04:33.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12751 0.10 MB/sec execute 499 sec latency 421.935 ms 2023-07-13T14:04:34.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12793 0.10 MB/sec execute 500 sec latency 456.422 ms 2023-07-13T14:04:35.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12801 0.10 MB/sec execute 501 sec latency 405.061 ms 2023-07-13T14:04:36.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12830 0.10 MB/sec execute 502 sec latency 597.222 ms 2023-07-13T14:04:37.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12837 0.10 MB/sec execute 503 sec latency 388.222 ms 2023-07-13T14:04:38.317 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:13:12.841 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.346 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:13:12.871 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.379 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:13:12.870 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.383 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:13:12.874 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.387 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:13:12.878 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.389 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:13:12.880 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.469 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:13:12.960 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.480 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:13:12.971 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.492 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:13:13.017 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:04:38.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12871 0.10 MB/sec execute 504 sec latency 390.090 ms 2023-07-13T14:04:39.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12916 0.10 MB/sec execute 505 sec latency 407.578 ms 2023-07-13T14:04:40.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12950 0.10 MB/sec execute 506 sec latency 560.484 ms 2023-07-13T14:04:41.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12960 0.10 MB/sec execute 507 sec latency 356.228 ms 2023-07-13T14:04:42.861 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12978 0.10 MB/sec execute 508 sec latency 382.878 ms 2023-07-13T14:04:43.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 12989 0.10 MB/sec execute 509 sec latency 381.849 ms 2023-07-13T14:04:44.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13012 0.10 MB/sec execute 510 sec latency 358.635 ms 2023-07-13T14:04:45.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13016 0.10 MB/sec execute 511 sec latency 662.484 ms 2023-07-13T14:04:46.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13020 0.10 MB/sec execute 512 sec latency 632.405 ms 2023-07-13T14:04:47.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13037 0.10 MB/sec execute 513 sec latency 397.610 ms 2023-07-13T14:04:48.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13048 0.10 MB/sec execute 514 sec latency 454.783 ms 2023-07-13T14:04:49.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13064 0.10 MB/sec execute 515 sec latency 168.931 ms 2023-07-13T14:04:50.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13085 0.10 MB/sec execute 516 sec latency 370.974 ms 2023-07-13T14:04:51.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13092 0.10 MB/sec execute 517 sec latency 411.524 ms 2023-07-13T14:04:52.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13108 0.10 MB/sec execute 518 sec latency 188.147 ms 2023-07-13T14:04:53.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13140 0.10 MB/sec execute 519 sec latency 356.915 ms 2023-07-13T14:04:53.951 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:04:53.953 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:04:54.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13148 0.10 MB/sec execute 520 sec latency 376.208 ms 2023-07-13T14:04:55.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13158 0.10 MB/sec execute 521 sec latency 386.736 ms 2023-07-13T14:04:56.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13206 0.10 MB/sec execute 522 sec latency 466.252 ms 2023-07-13T14:04:57.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13223 0.10 MB/sec execute 523 sec latency 400.109 ms 2023-07-13T14:04:58.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13233 0.10 MB/sec execute 524 sec latency 404.618 ms 2023-07-13T14:04:59.862 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13252 0.10 MB/sec execute 525 sec latency 402.264 ms 2023-07-13T14:05:00.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13260 0.10 MB/sec execute 526 sec latency 355.424 ms 2023-07-13T14:05:01.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13270 0.10 MB/sec execute 527 sec latency 396.297 ms 2023-07-13T14:05:02.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13369 0.11 MB/sec execute 528 sec latency 437.160 ms 2023-07-13T14:05:03.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13400 0.11 MB/sec execute 529 sec latency 439.062 ms 2023-07-13T14:05:04.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13413 0.11 MB/sec execute 530 sec latency 415.360 ms 2023-07-13T14:05:05.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13431 0.11 MB/sec execute 531 sec latency 218.421 ms 2023-07-13T14:05:06.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13526 0.11 MB/sec execute 532 sec latency 429.539 ms 2023-07-13T14:05:07.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13552 0.11 MB/sec execute 533 sec latency 178.366 ms 2023-07-13T14:05:08.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13582 0.11 MB/sec execute 534 sec latency 236.437 ms 2023-07-13T14:05:09.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13616 0.11 MB/sec execute 535 sec latency 489.774 ms 2023-07-13T14:05:10.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13624 0.11 MB/sec execute 536 sec latency 403.904 ms 2023-07-13T14:05:11.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13640 0.11 MB/sec execute 537 sec latency 500.620 ms 2023-07-13T14:05:12.863 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13660 0.11 MB/sec execute 538 sec latency 362.091 ms 2023-07-13T14:05:13.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13674 0.11 MB/sec execute 539 sec latency 257.528 ms 2023-07-13T14:05:14.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13819 0.11 MB/sec execute 540 sec latency 374.769 ms 2023-07-13T14:05:15.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13838 0.11 MB/sec execute 541 sec latency 302.644 ms 2023-07-13T14:05:16.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13860 0.11 MB/sec execute 542 sec latency 527.693 ms 2023-07-13T14:05:17.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13917 0.11 MB/sec execute 543 sec latency 377.638 ms 2023-07-13T14:05:18.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13930 0.11 MB/sec execute 544 sec latency 377.577 ms 2023-07-13T14:05:19.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13932 0.11 MB/sec execute 545 sec latency 365.643 ms 2023-07-13T14:05:20.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13936 0.11 MB/sec execute 546 sec latency 444.274 ms 2023-07-13T14:05:21.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13940 0.11 MB/sec execute 547 sec latency 401.526 ms 2023-07-13T14:05:22.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13942 0.11 MB/sec execute 548 sec latency 474.594 ms 2023-07-13T14:05:23.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13946 0.11 MB/sec execute 549 sec latency 512.891 ms 2023-07-13T14:05:24.021 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:05:24.023 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:05:24.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13952 0.11 MB/sec execute 550 sec latency 372.282 ms 2023-07-13T14:05:25.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13956 0.11 MB/sec execute 551 sec latency 378.867 ms 2023-07-13T14:05:26.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13959 0.11 MB/sec execute 552 sec latency 510.826 ms 2023-07-13T14:05:27.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13961 0.11 MB/sec execute 553 sec latency 369.408 ms 2023-07-13T14:05:28.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13965 0.11 MB/sec execute 554 sec latency 375.759 ms 2023-07-13T14:05:29.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13968 0.11 MB/sec execute 555 sec latency 366.363 ms 2023-07-13T14:05:30.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13972 0.11 MB/sec execute 556 sec latency 365.592 ms 2023-07-13T14:05:31.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13975 0.11 MB/sec execute 557 sec latency 398.540 ms 2023-07-13T14:05:32.864 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13979 0.11 MB/sec execute 558 sec latency 400.251 ms 2023-07-13T14:05:33.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13982 0.11 MB/sec execute 559 sec latency 366.809 ms 2023-07-13T14:05:34.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13984 0.11 MB/sec execute 560 sec latency 364.049 ms 2023-07-13T14:05:35.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 13992 0.11 MB/sec execute 561 sec latency 367.284 ms 2023-07-13T14:05:36.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14014 0.11 MB/sec execute 562 sec latency 172.169 ms 2023-07-13T14:05:37.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14039 0.11 MB/sec execute 563 sec latency 181.576 ms 2023-07-13T14:05:38.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14044 0.11 MB/sec execute 564 sec latency 408.572 ms 2023-07-13T14:05:39.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14141 0.11 MB/sec execute 565 sec latency 414.446 ms 2023-07-13T14:05:40.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14174 0.11 MB/sec execute 566 sec latency 171.826 ms 2023-07-13T14:05:41.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14194 0.11 MB/sec execute 567 sec latency 369.948 ms 2023-07-13T14:05:42.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14204 0.11 MB/sec execute 568 sec latency 442.048 ms 2023-07-13T14:05:43.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14218 0.11 MB/sec execute 569 sec latency 324.232 ms 2023-07-13T14:05:44.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14259 0.11 MB/sec execute 570 sec latency 466.480 ms 2023-07-13T14:05:45.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14280 0.11 MB/sec execute 571 sec latency 176.641 ms 2023-07-13T14:05:46.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14304 0.11 MB/sec execute 572 sec latency 388.231 ms 2023-07-13T14:05:47.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14314 0.11 MB/sec execute 573 sec latency 393.161 ms 2023-07-13T14:05:48.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14326 0.11 MB/sec execute 574 sec latency 361.772 ms 2023-07-13T14:05:49.865 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14347 0.11 MB/sec execute 575 sec latency 377.110 ms 2023-07-13T14:05:50.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14387 0.11 MB/sec execute 576 sec latency 141.988 ms 2023-07-13T14:05:51.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14410 0.11 MB/sec execute 577 sec latency 375.867 ms 2023-07-13T14:05:52.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14423 0.11 MB/sec execute 578 sec latency 199.153 ms 2023-07-13T14:05:53.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14431 0.11 MB/sec execute 579 sec latency 231.979 ms 2023-07-13T14:05:54.160 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:05:54.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:05:54.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14440 0.11 MB/sec execute 580 sec latency 240.981 ms 2023-07-13T14:05:55.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14453 0.11 MB/sec execute 581 sec latency 270.711 ms 2023-07-13T14:05:56.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14466 0.11 MB/sec execute 582 sec latency 173.596 ms 2023-07-13T14:05:57.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14478 0.11 MB/sec execute 583 sec latency 201.838 ms 2023-07-13T14:05:58.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14491 0.11 MB/sec execute 584 sec latency 181.112 ms 2023-07-13T14:05:59.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14506 0.11 MB/sec execute 585 sec latency 193.632 ms 2023-07-13T14:06:00.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14515 0.11 MB/sec execute 586 sec latency 384.406 ms 2023-07-13T14:06:01.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14534 0.11 MB/sec execute 587 sec latency 427.152 ms 2023-07-13T14:06:02.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14539 0.11 MB/sec execute 588 sec latency 403.979 ms 2023-07-13T14:06:03.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14559 0.11 MB/sec execute 589 sec latency 380.866 ms 2023-07-13T14:06:04.866 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14571 0.11 MB/sec execute 590 sec latency 188.558 ms 2023-07-13T14:06:05.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14578 0.11 MB/sec execute 591 sec latency 240.215 ms 2023-07-13T14:06:06.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14589 0.11 MB/sec execute 592 sec latency 380.825 ms 2023-07-13T14:06:07.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14602 0.11 MB/sec execute 593 sec latency 177.297 ms 2023-07-13T14:06:08.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14615 0.11 MB/sec execute 594 sec latency 199.408 ms 2023-07-13T14:06:09.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14629 0.11 MB/sec execute 595 sec latency 229.812 ms 2023-07-13T14:06:10.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14641 0.11 MB/sec execute 596 sec latency 185.645 ms 2023-07-13T14:06:11.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14656 0.11 MB/sec execute 597 sec latency 169.545 ms 2023-07-13T14:06:12.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14666 0.11 MB/sec execute 598 sec latency 328.651 ms 2023-07-13T14:06:13.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 14673 0.11 MB/sec execute 599 sec latency 420.346 ms 2023-07-13T14:06:14.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 600 sec 2023-07-13T14:06:15.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 601 sec 2023-07-13T14:06:16.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 602 sec 2023-07-13T14:06:17.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 603 sec 2023-07-13T14:06:18.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 604 sec 2023-07-13T14:06:19.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 605 sec 2023-07-13T14:06:20.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 606 sec 2023-07-13T14:06:21.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 607 sec 2023-07-13T14:06:22.867 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 608 sec 2023-07-13T14:06:23.868 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 609 sec 2023-07-13T14:06:24.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:06:24.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:06:24.868 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 610 sec 2023-07-13T14:06:25.868 INFO:tasks.workunit.client.0.smithi118.stdout: 1 cleanup 611 sec 2023-07-13T14:06:25.921 INFO:tasks.workunit.client.0.smithi118.stdout: 0 cleanup 611 sec 2023-07-13T14:06:25.921 INFO:tasks.workunit.client.0.smithi118.stdout: 2023-07-13T14:06:25.921 INFO:tasks.workunit.client.0.smithi118.stdout: Operation Count AvgLat MaxLat 2023-07-13T14:06:25.922 INFO:tasks.workunit.client.0.smithi118.stdout: ---------------------------------------- 2023-07-13T14:06:25.922 INFO:tasks.workunit.client.0.smithi118.stdout: NTCreateX 2054 81.290 461.525 2023-07-13T14:06:25.922 INFO:tasks.workunit.client.0.smithi118.stdout: Close 1470 1.302 38.371 2023-07-13T14:06:25.922 INFO:tasks.workunit.client.0.smithi118.stdout: Rename 86 219.191 345.504 2023-07-13T14:06:25.922 INFO:tasks.workunit.client.0.smithi118.stdout: Unlink 424 90.374 280.198 2023-07-13T14:06:25.922 INFO:tasks.workunit.client.0.smithi118.stdout: Qpathinfo 1833 43.130 488.792 2023-07-13T14:06:25.923 INFO:tasks.workunit.client.0.smithi118.stdout: Qfileinfo 310 1.161 3.368 2023-07-13T14:06:25.923 INFO:tasks.workunit.client.0.smithi118.stdout: Qfsinfo 351 7.275 58.315 2023-07-13T14:06:25.923 INFO:tasks.workunit.client.0.smithi118.stdout: Sfileinfo 150 14.198 30.300 2023-07-13T14:06:25.923 INFO:tasks.workunit.client.0.smithi118.stdout: Find 718 384.765 671.903 2023-07-13T14:06:25.923 INFO:tasks.workunit.client.0.smithi118.stdout: WriteX 982 5.121 145.069 2023-07-13T14:06:25.923 INFO:tasks.workunit.client.0.smithi118.stdout: ReadX 3229 0.026 2.977 2023-07-13T14:06:25.923 INFO:tasks.workunit.client.0.smithi118.stdout: LockX 6 19.119 21.423 2023-07-13T14:06:25.924 INFO:tasks.workunit.client.0.smithi118.stdout: UnlockX 6 18.782 21.019 2023-07-13T14:06:25.924 INFO:tasks.workunit.client.0.smithi118.stdout: Flush 136 61.207 177.943 2023-07-13T14:06:25.924 INFO:tasks.workunit.client.0.smithi118.stdout: 2023-07-13T14:06:25.924 INFO:tasks.workunit.client.0.smithi118.stdout:Throughput 0.106749 MB/sec 1 clients 1 procs max_latency=671.912 ms 2023-07-13T14:06:25.925 INFO:tasks.workunit.client.0.smithi118.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-07-13T14:06:25.925 INFO:tasks.workunit.client.0.smithi118.stdout: 2023-07-13T14:06:25.925 INFO:tasks.workunit.client.0.smithi118.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-07-13T14:06:25.925 INFO:tasks.workunit.client.0.smithi118.stdout:8 of 10 processes prepared for launch 0 sec 2023-07-13T14:06:26.023 INFO:tasks.workunit.client.0.smithi118.stdout:10 of 10 processes prepared for launch 0 sec 2023-07-13T14:06:26.023 INFO:tasks.workunit.client.0.smithi118.stdout:releasing clients 2023-07-13T14:06:27.023 INFO:tasks.workunit.client.0.smithi118.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.940 ms 2023-07-13T14:06:28.023 INFO:tasks.workunit.client.0.smithi118.stdout: 0 4 0.00 MB/sec warmup 2 sec latency 1999.969 ms 2023-07-13T14:06:29.023 INFO:tasks.workunit.client.0.smithi118.stdout: 1 7 0.02 MB/sec warmup 3 sec latency 2999.995 ms 2023-07-13T14:06:30.023 INFO:tasks.workunit.client.0.smithi118.stdout: 2 13 0.52 MB/sec warmup 4 sec latency 728.315 ms 2023-07-13T14:06:31.023 INFO:tasks.workunit.client.0.smithi118.stdout: 5 22 1.28 MB/sec warmup 5 sec latency 1076.048 ms 2023-07-13T14:06:32.023 INFO:tasks.workunit.client.0.smithi118.stdout: 9 36 2.21 MB/sec warmup 6 sec latency 976.598 ms 2023-07-13T14:06:33.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 50 2.90 MB/sec warmup 7 sec latency 883.628 ms 2023-07-13T14:06:34.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 64 3.50 MB/sec warmup 8 sec latency 915.360 ms 2023-07-13T14:06:35.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 77 3.82 MB/sec warmup 9 sec latency 949.406 ms 2023-07-13T14:06:36.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 90 4.18 MB/sec warmup 10 sec latency 958.070 ms 2023-07-13T14:06:37.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 100 4.24 MB/sec warmup 11 sec latency 1079.208 ms 2023-07-13T14:06:38.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 111 4.32 MB/sec warmup 12 sec latency 1173.438 ms 2023-07-13T14:06:39.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 117 4.15 MB/sec warmup 13 sec latency 1321.424 ms 2023-07-13T14:06:40.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 121 3.93 MB/sec warmup 14 sec latency 1334.746 ms 2023-07-13T14:06:41.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 128 3.82 MB/sec warmup 15 sec latency 1705.354 ms 2023-07-13T14:06:42.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 131 3.65 MB/sec warmup 16 sec latency 1600.241 ms 2023-07-13T14:06:43.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 135 3.50 MB/sec warmup 17 sec latency 1945.079 ms 2023-07-13T14:06:44.023 INFO:tasks.workunit.client.0.smithi118.stdout: 10 140 3.39 MB/sec warmup 18 sec latency 1338.955 ms 2023-07-13T14:06:45.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 144 3.27 MB/sec warmup 19 sec latency 1668.491 ms 2023-07-13T14:06:46.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 148 3.16 MB/sec warmup 20 sec latency 1467.433 ms 2023-07-13T14:06:47.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 152 3.07 MB/sec warmup 21 sec latency 1791.350 ms 2023-07-13T14:06:48.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 153 2.94 MB/sec warmup 22 sec latency 2564.614 ms 2023-07-13T14:06:49.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 159 2.89 MB/sec warmup 23 sec latency 2431.947 ms 2023-07-13T14:06:50.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 162 2.80 MB/sec warmup 24 sec latency 1564.869 ms 2023-07-13T14:06:51.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 168 2.76 MB/sec warmup 25 sec latency 1654.062 ms 2023-07-13T14:06:52.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 170 2.69 MB/sec warmup 26 sec latency 1828.497 ms 2023-07-13T14:06:53.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 174 2.63 MB/sec warmup 27 sec latency 2121.040 ms 2023-07-13T14:06:54.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 180 2.61 MB/sec warmup 28 sec latency 2227.341 ms 2023-07-13T14:06:54.421 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:06:54.423 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:06:55.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 186 2.58 MB/sec warmup 29 sec latency 1686.045 ms 2023-07-13T14:06:56.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 190 2.54 MB/sec warmup 30 sec latency 1889.724 ms 2023-07-13T14:06:57.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 194 2.51 MB/sec warmup 31 sec latency 1869.708 ms 2023-07-13T14:06:58.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 196 2.43 MB/sec warmup 32 sec latency 2242.187 ms 2023-07-13T14:06:59.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 201 2.41 MB/sec warmup 33 sec latency 2325.036 ms 2023-07-13T14:07:00.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 204 2.36 MB/sec warmup 34 sec latency 1629.729 ms 2023-07-13T14:07:01.024 INFO:tasks.workunit.client.0.smithi118.stdout: 10 209 2.34 MB/sec warmup 35 sec latency 2205.290 ms 2023-07-13T14:07:02.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 211 2.29 MB/sec warmup 36 sec latency 1865.899 ms 2023-07-13T14:07:03.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 215 2.26 MB/sec warmup 37 sec latency 2359.748 ms 2023-07-13T14:07:04.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 221 2.25 MB/sec warmup 38 sec latency 2340.138 ms 2023-07-13T14:07:05.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 224 2.22 MB/sec warmup 39 sec latency 1787.908 ms 2023-07-13T14:07:06.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 230 2.22 MB/sec warmup 40 sec latency 1977.204 ms 2023-07-13T14:07:07.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 232 2.18 MB/sec warmup 41 sec latency 1853.660 ms 2023-07-13T14:07:08.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 237 2.17 MB/sec warmup 42 sec latency 2181.153 ms 2023-07-13T14:07:09.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 241 2.14 MB/sec warmup 43 sec latency 2381.228 ms 2023-07-13T14:07:10.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 246 2.13 MB/sec warmup 44 sec latency 2035.251 ms 2023-07-13T14:07:11.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 249 2.11 MB/sec warmup 45 sec latency 2036.842 ms 2023-07-13T14:07:12.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 252 2.08 MB/sec warmup 46 sec latency 2386.141 ms 2023-07-13T14:07:13.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 255 2.06 MB/sec warmup 47 sec latency 2886.934 ms 2023-07-13T14:07:14.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 260 2.05 MB/sec warmup 48 sec latency 2761.513 ms 2023-07-13T14:07:15.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 264 2.03 MB/sec warmup 49 sec latency 1943.342 ms 2023-07-13T14:07:16.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 269 2.03 MB/sec warmup 50 sec latency 2498.679 ms 2023-07-13T14:07:17.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 272 2.01 MB/sec warmup 51 sec latency 1961.556 ms 2023-07-13T14:07:18.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 275 1.99 MB/sec warmup 52 sec latency 2360.471 ms 2023-07-13T14:07:19.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 281 1.98 MB/sec warmup 53 sec latency 2784.006 ms 2023-07-13T14:07:20.025 INFO:tasks.workunit.client.0.smithi118.stdout: 10 282 1.95 MB/sec warmup 54 sec latency 2036.599 ms 2023-07-13T14:07:21.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 289 1.96 MB/sec warmup 55 sec latency 2150.311 ms 2023-07-13T14:07:22.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 290 1.93 MB/sec warmup 56 sec latency 1675.193 ms 2023-07-13T14:07:23.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 293 1.91 MB/sec warmup 57 sec latency 2384.698 ms 2023-07-13T14:07:24.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 297 1.89 MB/sec warmup 58 sec latency 2819.179 ms 2023-07-13T14:07:24.559 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:07:24.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:07:25.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 302 1.88 MB/sec warmup 59 sec latency 2427.312 ms 2023-07-13T14:07:26.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 306 1.88 MB/sec warmup 60 sec latency 1448.375 ms 2023-07-13T14:07:27.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 309 1.86 MB/sec warmup 61 sec latency 1448.747 ms 2023-07-13T14:07:28.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 314 1.86 MB/sec warmup 62 sec latency 1884.417 ms 2023-07-13T14:07:29.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 318 1.84 MB/sec warmup 63 sec latency 2281.703 ms 2023-07-13T14:07:30.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 323 1.84 MB/sec warmup 64 sec latency 2061.691 ms 2023-07-13T14:07:31.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 326 1.83 MB/sec warmup 65 sec latency 2028.916 ms 2023-07-13T14:07:32.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 330 1.81 MB/sec warmup 66 sec latency 1454.688 ms 2023-07-13T14:07:33.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 333 1.80 MB/sec warmup 67 sec latency 1745.114 ms 2023-07-13T14:07:34.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 336 1.79 MB/sec warmup 68 sec latency 2445.235 ms 2023-07-13T14:07:35.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 340 1.78 MB/sec warmup 69 sec latency 3097.289 ms 2023-07-13T14:07:36.026 INFO:tasks.workunit.client.0.smithi118.stdout: 10 345 1.78 MB/sec warmup 70 sec latency 1848.454 ms 2023-07-13T14:07:37.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 349 1.77 MB/sec warmup 71 sec latency 1768.982 ms 2023-07-13T14:07:38.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 353 1.76 MB/sec warmup 72 sec latency 1870.563 ms 2023-07-13T14:07:39.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 357 1.75 MB/sec warmup 73 sec latency 2265.930 ms 2023-07-13T14:07:40.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 361 1.75 MB/sec warmup 74 sec latency 1683.833 ms 2023-07-13T14:07:41.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 367 1.75 MB/sec warmup 75 sec latency 1627.002 ms 2023-07-13T14:07:42.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 369 1.74 MB/sec warmup 76 sec latency 1890.330 ms 2023-07-13T14:07:43.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 373 1.73 MB/sec warmup 77 sec latency 2416.403 ms 2023-07-13T14:07:44.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 377 1.72 MB/sec warmup 78 sec latency 2358.750 ms 2023-07-13T14:07:45.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 383 1.73 MB/sec warmup 79 sec latency 2277.164 ms 2023-07-13T14:07:46.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 386 1.72 MB/sec warmup 80 sec latency 1704.138 ms 2023-07-13T14:07:47.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 391 1.72 MB/sec warmup 81 sec latency 2069.139 ms 2023-07-13T14:07:48.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 393 1.71 MB/sec warmup 82 sec latency 2617.092 ms 2023-07-13T14:07:49.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 398 1.70 MB/sec warmup 83 sec latency 2404.613 ms 2023-07-13T14:07:50.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 403 1.70 MB/sec warmup 84 sec latency 1650.278 ms 2023-07-13T14:07:51.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 407 1.70 MB/sec warmup 85 sec latency 1920.697 ms 2023-07-13T14:07:52.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 413 1.70 MB/sec warmup 86 sec latency 2330.410 ms 2023-07-13T14:07:53.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 413 1.68 MB/sec warmup 87 sec latency 2111.371 ms 2023-07-13T14:07:54.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 417 1.68 MB/sec warmup 88 sec latency 2521.050 ms 2023-07-13T14:07:54.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:07:54.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:07:55.027 INFO:tasks.workunit.client.0.smithi118.stdout: 10 421 1.67 MB/sec warmup 89 sec latency 2894.906 ms 2023-07-13T14:07:56.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 425 1.67 MB/sec warmup 90 sec latency 2124.441 ms 2023-07-13T14:07:57.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 429 1.66 MB/sec warmup 91 sec latency 2370.383 ms 2023-07-13T14:07:58.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 431 1.65 MB/sec warmup 92 sec latency 2405.927 ms 2023-07-13T14:07:59.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 434 1.65 MB/sec warmup 93 sec latency 2752.161 ms 2023-07-13T14:08:00.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 441 1.65 MB/sec warmup 94 sec latency 2764.536 ms 2023-07-13T14:08:01.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 443 1.64 MB/sec warmup 95 sec latency 2373.594 ms 2023-07-13T14:08:02.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 449 1.64 MB/sec warmup 96 sec latency 2354.295 ms 2023-07-13T14:08:03.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 449 1.63 MB/sec warmup 97 sec latency 2237.047 ms 2023-07-13T14:08:04.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 453 1.63 MB/sec warmup 98 sec latency 2728.811 ms 2023-07-13T14:08:05.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 459 1.63 MB/sec warmup 99 sec latency 2807.274 ms 2023-07-13T14:08:06.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 462 1.62 MB/sec warmup 100 sec latency 2021.228 ms 2023-07-13T14:08:06.509 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:16:41.029 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:06.534 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:16:41.055 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:06.570 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:16:41.057 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:06.572 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:16:41.059 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:06.573 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:16:41.060 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:06.575 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:16:41.062 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:06.662 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:16:41.149 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:06.670 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:16:41.157 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:06.700 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:16:41.221 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:07.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 467 1.62 MB/sec warmup 101 sec latency 2609.991 ms 2023-07-13T14:08:08.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 470 1.61 MB/sec warmup 102 sec latency 2687.403 ms 2023-07-13T14:08:09.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 473 1.61 MB/sec warmup 103 sec latency 2452.285 ms 2023-07-13T14:08:10.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 479 1.61 MB/sec warmup 104 sec latency 2735.585 ms 2023-07-13T14:08:11.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 486 1.62 MB/sec warmup 105 sec latency 1599.585 ms 2023-07-13T14:08:12.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 492 1.62 MB/sec warmup 106 sec latency 2093.475 ms 2023-07-13T14:08:13.028 INFO:tasks.workunit.client.0.smithi118.stdout: 10 493 1.61 MB/sec warmup 107 sec latency 2206.387 ms 2023-07-13T14:08:14.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 495 1.60 MB/sec warmup 108 sec latency 3206.457 ms 2023-07-13T14:08:15.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 500 1.60 MB/sec warmup 109 sec latency 4206.489 ms 2023-07-13T14:08:16.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 502 1.59 MB/sec warmup 110 sec latency 5206.543 ms 2023-07-13T14:08:17.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 506 1.59 MB/sec warmup 111 sec latency 6206.569 ms 2023-07-13T14:08:18.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 509 1.58 MB/sec warmup 112 sec latency 6345.921 ms 2023-07-13T14:08:19.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 511 1.57 MB/sec warmup 113 sec latency 2671.445 ms 2023-07-13T14:08:20.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 517 1.58 MB/sec warmup 114 sec latency 2518.043 ms 2023-07-13T14:08:21.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 522 1.57 MB/sec warmup 115 sec latency 1967.878 ms 2023-07-13T14:08:22.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 532 1.59 MB/sec warmup 116 sec latency 2967.934 ms 2023-07-13T14:08:23.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 534 1.59 MB/sec warmup 117 sec latency 3967.963 ms 2023-07-13T14:08:24.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 539 1.59 MB/sec warmup 118 sec latency 4967.993 ms 2023-07-13T14:08:24.745 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:08:24.747 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:08:25.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 554 1.62 MB/sec warmup 119 sec latency 5298.763 ms 2023-07-13T14:08:27.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 570 1.70 MB/sec execute 1 sec latency 2545.791 ms 2023-07-13T14:08:28.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 578 2.83 MB/sec execute 2 sec latency 3545.816 ms 2023-07-13T14:08:29.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 589 2.86 MB/sec execute 3 sec latency 4545.843 ms 2023-07-13T14:08:30.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 605 3.10 MB/sec execute 4 sec latency 4978.137 ms 2023-07-13T14:08:31.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 610 2.86 MB/sec execute 5 sec latency 4589.333 ms 2023-07-13T14:08:32.029 INFO:tasks.workunit.client.0.smithi118.stdout: 10 611 2.38 MB/sec execute 6 sec latency 2462.028 ms 2023-07-13T14:08:33.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 611 2.04 MB/sec execute 7 sec latency 3462.068 ms 2023-07-13T14:08:34.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 613 1.79 MB/sec execute 8 sec latency 3747.917 ms 2023-07-13T14:08:35.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 618 1.60 MB/sec execute 9 sec latency 3637.964 ms 2023-07-13T14:08:36.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 618 1.44 MB/sec execute 10 sec latency 3496.984 ms 2023-07-13T14:08:37.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 622 1.32 MB/sec execute 11 sec latency 3104.933 ms 2023-07-13T14:08:38.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 628 1.22 MB/sec execute 12 sec latency 3723.681 ms 2023-07-13T14:08:39.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 635 1.14 MB/sec execute 13 sec latency 3499.584 ms 2023-07-13T14:08:40.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 636 1.06 MB/sec execute 14 sec latency 3511.903 ms 2023-07-13T14:08:41.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 639 1.00 MB/sec execute 15 sec latency 3556.591 ms 2023-07-13T14:08:42.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 645 0.95 MB/sec execute 16 sec latency 3271.700 ms 2023-07-13T14:08:43.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 646 0.89 MB/sec execute 17 sec latency 3811.376 ms 2023-07-13T14:08:44.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 648 0.85 MB/sec execute 18 sec latency 3505.790 ms 2023-07-13T14:08:45.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 650 0.80 MB/sec execute 19 sec latency 3630.795 ms 2023-07-13T14:08:46.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 652 0.76 MB/sec execute 20 sec latency 3652.293 ms 2023-07-13T14:08:47.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 653 0.73 MB/sec execute 21 sec latency 3123.334 ms 2023-07-13T14:08:48.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 654 0.70 MB/sec execute 22 sec latency 3492.379 ms 2023-07-13T14:08:49.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 656 0.67 MB/sec execute 23 sec latency 3952.643 ms 2023-07-13T14:08:50.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 658 0.64 MB/sec execute 24 sec latency 4047.391 ms 2023-07-13T14:08:51.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 660 0.62 MB/sec execute 25 sec latency 4116.276 ms 2023-07-13T14:08:51.634 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:17:26.154 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:51.658 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:17:26.144 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:51.672 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:17:26.192 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:51.672 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:17:26.158 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:51.681 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:17:26.167 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:51.685 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:17:26.171 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:51.713 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:17:26.199 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:51.720 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:17:26.241 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:51.723 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:17:26.209 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:08:52.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 663 0.60 MB/sec execute 26 sec latency 3793.032 ms 2023-07-13T14:08:53.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 667 0.59 MB/sec execute 27 sec latency 3530.567 ms 2023-07-13T14:08:54.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 673 0.57 MB/sec execute 28 sec latency 3707.427 ms 2023-07-13T14:08:55.026 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:08:55.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:08:55.030 INFO:tasks.workunit.client.0.smithi118.stdout: 10 677 0.56 MB/sec execute 29 sec latency 4197.762 ms 2023-07-13T14:08:56.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 680 0.54 MB/sec execute 30 sec latency 3665.573 ms 2023-07-13T14:08:57.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 684 0.53 MB/sec execute 31 sec latency 3986.423 ms 2023-07-13T14:08:58.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 687 0.51 MB/sec execute 32 sec latency 4015.505 ms 2023-07-13T14:08:59.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 690 0.50 MB/sec execute 33 sec latency 3801.481 ms 2023-07-13T14:09:00.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 690 0.48 MB/sec execute 34 sec latency 3666.481 ms 2023-07-13T14:09:01.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 692 0.47 MB/sec execute 35 sec latency 3889.933 ms 2023-07-13T14:09:02.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 696 0.46 MB/sec execute 36 sec latency 3356.514 ms 2023-07-13T14:09:03.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 702 0.45 MB/sec execute 37 sec latency 3651.263 ms 2023-07-13T14:09:04.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 705 0.44 MB/sec execute 38 sec latency 3683.228 ms 2023-07-13T14:09:05.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 710 0.43 MB/sec execute 39 sec latency 4035.529 ms 2023-07-13T14:09:06.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 712 0.42 MB/sec execute 40 sec latency 4599.856 ms 2023-07-13T14:09:07.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 715 0.41 MB/sec execute 41 sec latency 4914.636 ms 2023-07-13T14:09:08.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 718 0.40 MB/sec execute 42 sec latency 5309.623 ms 2023-07-13T14:09:09.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 723 0.40 MB/sec execute 43 sec latency 5408.414 ms 2023-07-13T14:09:10.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 727 0.39 MB/sec execute 44 sec latency 4759.527 ms 2023-07-13T14:09:11.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 729 0.38 MB/sec execute 45 sec latency 5759.555 ms 2023-07-13T14:09:12.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 734 0.38 MB/sec execute 46 sec latency 6227.121 ms 2023-07-13T14:09:13.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 736 0.37 MB/sec execute 47 sec latency 1529.729 ms 2023-07-13T14:09:14.031 INFO:tasks.workunit.client.0.smithi118.stdout: 10 743 0.37 MB/sec execute 48 sec latency 2529.761 ms 2023-07-13T14:09:15.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 747 0.36 MB/sec execute 49 sec latency 3529.798 ms 2023-07-13T14:09:16.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 749 0.36 MB/sec execute 50 sec latency 4529.851 ms 2023-07-13T14:09:17.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 753 0.35 MB/sec execute 51 sec latency 4732.668 ms 2023-07-13T14:09:18.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 753 0.34 MB/sec execute 52 sec latency 3763.898 ms 2023-07-13T14:09:19.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 755 0.34 MB/sec execute 53 sec latency 4302.260 ms 2023-07-13T14:09:20.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 755 0.33 MB/sec execute 54 sec latency 3824.099 ms 2023-07-13T14:09:21.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 759 0.33 MB/sec execute 55 sec latency 3789.268 ms 2023-07-13T14:09:22.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 761 0.32 MB/sec execute 56 sec latency 3264.758 ms 2023-07-13T14:09:23.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 771 0.32 MB/sec execute 57 sec latency 3481.645 ms 2023-07-13T14:09:24.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 774 0.31 MB/sec execute 58 sec latency 3907.407 ms 2023-07-13T14:09:25.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 780 0.31 MB/sec execute 59 sec latency 4389.519 ms 2023-07-13T14:09:25.122 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:09:25.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:09:26.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 784 0.31 MB/sec execute 60 sec latency 2402.852 ms 2023-07-13T14:09:27.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 786 0.30 MB/sec execute 61 sec latency 3402.879 ms 2023-07-13T14:09:28.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 787 0.30 MB/sec execute 62 sec latency 4402.910 ms 2023-07-13T14:09:29.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 790 0.30 MB/sec execute 63 sec latency 5402.942 ms 2023-07-13T14:09:30.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 795 0.30 MB/sec execute 64 sec latency 5990.076 ms 2023-07-13T14:09:31.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 800 0.29 MB/sec execute 65 sec latency 4700.943 ms 2023-07-13T14:09:32.032 INFO:tasks.workunit.client.0.smithi118.stdout: 10 807 0.29 MB/sec execute 66 sec latency 4896.178 ms 2023-07-13T14:09:33.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 810 0.29 MB/sec execute 67 sec latency 3413.041 ms 2023-07-13T14:09:34.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 811 0.28 MB/sec execute 68 sec latency 4413.069 ms 2023-07-13T14:09:35.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 813 0.28 MB/sec execute 69 sec latency 4667.484 ms 2023-07-13T14:09:36.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 816 0.28 MB/sec execute 70 sec latency 4515.322 ms 2023-07-13T14:09:37.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 817 0.27 MB/sec execute 71 sec latency 4217.103 ms 2023-07-13T14:09:38.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 817 0.27 MB/sec execute 72 sec latency 3212.131 ms 2023-07-13T14:09:39.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 818 0.27 MB/sec execute 73 sec latency 3272.574 ms 2023-07-13T14:09:40.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 819 0.26 MB/sec execute 74 sec latency 3257.036 ms 2023-07-13T14:09:41.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 821 0.26 MB/sec execute 75 sec latency 3327.971 ms 2023-07-13T14:09:42.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 824 0.26 MB/sec execute 76 sec latency 3032.814 ms 2023-07-13T14:09:43.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 825 0.25 MB/sec execute 77 sec latency 2979.475 ms 2023-07-13T14:09:44.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 827 0.25 MB/sec execute 78 sec latency 3091.690 ms 2023-07-13T14:09:45.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 830 0.25 MB/sec execute 79 sec latency 3094.607 ms 2023-07-13T14:09:46.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 833 0.25 MB/sec execute 80 sec latency 2760.561 ms 2023-07-13T14:09:47.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 836 0.24 MB/sec execute 81 sec latency 2871.127 ms 2023-07-13T14:09:48.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 853 0.25 MB/sec execute 82 sec latency 3067.480 ms 2023-07-13T14:09:49.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 856 0.24 MB/sec execute 83 sec latency 3210.552 ms 2023-07-13T14:09:50.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 856 0.24 MB/sec execute 84 sec latency 3321.902 ms 2023-07-13T14:09:51.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 856 0.24 MB/sec execute 85 sec latency 2996.878 ms 2023-07-13T14:09:52.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 859 0.24 MB/sec execute 86 sec latency 3134.735 ms 2023-07-13T14:09:53.033 INFO:tasks.workunit.client.0.smithi118.stdout: 10 860 0.23 MB/sec execute 87 sec latency 2505.075 ms 2023-07-13T14:09:54.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 862 0.23 MB/sec execute 88 sec latency 2876.382 ms 2023-07-13T14:09:55.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 864 0.23 MB/sec execute 89 sec latency 3659.333 ms 2023-07-13T14:09:55.269 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:09:55.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:09:56.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 867 0.23 MB/sec execute 90 sec latency 2923.689 ms 2023-07-13T14:09:57.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 869 0.23 MB/sec execute 91 sec latency 3413.382 ms 2023-07-13T14:09:58.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 869 0.22 MB/sec execute 92 sec latency 3767.189 ms 2023-07-13T14:09:59.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 871 0.22 MB/sec execute 93 sec latency 3879.567 ms 2023-07-13T14:10:00.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 874 0.22 MB/sec execute 94 sec latency 4472.914 ms 2023-07-13T14:10:01.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 876 0.22 MB/sec execute 95 sec latency 4237.392 ms 2023-07-13T14:10:02.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 877 0.22 MB/sec execute 96 sec latency 3194.362 ms 2023-07-13T14:10:03.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 883 0.22 MB/sec execute 97 sec latency 3390.688 ms 2023-07-13T14:10:04.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 888 0.22 MB/sec execute 98 sec latency 3710.702 ms 2023-07-13T14:10:05.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 892 0.22 MB/sec execute 99 sec latency 3066.222 ms 2023-07-13T14:10:06.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 894 0.21 MB/sec execute 100 sec latency 3625.395 ms 2023-07-13T14:10:07.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 895 0.21 MB/sec execute 101 sec latency 2954.958 ms 2023-07-13T14:10:08.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 898 0.21 MB/sec execute 102 sec latency 3897.749 ms 2023-07-13T14:10:09.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 905 0.21 MB/sec execute 103 sec latency 4297.096 ms 2023-07-13T14:10:10.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 909 0.21 MB/sec execute 104 sec latency 4645.602 ms 2023-07-13T14:10:11.034 INFO:tasks.workunit.client.0.smithi118.stdout: 10 912 0.21 MB/sec execute 105 sec latency 2723.638 ms 2023-07-13T14:10:12.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 912 0.20 MB/sec execute 106 sec latency 2433.680 ms 2023-07-13T14:10:13.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 913 0.20 MB/sec execute 107 sec latency 3433.728 ms 2023-07-13T14:10:14.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 916 0.20 MB/sec execute 108 sec latency 4433.759 ms 2023-07-13T14:10:15.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 922 0.20 MB/sec execute 109 sec latency 4913.506 ms 2023-07-13T14:10:16.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 925 0.20 MB/sec execute 110 sec latency 4136.496 ms 2023-07-13T14:10:17.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 927 0.20 MB/sec execute 111 sec latency 2713.318 ms 2023-07-13T14:10:18.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 928 0.20 MB/sec execute 112 sec latency 3713.370 ms 2023-07-13T14:10:19.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 928 0.20 MB/sec execute 113 sec latency 4325.606 ms 2023-07-13T14:10:20.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 929 0.19 MB/sec execute 114 sec latency 4170.818 ms 2023-07-13T14:10:21.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 930 0.19 MB/sec execute 115 sec latency 3514.282 ms 2023-07-13T14:10:22.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 930 0.19 MB/sec execute 116 sec latency 2567.548 ms 2023-07-13T14:10:23.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 932 0.19 MB/sec execute 117 sec latency 2658.779 ms 2023-07-13T14:10:24.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 934 0.19 MB/sec execute 118 sec latency 2686.341 ms 2023-07-13T14:10:25.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 935 0.19 MB/sec execute 119 sec latency 2891.076 ms 2023-07-13T14:10:25.358 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:10:25.360 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:10:26.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 937 0.19 MB/sec execute 120 sec latency 3100.199 ms 2023-07-13T14:10:27.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 939 0.18 MB/sec execute 121 sec latency 2152.195 ms 2023-07-13T14:10:28.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 939 0.18 MB/sec execute 122 sec latency 3152.241 ms 2023-07-13T14:10:29.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 942 0.18 MB/sec execute 123 sec latency 3202.245 ms 2023-07-13T14:10:30.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 945 0.18 MB/sec execute 124 sec latency 3147.775 ms 2023-07-13T14:10:31.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 947 0.18 MB/sec execute 125 sec latency 3081.132 ms 2023-07-13T14:10:32.035 INFO:tasks.workunit.client.0.smithi118.stdout: 10 952 0.19 MB/sec execute 126 sec latency 3277.015 ms 2023-07-13T14:10:33.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 954 0.19 MB/sec execute 127 sec latency 3547.869 ms 2023-07-13T14:10:34.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 959 0.18 MB/sec execute 128 sec latency 3596.107 ms 2023-07-13T14:10:35.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 961 0.18 MB/sec execute 129 sec latency 3218.926 ms 2023-07-13T14:10:36.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 962 0.18 MB/sec execute 130 sec latency 3247.807 ms 2023-07-13T14:10:37.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 969 0.18 MB/sec execute 131 sec latency 3692.116 ms 2023-07-13T14:10:38.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 977 0.18 MB/sec execute 132 sec latency 3680.808 ms 2023-07-13T14:10:39.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 981 0.18 MB/sec execute 133 sec latency 2305.694 ms 2023-07-13T14:10:40.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 985 0.18 MB/sec execute 134 sec latency 3305.720 ms 2023-07-13T14:10:41.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 986 0.18 MB/sec execute 135 sec latency 4305.748 ms 2023-07-13T14:10:42.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 987 0.18 MB/sec execute 136 sec latency 4782.218 ms 2023-07-13T14:10:43.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 991 0.18 MB/sec execute 137 sec latency 4797.033 ms 2023-07-13T14:10:44.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 996 0.18 MB/sec execute 138 sec latency 5797.061 ms 2023-07-13T14:10:45.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1002 0.18 MB/sec execute 139 sec latency 5872.190 ms 2023-07-13T14:10:46.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1004 0.19 MB/sec execute 140 sec latency 5478.347 ms 2023-07-13T14:10:47.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1009 0.19 MB/sec execute 141 sec latency 3629.704 ms 2023-07-13T14:10:48.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1009 0.19 MB/sec execute 142 sec latency 4629.765 ms 2023-07-13T14:10:49.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1011 0.19 MB/sec execute 143 sec latency 4791.734 ms 2023-07-13T14:10:50.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1017 0.20 MB/sec execute 144 sec latency 3842.113 ms 2023-07-13T14:10:51.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1031 0.23 MB/sec execute 145 sec latency 2847.549 ms 2023-07-13T14:10:52.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1032 0.23 MB/sec execute 146 sec latency 1611.387 ms 2023-07-13T14:10:53.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1032 0.23 MB/sec execute 147 sec latency 2611.419 ms 2023-07-13T14:10:54.036 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1032 0.23 MB/sec execute 148 sec latency 3330.387 ms 2023-07-13T14:10:55.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1035 0.22 MB/sec execute 149 sec latency 3544.139 ms 2023-07-13T14:10:55.507 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:10:55.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:10:56.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1037 0.22 MB/sec execute 150 sec latency 1580.284 ms 2023-07-13T14:10:57.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1039 0.22 MB/sec execute 151 sec latency 2580.315 ms 2023-07-13T14:10:58.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1039 0.22 MB/sec execute 152 sec latency 3580.372 ms 2023-07-13T14:10:59.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1041 0.22 MB/sec execute 153 sec latency 3835.976 ms 2023-07-13T14:11:00.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1046 0.22 MB/sec execute 154 sec latency 4073.249 ms 2023-07-13T14:11:01.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1049 0.22 MB/sec execute 155 sec latency 3799.557 ms 2023-07-13T14:11:02.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1050 0.21 MB/sec execute 156 sec latency 3068.177 ms 2023-07-13T14:11:03.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1051 0.21 MB/sec execute 157 sec latency 3361.105 ms 2023-07-13T14:11:04.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1052 0.21 MB/sec execute 158 sec latency 3764.934 ms 2023-07-13T14:11:05.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1053 0.21 MB/sec execute 159 sec latency 3767.733 ms 2023-07-13T14:11:06.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1055 0.21 MB/sec execute 160 sec latency 3480.997 ms 2023-07-13T14:11:07.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1057 0.21 MB/sec execute 161 sec latency 3628.084 ms 2023-07-13T14:11:08.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1058 0.21 MB/sec execute 162 sec latency 3502.304 ms 2023-07-13T14:11:09.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1059 0.21 MB/sec execute 163 sec latency 3881.187 ms 2023-07-13T14:11:10.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1060 0.20 MB/sec execute 164 sec latency 3782.085 ms 2023-07-13T14:11:11.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1063 0.20 MB/sec execute 165 sec latency 3673.812 ms 2023-07-13T14:11:12.037 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1068 0.20 MB/sec execute 166 sec latency 3550.701 ms 2023-07-13T14:11:13.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1070 0.20 MB/sec execute 167 sec latency 4037.279 ms 2023-07-13T14:11:14.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1073 0.20 MB/sec execute 168 sec latency 3458.989 ms 2023-07-13T14:11:15.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1075 0.20 MB/sec execute 169 sec latency 4459.039 ms 2023-07-13T14:11:16.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1076 0.20 MB/sec execute 170 sec latency 5185.288 ms 2023-07-13T14:11:17.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1081 0.20 MB/sec execute 171 sec latency 4981.024 ms 2023-07-13T14:11:18.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1084 0.20 MB/sec execute 172 sec latency 5310.498 ms 2023-07-13T14:11:19.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1090 0.20 MB/sec execute 173 sec latency 4638.092 ms 2023-07-13T14:11:20.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1094 0.19 MB/sec execute 174 sec latency 2185.450 ms 2023-07-13T14:11:21.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1096 0.19 MB/sec execute 175 sec latency 3185.500 ms 2023-07-13T14:11:22.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1098 0.19 MB/sec execute 176 sec latency 4185.551 ms 2023-07-13T14:11:23.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1099 0.19 MB/sec execute 177 sec latency 4828.359 ms 2023-07-13T14:11:24.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1102 0.19 MB/sec execute 178 sec latency 4897.009 ms 2023-07-13T14:11:25.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1106 0.19 MB/sec execute 179 sec latency 3978.519 ms 2023-07-13T14:11:25.586 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:11:25.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:11:26.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1109 0.19 MB/sec execute 180 sec latency 4166.477 ms 2023-07-13T14:11:27.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1111 0.19 MB/sec execute 181 sec latency 2837.087 ms 2023-07-13T14:11:28.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1113 0.19 MB/sec execute 182 sec latency 3837.137 ms 2023-07-13T14:11:29.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1117 0.19 MB/sec execute 183 sec latency 3966.426 ms 2023-07-13T14:11:30.038 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1120 0.19 MB/sec execute 184 sec latency 3830.023 ms 2023-07-13T14:11:31.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1123 0.19 MB/sec execute 185 sec latency 3164.931 ms 2023-07-13T14:11:32.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1127 0.18 MB/sec execute 186 sec latency 3484.526 ms 2023-07-13T14:11:33.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1131 0.18 MB/sec execute 187 sec latency 3211.861 ms 2023-07-13T14:11:34.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1132 0.18 MB/sec execute 188 sec latency 3641.774 ms 2023-07-13T14:11:35.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1137 0.18 MB/sec execute 189 sec latency 3993.001 ms 2023-07-13T14:11:36.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1139 0.18 MB/sec execute 190 sec latency 3934.395 ms 2023-07-13T14:11:37.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1143 0.18 MB/sec execute 191 sec latency 3914.100 ms 2023-07-13T14:11:38.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1147 0.18 MB/sec execute 192 sec latency 2763.250 ms 2023-07-13T14:11:39.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1150 0.18 MB/sec execute 193 sec latency 3723.932 ms 2023-07-13T14:11:40.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1154 0.18 MB/sec execute 194 sec latency 3766.462 ms 2023-07-13T14:11:41.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1157 0.18 MB/sec execute 195 sec latency 3916.853 ms 2023-07-13T14:11:42.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1160 0.18 MB/sec execute 196 sec latency 4261.733 ms 2023-07-13T14:11:43.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1162 0.18 MB/sec execute 197 sec latency 3751.828 ms 2023-07-13T14:11:44.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1163 0.17 MB/sec execute 198 sec latency 3007.774 ms 2023-07-13T14:11:45.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1165 0.17 MB/sec execute 199 sec latency 4007.802 ms 2023-07-13T14:11:46.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1166 0.17 MB/sec execute 200 sec latency 4139.756 ms 2023-07-13T14:11:47.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1167 0.17 MB/sec execute 201 sec latency 3689.444 ms 2023-07-13T14:11:48.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1169 0.17 MB/sec execute 202 sec latency 3868.648 ms 2023-07-13T14:11:49.039 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1171 0.17 MB/sec execute 203 sec latency 3934.017 ms 2023-07-13T14:11:50.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1173 0.17 MB/sec execute 204 sec latency 4006.986 ms 2023-07-13T14:11:51.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1175 0.17 MB/sec execute 205 sec latency 3738.632 ms 2023-07-13T14:11:52.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1177 0.17 MB/sec execute 206 sec latency 3666.336 ms 2023-07-13T14:11:53.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1178 0.17 MB/sec execute 207 sec latency 3420.734 ms 2023-07-13T14:11:54.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1179 0.17 MB/sec execute 208 sec latency 2533.632 ms 2023-07-13T14:11:55.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1180 0.17 MB/sec execute 209 sec latency 3533.662 ms 2023-07-13T14:11:55.700 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:11:55.703 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:11:56.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1183 0.17 MB/sec execute 210 sec latency 3898.776 ms 2023-07-13T14:11:57.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1185 0.16 MB/sec execute 211 sec latency 4185.938 ms 2023-07-13T14:11:58.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1188 0.16 MB/sec execute 212 sec latency 4197.067 ms 2023-07-13T14:11:59.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1190 0.16 MB/sec execute 213 sec latency 3263.982 ms 2023-07-13T14:12:00.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1193 0.16 MB/sec execute 214 sec latency 3591.770 ms 2023-07-13T14:12:01.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1197 0.16 MB/sec execute 215 sec latency 4064.205 ms 2023-07-13T14:12:02.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1200 0.16 MB/sec execute 216 sec latency 4028.629 ms 2023-07-13T14:12:03.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1204 0.16 MB/sec execute 217 sec latency 3754.613 ms 2023-07-13T14:12:04.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1205 0.16 MB/sec execute 218 sec latency 4754.643 ms 2023-07-13T14:12:05.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1206 0.16 MB/sec execute 219 sec latency 5416.080 ms 2023-07-13T14:12:06.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1209 0.16 MB/sec execute 220 sec latency 4785.907 ms 2023-07-13T14:12:07.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1213 0.16 MB/sec execute 221 sec latency 4889.664 ms 2023-07-13T14:12:08.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1219 0.16 MB/sec execute 222 sec latency 4587.707 ms 2023-07-13T14:12:09.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1221 0.16 MB/sec execute 223 sec latency 1719.955 ms 2023-07-13T14:12:10.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1226 0.16 MB/sec execute 224 sec latency 2719.983 ms 2023-07-13T14:12:11.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1230 0.16 MB/sec execute 225 sec latency 3720.009 ms 2023-07-13T14:12:12.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1233 0.16 MB/sec execute 226 sec latency 4273.683 ms 2023-07-13T14:12:13.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1236 0.16 MB/sec execute 227 sec latency 4917.146 ms 2023-07-13T14:12:14.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1237 0.15 MB/sec execute 228 sec latency 4284.203 ms 2023-07-13T14:12:15.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1241 0.15 MB/sec execute 229 sec latency 4384.227 ms 2023-07-13T14:12:16.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1242 0.15 MB/sec execute 230 sec latency 3356.658 ms 2023-07-13T14:12:17.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1246 0.15 MB/sec execute 231 sec latency 4356.687 ms 2023-07-13T14:12:18.040 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1249 0.15 MB/sec execute 232 sec latency 4617.001 ms 2023-07-13T14:12:19.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1251 0.15 MB/sec execute 233 sec latency 4269.591 ms 2023-07-13T14:12:20.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1258 0.15 MB/sec execute 234 sec latency 2649.013 ms 2023-07-13T14:12:21.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1262 0.15 MB/sec execute 235 sec latency 3649.038 ms 2023-07-13T14:12:22.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1265 0.15 MB/sec execute 236 sec latency 4589.619 ms 2023-07-13T14:12:23.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1267 0.15 MB/sec execute 237 sec latency 4134.208 ms 2023-07-13T14:12:24.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1276 0.16 MB/sec execute 238 sec latency 5134.251 ms 2023-07-13T14:12:25.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1276 0.16 MB/sec execute 239 sec latency 5275.570 ms 2023-07-13T14:12:25.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:12:25.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:12:26.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1278 0.16 MB/sec execute 240 sec latency 5216.417 ms 2023-07-13T14:12:27.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1280 0.16 MB/sec execute 241 sec latency 5225.335 ms 2023-07-13T14:12:28.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1283 0.16 MB/sec execute 242 sec latency 4106.937 ms 2023-07-13T14:12:29.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1295 0.17 MB/sec execute 243 sec latency 3015.737 ms 2023-07-13T14:12:30.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1297 0.17 MB/sec execute 244 sec latency 4015.788 ms 2023-07-13T14:12:31.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1298 0.17 MB/sec execute 245 sec latency 4964.238 ms 2023-07-13T14:12:32.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1299 0.17 MB/sec execute 246 sec latency 4831.844 ms 2023-07-13T14:12:33.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1299 0.17 MB/sec execute 247 sec latency 4279.206 ms 2023-07-13T14:12:34.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1300 0.17 MB/sec execute 248 sec latency 3332.924 ms 2023-07-13T14:12:35.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1301 0.17 MB/sec execute 249 sec latency 3612.702 ms 2023-07-13T14:12:36.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1301 0.17 MB/sec execute 250 sec latency 3118.495 ms 2023-07-13T14:12:37.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1302 0.17 MB/sec execute 251 sec latency 3504.459 ms 2023-07-13T14:12:38.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1307 0.17 MB/sec execute 252 sec latency 3061.950 ms 2023-07-13T14:12:39.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1339 0.21 MB/sec execute 253 sec latency 3119.719 ms 2023-07-13T14:12:40.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1340 0.21 MB/sec execute 254 sec latency 3420.072 ms 2023-07-13T14:12:41.041 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1341 0.21 MB/sec execute 255 sec latency 3174.165 ms 2023-07-13T14:12:42.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1351 0.22 MB/sec execute 256 sec latency 3067.487 ms 2023-07-13T14:12:43.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1357 0.22 MB/sec execute 257 sec latency 2784.716 ms 2023-07-13T14:12:44.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1379 0.25 MB/sec execute 258 sec latency 3047.006 ms 2023-07-13T14:12:45.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1380 0.25 MB/sec execute 259 sec latency 3377.650 ms 2023-07-13T14:12:46.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1382 0.25 MB/sec execute 260 sec latency 3367.144 ms 2023-07-13T14:12:47.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1384 0.25 MB/sec execute 261 sec latency 3114.444 ms 2023-07-13T14:12:48.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1384 0.25 MB/sec execute 262 sec latency 2956.350 ms 2023-07-13T14:12:49.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1384 0.25 MB/sec execute 263 sec latency 3342.708 ms 2023-07-13T14:12:50.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1387 0.24 MB/sec execute 264 sec latency 3314.815 ms 2023-07-13T14:12:51.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1390 0.24 MB/sec execute 265 sec latency 1610.504 ms 2023-07-13T14:12:52.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1390 0.24 MB/sec execute 266 sec latency 2610.557 ms 2023-07-13T14:12:53.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1393 0.24 MB/sec execute 267 sec latency 3323.216 ms 2023-07-13T14:12:54.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1396 0.24 MB/sec execute 268 sec latency 3419.433 ms 2023-07-13T14:12:55.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1398 0.24 MB/sec execute 269 sec latency 3598.550 ms 2023-07-13T14:12:55.961 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:12:55.963 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:12:56.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1400 0.24 MB/sec execute 270 sec latency 2330.139 ms 2023-07-13T14:12:57.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1401 0.24 MB/sec execute 271 sec latency 2611.073 ms 2023-07-13T14:12:58.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1403 0.24 MB/sec execute 272 sec latency 3293.805 ms 2023-07-13T14:12:59.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1405 0.24 MB/sec execute 273 sec latency 3976.565 ms 2023-07-13T14:13:00.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1409 0.24 MB/sec execute 274 sec latency 4041.011 ms 2023-07-13T14:13:01.042 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1412 0.24 MB/sec execute 275 sec latency 2280.872 ms 2023-07-13T14:13:02.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1417 0.23 MB/sec execute 276 sec latency 3280.897 ms 2023-07-13T14:13:03.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1418 0.23 MB/sec execute 277 sec latency 3283.135 ms 2023-07-13T14:13:04.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1420 0.23 MB/sec execute 278 sec latency 3362.457 ms 2023-07-13T14:13:05.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1422 0.23 MB/sec execute 279 sec latency 3580.977 ms 2023-07-13T14:13:06.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1427 0.23 MB/sec execute 280 sec latency 3568.952 ms 2023-07-13T14:13:07.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1432 0.23 MB/sec execute 281 sec latency 3366.631 ms 2023-07-13T14:13:08.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1435 0.23 MB/sec execute 282 sec latency 2249.222 ms 2023-07-13T14:13:09.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1437 0.23 MB/sec execute 283 sec latency 3249.250 ms 2023-07-13T14:13:10.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1442 0.23 MB/sec execute 284 sec latency 4165.134 ms 2023-07-13T14:13:11.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1445 0.23 MB/sec execute 285 sec latency 4470.195 ms 2023-07-13T14:13:12.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1446 0.23 MB/sec execute 286 sec latency 4747.479 ms 2023-07-13T14:13:13.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1447 0.23 MB/sec execute 287 sec latency 4107.576 ms 2023-07-13T14:13:14.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1450 0.22 MB/sec execute 288 sec latency 4678.409 ms 2023-07-13T14:13:15.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1452 0.22 MB/sec execute 289 sec latency 4288.342 ms 2023-07-13T14:13:16.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1455 0.22 MB/sec execute 290 sec latency 4719.942 ms 2023-07-13T14:13:17.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1458 0.22 MB/sec execute 291 sec latency 5546.996 ms 2023-07-13T14:13:18.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1460 0.22 MB/sec execute 292 sec latency 5676.408 ms 2023-07-13T14:13:19.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1462 0.22 MB/sec execute 293 sec latency 3046.081 ms 2023-07-13T14:13:20.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1464 0.22 MB/sec execute 294 sec latency 4046.128 ms 2023-07-13T14:13:21.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1466 0.22 MB/sec execute 295 sec latency 4135.971 ms 2023-07-13T14:13:22.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1467 0.22 MB/sec execute 296 sec latency 3864.601 ms 2023-07-13T14:13:23.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1470 0.22 MB/sec execute 297 sec latency 3698.214 ms 2023-07-13T14:13:24.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1475 0.22 MB/sec execute 298 sec latency 3600.908 ms 2023-07-13T14:13:25.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1478 0.22 MB/sec execute 299 sec latency 3404.667 ms 2023-07-13T14:13:26.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1482 0.22 MB/sec execute 300 sec latency 3237.774 ms 2023-07-13T14:13:26.057 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:13:26.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:13:27.043 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1485 0.22 MB/sec execute 301 sec latency 3328.520 ms 2023-07-13T14:13:28.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1487 0.22 MB/sec execute 302 sec latency 2901.312 ms 2023-07-13T14:13:29.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1489 0.21 MB/sec execute 303 sec latency 3172.619 ms 2023-07-13T14:13:30.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1493 0.21 MB/sec execute 304 sec latency 3230.823 ms 2023-07-13T14:13:31.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1495 0.21 MB/sec execute 305 sec latency 3213.543 ms 2023-07-13T14:13:32.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1496 0.21 MB/sec execute 306 sec latency 2935.381 ms 2023-07-13T14:13:33.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1498 0.21 MB/sec execute 307 sec latency 3383.542 ms 2023-07-13T14:13:34.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1498 0.21 MB/sec execute 308 sec latency 3604.202 ms 2023-07-13T14:13:35.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1500 0.21 MB/sec execute 309 sec latency 4221.538 ms 2023-07-13T14:13:36.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1504 0.21 MB/sec execute 310 sec latency 3504.261 ms 2023-07-13T14:13:37.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1509 0.21 MB/sec execute 311 sec latency 3552.455 ms 2023-07-13T14:13:38.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1512 0.21 MB/sec execute 312 sec latency 2513.951 ms 2023-07-13T14:13:39.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1514 0.21 MB/sec execute 313 sec latency 3513.994 ms 2023-07-13T14:13:40.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1518 0.21 MB/sec execute 314 sec latency 4264.657 ms 2023-07-13T14:13:41.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1520 0.21 MB/sec execute 315 sec latency 4192.895 ms 2023-07-13T14:13:42.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1523 0.21 MB/sec execute 316 sec latency 4198.024 ms 2023-07-13T14:13:43.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1525 0.21 MB/sec execute 317 sec latency 4095.178 ms 2023-07-13T14:13:44.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1527 0.21 MB/sec execute 318 sec latency 4348.725 ms 2023-07-13T14:13:45.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1530 0.21 MB/sec execute 319 sec latency 4787.235 ms 2023-07-13T14:13:46.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1533 0.20 MB/sec execute 320 sec latency 4173.694 ms 2023-07-13T14:13:47.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1536 0.20 MB/sec execute 321 sec latency 4749.059 ms 2023-07-13T14:13:48.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1538 0.20 MB/sec execute 322 sec latency 4972.292 ms 2023-07-13T14:13:49.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1540 0.20 MB/sec execute 323 sec latency 3995.491 ms 2023-07-13T14:13:50.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1544 0.20 MB/sec execute 324 sec latency 4165.567 ms 2023-07-13T14:13:51.044 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1546 0.20 MB/sec execute 325 sec latency 3051.246 ms 2023-07-13T14:13:52.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1548 0.20 MB/sec execute 326 sec latency 3646.608 ms 2023-07-13T14:13:53.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1553 0.20 MB/sec execute 327 sec latency 3880.202 ms 2023-07-13T14:13:54.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1555 0.20 MB/sec execute 328 sec latency 3726.237 ms 2023-07-13T14:13:55.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1556 0.20 MB/sec execute 329 sec latency 4541.974 ms 2023-07-13T14:13:56.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1560 0.20 MB/sec execute 330 sec latency 4583.383 ms 2023-07-13T14:13:56.188 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:13:56.190 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:13:57.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1562 0.20 MB/sec execute 331 sec latency 4670.073 ms 2023-07-13T14:13:58.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1566 0.20 MB/sec execute 332 sec latency 4994.131 ms 2023-07-13T14:13:59.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1570 0.20 MB/sec execute 333 sec latency 4786.953 ms 2023-07-13T14:14:00.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1572 0.20 MB/sec execute 334 sec latency 5305.058 ms 2023-07-13T14:14:01.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1575 0.20 MB/sec execute 335 sec latency 4077.312 ms 2023-07-13T14:14:02.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1578 0.20 MB/sec execute 336 sec latency 4134.494 ms 2023-07-13T14:14:03.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1581 0.20 MB/sec execute 337 sec latency 2987.536 ms 2023-07-13T14:14:04.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1583 0.19 MB/sec execute 338 sec latency 3538.965 ms 2023-07-13T14:14:05.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1585 0.19 MB/sec execute 339 sec latency 3788.674 ms 2023-07-13T14:14:06.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1588 0.19 MB/sec execute 340 sec latency 3813.140 ms 2023-07-13T14:14:07.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1592 0.19 MB/sec execute 341 sec latency 4036.345 ms 2023-07-13T14:14:08.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1596 0.19 MB/sec execute 342 sec latency 2976.065 ms 2023-07-13T14:14:09.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1598 0.19 MB/sec execute 343 sec latency 3799.262 ms 2023-07-13T14:14:10.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1601 0.19 MB/sec execute 344 sec latency 3331.210 ms 2023-07-13T14:14:11.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1603 0.19 MB/sec execute 345 sec latency 3378.550 ms 2023-07-13T14:14:12.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1607 0.19 MB/sec execute 346 sec latency 3431.353 ms 2023-07-13T14:14:13.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1610 0.19 MB/sec execute 347 sec latency 2829.158 ms 2023-07-13T14:14:14.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1612 0.19 MB/sec execute 348 sec latency 2916.016 ms 2023-07-13T14:14:15.045 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1614 0.19 MB/sec execute 349 sec latency 3205.593 ms 2023-07-13T14:14:16.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1616 0.19 MB/sec execute 350 sec latency 3416.260 ms 2023-07-13T14:14:17.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1617 0.19 MB/sec execute 351 sec latency 3350.955 ms 2023-07-13T14:14:18.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1619 0.19 MB/sec execute 352 sec latency 2889.381 ms 2023-07-13T14:14:19.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1621 0.19 MB/sec execute 353 sec latency 2850.164 ms 2023-07-13T14:14:20.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1623 0.19 MB/sec execute 354 sec latency 3296.613 ms 2023-07-13T14:14:21.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1625 0.19 MB/sec execute 355 sec latency 3301.143 ms 2023-07-13T14:14:22.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1629 0.19 MB/sec execute 356 sec latency 3877.402 ms 2023-07-13T14:14:23.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1634 0.19 MB/sec execute 357 sec latency 3965.380 ms 2023-07-13T14:14:24.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1640 0.19 MB/sec execute 358 sec latency 2407.020 ms 2023-07-13T14:14:25.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1644 0.18 MB/sec execute 359 sec latency 1999.338 ms 2023-07-13T14:14:26.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1644 0.18 MB/sec execute 360 sec latency 2999.365 ms 2023-07-13T14:14:26.327 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:14:26.329 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:14:27.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1646 0.18 MB/sec execute 361 sec latency 3837.346 ms 2023-07-13T14:14:28.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1648 0.18 MB/sec execute 362 sec latency 3636.790 ms 2023-07-13T14:14:29.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1652 0.18 MB/sec execute 363 sec latency 3812.464 ms 2023-07-13T14:14:30.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1653 0.18 MB/sec execute 364 sec latency 4212.387 ms 2023-07-13T14:14:31.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1655 0.18 MB/sec execute 365 sec latency 3290.220 ms 2023-07-13T14:14:32.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1656 0.18 MB/sec execute 366 sec latency 4086.629 ms 2023-07-13T14:14:33.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1658 0.18 MB/sec execute 367 sec latency 4171.464 ms 2023-07-13T14:14:34.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1662 0.18 MB/sec execute 368 sec latency 3517.070 ms 2023-07-13T14:14:35.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1667 0.18 MB/sec execute 369 sec latency 2355.726 ms 2023-07-13T14:14:36.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1669 0.18 MB/sec execute 370 sec latency 3355.751 ms 2023-07-13T14:14:37.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1677 0.18 MB/sec execute 371 sec latency 4355.779 ms 2023-07-13T14:14:38.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1680 0.18 MB/sec execute 372 sec latency 5010.919 ms 2023-07-13T14:14:39.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1685 0.18 MB/sec execute 373 sec latency 5719.401 ms 2023-07-13T14:14:40.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1686 0.18 MB/sec execute 374 sec latency 4562.194 ms 2023-07-13T14:14:41.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1688 0.18 MB/sec execute 375 sec latency 5562.228 ms 2023-07-13T14:14:42.046 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1693 0.18 MB/sec execute 376 sec latency 6110.890 ms 2023-07-13T14:14:43.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1696 0.18 MB/sec execute 377 sec latency 1074.689 ms 2023-07-13T14:14:44.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1696 0.18 MB/sec execute 378 sec latency 2007.050 ms 2023-07-13T14:14:45.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1700 0.18 MB/sec execute 379 sec latency 2996.449 ms 2023-07-13T14:14:46.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1704 0.18 MB/sec execute 380 sec latency 3996.491 ms 2023-07-13T14:14:47.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1709 0.18 MB/sec execute 381 sec latency 4996.548 ms 2023-07-13T14:14:48.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1711 0.17 MB/sec execute 382 sec latency 5996.578 ms 2023-07-13T14:14:49.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1712 0.17 MB/sec execute 383 sec latency 6709.194 ms 2023-07-13T14:14:50.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1714 0.17 MB/sec execute 384 sec latency 3883.689 ms 2023-07-13T14:14:51.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1716 0.17 MB/sec execute 385 sec latency 4883.715 ms 2023-07-13T14:14:52.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1718 0.17 MB/sec execute 386 sec latency 5701.312 ms 2023-07-13T14:14:53.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1720 0.17 MB/sec execute 387 sec latency 4838.563 ms 2023-07-13T14:14:54.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1722 0.17 MB/sec execute 388 sec latency 4669.847 ms 2023-07-13T14:14:55.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1722 0.17 MB/sec execute 389 sec latency 5669.883 ms 2023-07-13T14:14:56.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1724 0.17 MB/sec execute 390 sec latency 5711.725 ms 2023-07-13T14:14:56.464 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:14:56.466 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:14:57.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1728 0.17 MB/sec execute 391 sec latency 4801.943 ms 2023-07-13T14:14:58.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1731 0.17 MB/sec execute 392 sec latency 1499.555 ms 2023-07-13T14:14:59.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1734 0.17 MB/sec execute 393 sec latency 2499.582 ms 2023-07-13T14:15:00.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1740 0.17 MB/sec execute 394 sec latency 3499.625 ms 2023-07-13T14:15:01.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1744 0.17 MB/sec execute 395 sec latency 4259.169 ms 2023-07-13T14:15:01.539 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:23:36.056 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:01.547 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:23:36.064 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:01.550 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:23:36.034 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:01.553 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:23:36.036 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:01.556 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:23:36.039 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:01.556 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:23:36.039 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:01.710 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:23:36.193 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:01.710 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:23:36.194 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:01.724 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:23:36.241 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:02.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1752 0.17 MB/sec execute 396 sec latency 4305.620 ms 2023-07-13T14:15:03.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1760 0.17 MB/sec execute 397 sec latency 3314.969 ms 2023-07-13T14:15:04.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1765 0.17 MB/sec execute 398 sec latency 3861.312 ms 2023-07-13T14:15:05.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1766 0.17 MB/sec execute 399 sec latency 3905.380 ms 2023-07-13T14:15:06.047 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1768 0.17 MB/sec execute 400 sec latency 4905.407 ms 2023-07-13T14:15:07.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1770 0.17 MB/sec execute 401 sec latency 5825.156 ms 2023-07-13T14:15:08.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1779 0.17 MB/sec execute 402 sec latency 6220.024 ms 2023-07-13T14:15:09.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1782 0.17 MB/sec execute 403 sec latency 7011.688 ms 2023-07-13T14:15:10.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1782 0.17 MB/sec execute 404 sec latency 5538.770 ms 2023-07-13T14:15:11.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1783 0.17 MB/sec execute 405 sec latency 6538.797 ms 2023-07-13T14:15:12.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1785 0.17 MB/sec execute 406 sec latency 7233.541 ms 2023-07-13T14:15:13.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1787 0.17 MB/sec execute 407 sec latency 6415.421 ms 2023-07-13T14:15:14.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1789 0.17 MB/sec execute 408 sec latency 3628.813 ms 2023-07-13T14:15:15.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1790 0.17 MB/sec execute 409 sec latency 4628.839 ms 2023-07-13T14:15:16.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1793 0.16 MB/sec execute 410 sec latency 5324.033 ms 2023-07-13T14:15:17.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1797 0.16 MB/sec execute 411 sec latency 5346.962 ms 2023-07-13T14:15:18.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1801 0.16 MB/sec execute 412 sec latency 4066.371 ms 2023-07-13T14:15:19.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1804 0.16 MB/sec execute 413 sec latency 4385.846 ms 2023-07-13T14:15:20.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1808 0.16 MB/sec execute 414 sec latency 3397.222 ms 2023-07-13T14:15:21.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1811 0.16 MB/sec execute 415 sec latency 926.802 ms 2023-07-13T14:15:22.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1813 0.16 MB/sec execute 416 sec latency 1703.099 ms 2023-07-13T14:15:23.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1814 0.16 MB/sec execute 417 sec latency 2703.125 ms 2023-07-13T14:15:24.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1817 0.16 MB/sec execute 418 sec latency 3272.377 ms 2023-07-13T14:15:25.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1820 0.16 MB/sec execute 419 sec latency 3211.457 ms 2023-07-13T14:15:26.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1822 0.16 MB/sec execute 420 sec latency 3378.494 ms 2023-07-13T14:15:26.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:15:26.771 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:15:27.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1824 0.16 MB/sec execute 421 sec latency 4010.141 ms 2023-07-13T14:15:28.048 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1826 0.16 MB/sec execute 422 sec latency 4194.858 ms 2023-07-13T14:15:29.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1830 0.16 MB/sec execute 423 sec latency 3616.412 ms 2023-07-13T14:15:30.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1831 0.16 MB/sec execute 424 sec latency 3495.057 ms 2023-07-13T14:15:31.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1832 0.16 MB/sec execute 425 sec latency 2962.695 ms 2023-07-13T14:15:32.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1834 0.16 MB/sec execute 426 sec latency 3028.288 ms 2023-07-13T14:15:33.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1835 0.16 MB/sec execute 427 sec latency 2741.138 ms 2023-07-13T14:15:34.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1838 0.16 MB/sec execute 428 sec latency 2769.806 ms 2023-07-13T14:15:35.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1841 0.16 MB/sec execute 429 sec latency 2996.120 ms 2023-07-13T14:15:36.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1843 0.16 MB/sec execute 430 sec latency 3193.540 ms 2023-07-13T14:15:37.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1846 0.16 MB/sec execute 431 sec latency 2299.223 ms 2023-07-13T14:15:38.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1848 0.16 MB/sec execute 432 sec latency 2952.424 ms 2023-07-13T14:15:39.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1851 0.16 MB/sec execute 433 sec latency 2719.789 ms 2023-07-13T14:15:40.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1853 0.16 MB/sec execute 434 sec latency 2921.622 ms 2023-07-13T14:15:41.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1857 0.16 MB/sec execute 435 sec latency 3274.997 ms 2023-07-13T14:15:42.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1859 0.16 MB/sec execute 436 sec latency 3219.464 ms 2023-07-13T14:15:43.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1866 0.16 MB/sec execute 437 sec latency 3288.354 ms 2023-07-13T14:15:44.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1867 0.16 MB/sec execute 438 sec latency 2143.896 ms 2023-07-13T14:15:45.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1868 0.16 MB/sec execute 439 sec latency 2798.238 ms 2023-07-13T14:15:46.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1870 0.16 MB/sec execute 440 sec latency 3180.255 ms 2023-07-13T14:15:47.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1871 0.15 MB/sec execute 441 sec latency 3204.283 ms 2023-07-13T14:15:48.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1874 0.15 MB/sec execute 442 sec latency 3249.593 ms 2023-07-13T14:15:49.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1877 0.15 MB/sec execute 443 sec latency 2268.293 ms 2023-07-13T14:15:50.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1879 0.15 MB/sec execute 444 sec latency 2426.518 ms 2023-07-13T14:15:51.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1880 0.15 MB/sec execute 445 sec latency 2646.236 ms 2023-07-13T14:15:52.049 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1883 0.15 MB/sec execute 446 sec latency 2790.296 ms 2023-07-13T14:15:53.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1887 0.15 MB/sec execute 447 sec latency 2656.066 ms 2023-07-13T14:15:53.179 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:24:27.695 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:53.216 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:24:27.733 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:53.246 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:24:27.729 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:53.247 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:24:27.730 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:53.251 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:24:27.734 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:53.252 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:24:27.735 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:53.295 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:24:27.812 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:53.299 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:24:27.782 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:53.309 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:24:27.793 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:15:54.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1893 0.15 MB/sec execute 448 sec latency 1797.037 ms 2023-07-13T14:15:55.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1899 0.15 MB/sec execute 449 sec latency 2797.069 ms 2023-07-13T14:15:56.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1901 0.15 MB/sec execute 450 sec latency 3419.672 ms 2023-07-13T14:15:56.907 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:15:56.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:15:57.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1905 0.15 MB/sec execute 451 sec latency 3704.947 ms 2023-07-13T14:15:58.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1911 0.15 MB/sec execute 452 sec latency 3516.669 ms 2023-07-13T14:15:59.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1916 0.15 MB/sec execute 453 sec latency 3472.883 ms 2023-07-13T14:16:00.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1916 0.15 MB/sec execute 454 sec latency 3614.654 ms 2023-07-13T14:16:01.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1918 0.15 MB/sec execute 455 sec latency 4206.311 ms 2023-07-13T14:16:02.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1920 0.15 MB/sec execute 456 sec latency 4589.701 ms 2023-07-13T14:16:03.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1923 0.15 MB/sec execute 457 sec latency 4304.525 ms 2023-07-13T14:16:04.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1924 0.15 MB/sec execute 458 sec latency 3981.537 ms 2023-07-13T14:16:05.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1925 0.15 MB/sec execute 459 sec latency 4316.941 ms 2023-07-13T14:16:06.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1926 0.15 MB/sec execute 460 sec latency 4031.434 ms 2023-07-13T14:16:07.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1933 0.15 MB/sec execute 461 sec latency 4081.872 ms 2023-07-13T14:16:08.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1936 0.15 MB/sec execute 462 sec latency 3238.740 ms 2023-07-13T14:16:09.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1939 0.15 MB/sec execute 463 sec latency 3003.368 ms 2023-07-13T14:16:10.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1941 0.15 MB/sec execute 464 sec latency 2808.572 ms 2023-07-13T14:16:11.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1944 0.15 MB/sec execute 465 sec latency 3506.361 ms 2023-07-13T14:16:12.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1947 0.15 MB/sec execute 466 sec latency 3354.296 ms 2023-07-13T14:16:13.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1950 0.15 MB/sec execute 467 sec latency 3983.524 ms 2023-07-13T14:16:14.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1961 0.15 MB/sec execute 468 sec latency 4267.119 ms 2023-07-13T14:16:15.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1967 0.15 MB/sec execute 469 sec latency 2882.063 ms 2023-07-13T14:16:16.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1969 0.15 MB/sec execute 470 sec latency 3882.119 ms 2023-07-13T14:16:17.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1970 0.15 MB/sec execute 471 sec latency 4882.152 ms 2023-07-13T14:16:18.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1972 0.15 MB/sec execute 472 sec latency 5882.182 ms 2023-07-13T14:16:19.050 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1977 0.15 MB/sec execute 473 sec latency 6112.694 ms 2023-07-13T14:16:20.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1983 0.15 MB/sec execute 474 sec latency 5263.055 ms 2023-07-13T14:16:21.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1986 0.15 MB/sec execute 475 sec latency 4249.640 ms 2023-07-13T14:16:22.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1989 0.15 MB/sec execute 476 sec latency 5249.670 ms 2023-07-13T14:16:23.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1990 0.15 MB/sec execute 477 sec latency 6249.701 ms 2023-07-13T14:16:24.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1993 0.15 MB/sec execute 478 sec latency 6294.665 ms 2023-07-13T14:16:25.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1995 0.14 MB/sec execute 479 sec latency 6548.000 ms 2023-07-13T14:16:26.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1996 0.14 MB/sec execute 480 sec latency 6560.420 ms 2023-07-13T14:16:26.987 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:16:26.990 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:16:27.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 1997 0.14 MB/sec execute 481 sec latency 6231.289 ms 2023-07-13T14:16:28.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2001 0.14 MB/sec execute 482 sec latency 7004.719 ms 2023-07-13T14:16:29.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2003 0.14 MB/sec execute 483 sec latency 5526.514 ms 2023-07-13T14:16:30.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2006 0.14 MB/sec execute 484 sec latency 5711.162 ms 2023-07-13T14:16:31.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2009 0.14 MB/sec execute 485 sec latency 3493.408 ms 2023-07-13T14:16:32.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2012 0.14 MB/sec execute 486 sec latency 3356.136 ms 2023-07-13T14:16:33.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2015 0.14 MB/sec execute 487 sec latency 3816.344 ms 2023-07-13T14:16:34.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2017 0.14 MB/sec execute 488 sec latency 2955.828 ms 2023-07-13T14:16:35.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2019 0.14 MB/sec execute 489 sec latency 3955.861 ms 2023-07-13T14:16:36.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2022 0.14 MB/sec execute 490 sec latency 4445.969 ms 2023-07-13T14:16:37.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2024 0.14 MB/sec execute 491 sec latency 4839.381 ms 2023-07-13T14:16:38.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2028 0.14 MB/sec execute 492 sec latency 5221.898 ms 2023-07-13T14:16:39.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2031 0.14 MB/sec execute 493 sec latency 3152.628 ms 2023-07-13T14:16:40.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2034 0.14 MB/sec execute 494 sec latency 4057.201 ms 2023-07-13T14:16:41.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2036 0.14 MB/sec execute 495 sec latency 4925.066 ms 2023-07-13T14:16:42.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2039 0.14 MB/sec execute 496 sec latency 4573.737 ms 2023-07-13T14:16:43.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2041 0.14 MB/sec execute 497 sec latency 4057.328 ms 2023-07-13T14:16:44.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2046 0.14 MB/sec execute 498 sec latency 4091.168 ms 2023-07-13T14:16:45.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2047 0.14 MB/sec execute 499 sec latency 3155.496 ms 2023-07-13T14:16:46.051 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2048 0.14 MB/sec execute 500 sec latency 2851.750 ms 2023-07-13T14:16:47.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2051 0.14 MB/sec execute 501 sec latency 3160.620 ms 2023-07-13T14:16:48.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2054 0.14 MB/sec execute 502 sec latency 3356.803 ms 2023-07-13T14:16:49.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2055 0.14 MB/sec execute 503 sec latency 2966.027 ms 2023-07-13T14:16:50.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2057 0.14 MB/sec execute 504 sec latency 3072.231 ms 2023-07-13T14:16:51.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2057 0.14 MB/sec execute 505 sec latency 3619.536 ms 2023-07-13T14:16:52.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2059 0.14 MB/sec execute 506 sec latency 3665.740 ms 2023-07-13T14:16:53.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2060 0.14 MB/sec execute 507 sec latency 3411.056 ms 2023-07-13T14:16:54.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2063 0.14 MB/sec execute 508 sec latency 3496.903 ms 2023-07-13T14:16:55.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2064 0.14 MB/sec execute 509 sec latency 3583.438 ms 2023-07-13T14:16:56.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2065 0.14 MB/sec execute 510 sec latency 3785.844 ms 2023-07-13T14:16:57.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2066 0.14 MB/sec execute 511 sec latency 3929.936 ms 2023-07-13T14:16:57.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:16:57.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:16:58.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2067 0.14 MB/sec execute 512 sec latency 3768.812 ms 2023-07-13T14:16:59.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2070 0.14 MB/sec execute 513 sec latency 3533.517 ms 2023-07-13T14:17:00.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2072 0.14 MB/sec execute 514 sec latency 3039.933 ms 2023-07-13T14:17:01.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2075 0.14 MB/sec execute 515 sec latency 3161.028 ms 2023-07-13T14:17:02.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2082 0.14 MB/sec execute 516 sec latency 3249.428 ms 2023-07-13T14:17:03.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2087 0.14 MB/sec execute 517 sec latency 2864.537 ms 2023-07-13T14:17:04.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2090 0.14 MB/sec execute 518 sec latency 3277.444 ms 2023-07-13T14:17:05.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2093 0.14 MB/sec execute 519 sec latency 3174.806 ms 2023-07-13T14:17:06.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2094 0.14 MB/sec execute 520 sec latency 3113.054 ms 2023-07-13T14:17:07.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2095 0.14 MB/sec execute 521 sec latency 3123.841 ms 2023-07-13T14:17:08.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2095 0.14 MB/sec execute 522 sec latency 4047.958 ms 2023-07-13T14:17:09.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2096 0.14 MB/sec execute 523 sec latency 4243.021 ms 2023-07-13T14:17:10.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2096 0.14 MB/sec execute 524 sec latency 4832.244 ms 2023-07-13T14:17:11.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2100 0.14 MB/sec execute 525 sec latency 4825.210 ms 2023-07-13T14:17:12.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2106 0.14 MB/sec execute 526 sec latency 3491.806 ms 2023-07-13T14:17:13.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2109 0.13 MB/sec execute 527 sec latency 3020.610 ms 2023-07-13T14:17:13.606 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:25:48.123 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:13.646 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:25:48.162 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:13.679 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:25:48.162 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:13.681 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:25:48.164 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:13.691 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:25:48.174 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:13.693 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:25:48.176 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:13.731 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:25:48.214 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:13.737 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:25:48.253 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:13.745 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:25:48.228 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:17:14.052 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2112 0.13 MB/sec execute 528 sec latency 3071.799 ms 2023-07-13T14:17:15.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2114 0.13 MB/sec execute 529 sec latency 3433.463 ms 2023-07-13T14:17:16.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2119 0.13 MB/sec execute 530 sec latency 3546.784 ms 2023-07-13T14:17:17.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2119 0.13 MB/sec execute 531 sec latency 3586.234 ms 2023-07-13T14:17:18.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2120 0.13 MB/sec execute 532 sec latency 3607.177 ms 2023-07-13T14:17:19.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2121 0.13 MB/sec execute 533 sec latency 3916.433 ms 2023-07-13T14:17:20.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2123 0.13 MB/sec execute 534 sec latency 3818.358 ms 2023-07-13T14:17:21.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2134 0.13 MB/sec execute 535 sec latency 3774.585 ms 2023-07-13T14:17:22.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2134 0.13 MB/sec execute 536 sec latency 4736.424 ms 2023-07-13T14:17:23.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2138 0.13 MB/sec execute 537 sec latency 4719.537 ms 2023-07-13T14:17:24.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2146 0.13 MB/sec execute 538 sec latency 4034.051 ms 2023-07-13T14:17:25.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2150 0.13 MB/sec execute 539 sec latency 2682.801 ms 2023-07-13T14:17:26.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2152 0.13 MB/sec execute 540 sec latency 3055.892 ms 2023-07-13T14:17:27.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2154 0.13 MB/sec execute 541 sec latency 3656.262 ms 2023-07-13T14:17:27.247 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:17:27.250 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:17:28.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2154 0.13 MB/sec execute 542 sec latency 2388.004 ms 2023-07-13T14:17:29.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2156 0.13 MB/sec execute 543 sec latency 3388.030 ms 2023-07-13T14:17:30.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2156 0.13 MB/sec execute 544 sec latency 4388.072 ms 2023-07-13T14:17:31.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2156 0.13 MB/sec execute 545 sec latency 5388.122 ms 2023-07-13T14:17:32.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2157 0.13 MB/sec execute 546 sec latency 6388.168 ms 2023-07-13T14:17:33.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2158 0.13 MB/sec execute 547 sec latency 7049.406 ms 2023-07-13T14:17:34.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2162 0.13 MB/sec execute 548 sec latency 5294.511 ms 2023-07-13T14:17:35.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2165 0.13 MB/sec execute 549 sec latency 2992.249 ms 2023-07-13T14:17:36.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2167 0.13 MB/sec execute 550 sec latency 2858.371 ms 2023-07-13T14:17:37.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2169 0.13 MB/sec execute 551 sec latency 3858.397 ms 2023-07-13T14:17:38.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2174 0.13 MB/sec execute 552 sec latency 4135.994 ms 2023-07-13T14:17:39.053 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2179 0.13 MB/sec execute 553 sec latency 4337.379 ms 2023-07-13T14:17:40.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2181 0.13 MB/sec execute 554 sec latency 3129.086 ms 2023-07-13T14:17:41.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2183 0.13 MB/sec execute 555 sec latency 3598.075 ms 2023-07-13T14:17:42.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2186 0.13 MB/sec execute 556 sec latency 3853.005 ms 2023-07-13T14:17:43.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2192 0.13 MB/sec execute 557 sec latency 2360.258 ms 2023-07-13T14:17:44.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2193 0.13 MB/sec execute 558 sec latency 3281.727 ms 2023-07-13T14:17:45.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2201 0.13 MB/sec execute 559 sec latency 3476.290 ms 2023-07-13T14:17:46.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2203 0.13 MB/sec execute 560 sec latency 3206.078 ms 2023-07-13T14:17:47.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2204 0.13 MB/sec execute 561 sec latency 2692.375 ms 2023-07-13T14:17:48.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2207 0.13 MB/sec execute 562 sec latency 3231.464 ms 2023-07-13T14:17:49.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2211 0.13 MB/sec execute 563 sec latency 1263.108 ms 2023-07-13T14:17:50.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2211 0.13 MB/sec execute 564 sec latency 2263.153 ms 2023-07-13T14:17:51.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2212 0.13 MB/sec execute 565 sec latency 3263.218 ms 2023-07-13T14:17:52.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2215 0.13 MB/sec execute 566 sec latency 3919.170 ms 2023-07-13T14:17:53.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2223 0.13 MB/sec execute 567 sec latency 3943.075 ms 2023-07-13T14:17:54.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2227 0.13 MB/sec execute 568 sec latency 2621.553 ms 2023-07-13T14:17:55.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2232 0.13 MB/sec execute 569 sec latency 3621.604 ms 2023-07-13T14:17:56.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2241 0.13 MB/sec execute 570 sec latency 3685.728 ms 2023-07-13T14:17:57.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2243 0.13 MB/sec execute 571 sec latency 1788.411 ms 2023-07-13T14:17:57.402 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:17:57.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:17:58.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2246 0.13 MB/sec execute 572 sec latency 2788.442 ms 2023-07-13T14:17:59.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2246 0.13 MB/sec execute 573 sec latency 3592.697 ms 2023-07-13T14:18:00.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2251 0.13 MB/sec execute 574 sec latency 4145.062 ms 2023-07-13T14:18:01.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2258 0.13 MB/sec execute 575 sec latency 3834.599 ms 2023-07-13T14:18:02.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2263 0.13 MB/sec execute 576 sec latency 4031.597 ms 2023-07-13T14:18:03.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2268 0.13 MB/sec execute 577 sec latency 3427.428 ms 2023-07-13T14:18:04.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2276 0.14 MB/sec execute 578 sec latency 4427.458 ms 2023-07-13T14:18:05.054 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2284 0.14 MB/sec execute 579 sec latency 4450.573 ms 2023-07-13T14:18:06.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2290 0.14 MB/sec execute 580 sec latency 2756.450 ms 2023-07-13T14:18:07.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2290 0.14 MB/sec execute 581 sec latency 3756.478 ms 2023-07-13T14:18:08.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2292 0.14 MB/sec execute 582 sec latency 4756.570 ms 2023-07-13T14:18:09.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2298 0.14 MB/sec execute 583 sec latency 5529.659 ms 2023-07-13T14:18:10.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2302 0.14 MB/sec execute 584 sec latency 5708.326 ms 2023-07-13T14:18:11.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2303 0.14 MB/sec execute 585 sec latency 2160.034 ms 2023-07-13T14:18:12.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2303 0.14 MB/sec execute 586 sec latency 3160.065 ms 2023-07-13T14:18:13.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2304 0.14 MB/sec execute 587 sec latency 3631.027 ms 2023-07-13T14:18:14.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2306 0.14 MB/sec execute 588 sec latency 4088.136 ms 2023-07-13T14:18:15.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2308 0.14 MB/sec execute 589 sec latency 2529.176 ms 2023-07-13T14:18:16.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2309 0.14 MB/sec execute 590 sec latency 3529.204 ms 2023-07-13T14:18:17.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2313 0.14 MB/sec execute 591 sec latency 4254.827 ms 2023-07-13T14:18:18.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2313 0.14 MB/sec execute 592 sec latency 3616.009 ms 2023-07-13T14:18:19.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2314 0.14 MB/sec execute 593 sec latency 2971.352 ms 2023-07-13T14:18:20.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2316 0.14 MB/sec execute 594 sec latency 3015.350 ms 2023-07-13T14:18:21.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2316 0.14 MB/sec execute 595 sec latency 2813.176 ms 2023-07-13T14:18:22.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2316 0.14 MB/sec execute 596 sec latency 3025.185 ms 2023-07-13T14:18:23.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2320 0.14 MB/sec execute 597 sec latency 3171.263 ms 2023-07-13T14:18:24.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2325 0.14 MB/sec execute 598 sec latency 3366.554 ms 2023-07-13T14:18:25.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 2326 0.14 MB/sec execute 599 sec latency 2984.202 ms 2023-07-13T14:18:26.055 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 600 sec 2023-07-13T14:18:27.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 601 sec 2023-07-13T14:18:27.482 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:18:27.485 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:18:27.576 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:27:02.092 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:27.582 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:27:02.099 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:27.589 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:27:02.072 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:27.592 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:27:02.075 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:27.592 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:27:02.074 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:27.595 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:27:02.078 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:27.644 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:27:02.126 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:27.646 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:27:02.129 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:27.650 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:27:02.167 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:18:28.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 602 sec 2023-07-13T14:18:29.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 603 sec 2023-07-13T14:18:30.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 604 sec 2023-07-13T14:18:31.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 605 sec 2023-07-13T14:18:32.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 606 sec 2023-07-13T14:18:33.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 607 sec 2023-07-13T14:18:34.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 608 sec 2023-07-13T14:18:35.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 609 sec 2023-07-13T14:18:36.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 610 sec 2023-07-13T14:18:37.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 611 sec 2023-07-13T14:18:38.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 612 sec 2023-07-13T14:18:39.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 613 sec 2023-07-13T14:18:40.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 614 sec 2023-07-13T14:18:41.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 615 sec 2023-07-13T14:18:42.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 616 sec 2023-07-13T14:18:43.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 617 sec 2023-07-13T14:18:44.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 618 sec 2023-07-13T14:18:45.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 619 sec 2023-07-13T14:18:46.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 620 sec 2023-07-13T14:18:47.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 621 sec 2023-07-13T14:18:48.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 622 sec 2023-07-13T14:18:49.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 623 sec 2023-07-13T14:18:50.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 624 sec 2023-07-13T14:18:51.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 625 sec 2023-07-13T14:18:52.056 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 626 sec 2023-07-13T14:18:53.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 627 sec 2023-07-13T14:18:54.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 628 sec 2023-07-13T14:18:55.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 629 sec 2023-07-13T14:18:56.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 630 sec 2023-07-13T14:18:57.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 631 sec 2023-07-13T14:18:57.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:18:57.640 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:18:58.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 632 sec 2023-07-13T14:18:59.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 633 sec 2023-07-13T14:19:00.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 634 sec 2023-07-13T14:19:01.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 635 sec 2023-07-13T14:19:02.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 636 sec 2023-07-13T14:19:03.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 637 sec 2023-07-13T14:19:04.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 638 sec 2023-07-13T14:19:05.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 639 sec 2023-07-13T14:19:06.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 640 sec 2023-07-13T14:19:07.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 641 sec 2023-07-13T14:19:08.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 642 sec 2023-07-13T14:19:09.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 643 sec 2023-07-13T14:19:10.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 644 sec 2023-07-13T14:19:11.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 645 sec 2023-07-13T14:19:12.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 646 sec 2023-07-13T14:19:13.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 647 sec 2023-07-13T14:19:14.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 648 sec 2023-07-13T14:19:15.057 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 649 sec 2023-07-13T14:19:16.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 650 sec 2023-07-13T14:19:17.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 651 sec 2023-07-13T14:19:18.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 652 sec 2023-07-13T14:19:19.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 653 sec 2023-07-13T14:19:20.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 654 sec 2023-07-13T14:19:21.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 655 sec 2023-07-13T14:19:22.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 656 sec 2023-07-13T14:19:23.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 657 sec 2023-07-13T14:19:24.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 658 sec 2023-07-13T14:19:25.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 659 sec 2023-07-13T14:19:26.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 660 sec 2023-07-13T14:19:27.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 661 sec 2023-07-13T14:19:27.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:19:27.778 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:19:28.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 662 sec 2023-07-13T14:19:29.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 663 sec 2023-07-13T14:19:30.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 664 sec 2023-07-13T14:19:31.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 665 sec 2023-07-13T14:19:32.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 666 sec 2023-07-13T14:19:33.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 667 sec 2023-07-13T14:19:34.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 668 sec 2023-07-13T14:19:35.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 669 sec 2023-07-13T14:19:36.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 670 sec 2023-07-13T14:19:37.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 671 sec 2023-07-13T14:19:38.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 672 sec 2023-07-13T14:19:39.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 673 sec 2023-07-13T14:19:40.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 674 sec 2023-07-13T14:19:41.058 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 675 sec 2023-07-13T14:19:42.059 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 676 sec 2023-07-13T14:19:43.059 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 677 sec 2023-07-13T14:19:44.059 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 678 sec 2023-07-13T14:19:45.059 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 679 sec 2023-07-13T14:19:46.059 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 680 sec 2023-07-13T14:19:47.059 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 681 sec 2023-07-13T14:19:48.059 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 682 sec 2023-07-13T14:19:49.059 INFO:tasks.workunit.client.0.smithi118.stdout: 10 cleanup 683 sec 2023-07-13T14:19:50.059 INFO:tasks.workunit.client.0.smithi118.stdout: 4 cleanup 684 sec 2023-07-13T14:19:51.059 INFO:tasks.workunit.client.0.smithi118.stdout: 3 cleanup 685 sec 2023-07-13T14:19:51.970 INFO:tasks.workunit.client.0.smithi118.stdout: 0 cleanup 686 sec 2023-07-13T14:19:51.971 INFO:tasks.workunit.client.0.smithi118.stdout: 2023-07-13T14:19:51.971 INFO:tasks.workunit.client.0.smithi118.stdout: Operation Count AvgLat MaxLat 2023-07-13T14:19:51.971 INFO:tasks.workunit.client.0.smithi118.stdout: ---------------------------------------- 2023-07-13T14:19:51.971 INFO:tasks.workunit.client.0.smithi118.stdout: NTCreateX 3191 375.929 2723.628 2023-07-13T14:19:51.971 INFO:tasks.workunit.client.0.smithi118.stdout: Close 2734 3.821 77.108 2023-07-13T14:19:51.971 INFO:tasks.workunit.client.0.smithi118.stdout: Rename 112 1268.437 2169.856 2023-07-13T14:19:51.972 INFO:tasks.workunit.client.0.smithi118.stdout: Unlink 304 427.121 1774.038 2023-07-13T14:19:51.972 INFO:tasks.workunit.client.0.smithi118.stdout: Qpathinfo 3046 239.615 2306.546 2023-07-13T14:19:51.972 INFO:tasks.workunit.client.0.smithi118.stdout: Qfileinfo 600 7.851 125.097 2023-07-13T14:19:51.972 INFO:tasks.workunit.client.0.smithi118.stdout: Qfsinfo 344 25.506 148.994 2023-07-13T14:19:51.972 INFO:tasks.workunit.client.0.smithi118.stdout: Sfileinfo 356 49.094 166.790 2023-07-13T14:19:51.972 INFO:tasks.workunit.client.0.smithi118.stdout: Find 977 3704.942 7233.531 2023-07-13T14:19:51.972 INFO:tasks.workunit.client.0.smithi118.stdout: WriteX 1947 17.145 650.011 2023-07-13T14:19:51.973 INFO:tasks.workunit.client.0.smithi118.stdout: ReadX 3744 0.149 27.995 2023-07-13T14:19:51.973 INFO:tasks.workunit.client.0.smithi118.stdout: Flush 302 424.991 1079.327 2023-07-13T14:19:51.973 INFO:tasks.workunit.client.0.smithi118.stdout: 2023-07-13T14:19:51.973 INFO:tasks.workunit.client.0.smithi118.stdout:Throughput 0.13808 MB/sec 10 clients 10 procs max_latency=7233.541 ms 2023-07-13T14:19:51.973 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-13T14:19:51.974 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-13T14:19:57.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:19:57.890 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:20:18.859 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-07-13T14:20:18.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-07-13T14:20:19.129 DEBUG:teuthology.parallel:result is None 2023-07-13T14:20:19.129 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-07-13T14:20:19.364 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-07-13T14:20:19.365 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-07-13T14:20:19.374 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-07-13T14:20:19.374 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T14:20:19.374 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-13T14:20:19.393 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T14:20:19.393 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-13T14:20:19.451 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T14:20:19.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.622+0000 7fe66deef700 1 Processor -- start 2023-07-13T14:20:19.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.622+0000 7fe66deef700 1 -- start start 2023-07-13T14:20:19.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.623+0000 7fe66deef700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe66806de20 0x7fe66806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:19.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.623+0000 7fe66deef700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6680c7360 0x7fe6680c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:19.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.623+0000 7fe66deef700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe668156160 0x7fe6680c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:19.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.623+0000 7fe66deef700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66806e730 con 0x7fe66806de20 2023-07-13T14:20:19.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.623+0000 7fe66deef700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66815a080 con 0x7fe6680c7360 2023-07-13T14:20:19.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.623+0000 7fe66deef700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680c2fc0 con 0x7fe668156160 2023-07-13T14:20:19.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.624+0000 7fe6677fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe66806de20 0x7fe66806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:19.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.624+0000 7fe667fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe668156160 0x7fe6680c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:19.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.624+0000 7fe666ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6680c7360 0x7fe6680c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:19.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.624+0000 7fe6677fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe66806de20 0x7fe66806e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36746/0 (socket says 172.21.15.118:36746) 2023-07-13T14:20:19.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.624+0000 7fe6677fe700 1 -- 172.21.15.118:0/1404582501 learned_addr learned my addr 172.21.15.118:0/1404582501 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:19.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.628+0000 7fe6677fe700 1 -- 172.21.15.118:0/1404582501 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe668156160 msgr2=0x7fe6680c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:19.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.628+0000 7fe6677fe700 1 --2- 172.21.15.118:0/1404582501 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe668156160 0x7fe6680c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:19.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.628+0000 7fe6677fe700 1 -- 172.21.15.118:0/1404582501 >> v2:172.21.15.123:3300/0 conn(0x7fe6680c7360 msgr2=0x7fe6680c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:19.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.628+0000 7fe6677fe700 1 --2- 172.21.15.118:0/1404582501 >> v2:172.21.15.123:3300/0 conn(0x7fe6680c7360 0x7fe6680c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:19.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.628+0000 7fe6677fe700 1 -- 172.21.15.118:0/1404582501 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680c3270 con 0x7fe66806de20 2023-07-13T14:20:19.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.630+0000 7fe6677fe700 1 --2- 172.21.15.118:0/1404582501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe66806de20 0x7fe66806e1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6680c79d0 tx=0x7fe65c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8bcea1692a3772 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:19.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.634+0000 7fe6667fc700 1 -- 172.21.15.118:0/1404582501 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011830 con 0x7fe66806de20 2023-07-13T14:20:19.625 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.634+0000 7fe6667fc700 1 -- 172.21.15.118:0/1404582501 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c011990 con 0x7fe66806de20 2023-07-13T14:20:19.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.634+0000 7fe6667fc700 1 -- 172.21.15.118:0/1404582501 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011d20 con 0x7fe66806de20 2023-07-13T14:20:19.626 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 -- 172.21.15.118:0/1404582501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe66806de20 msgr2=0x7fe66806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 --2- 172.21.15.118:0/1404582501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe66806de20 0x7fe66806e1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6680c79d0 tx=0x7fe65c009bd0 comp rx=0 tx=0).stop 2023-07-13T14:20:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 -- 172.21.15.118:0/1404582501 shutdown_connections 2023-07-13T14:20:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 --2- 172.21.15.118:0/1404582501 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe668156160 0x7fe6680c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 --2- 172.21.15.118:0/1404582501 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe66806de20 0x7fe66806e1f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 --2- 172.21.15.118:0/1404582501 >> v2:172.21.15.123:3300/0 conn(0x7fe6680c7360 0x7fe6680c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 -- 172.21.15.118:0/1404582501 >> 172.21.15.118:0/1404582501 conn(0x7fe668069f30 msgr2=0x7fe66806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 -- 172.21.15.118:0/1404582501 shutdown_connections 2023-07-13T14:20:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.635+0000 7fe66deef700 1 -- 172.21.15.118:0/1404582501 wait complete. 2023-07-13T14:20:19.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.636+0000 7fe66deef700 1 Processor -- start 2023-07-13T14:20:19.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.636+0000 7fe66deef700 1 -- start start 2023-07-13T14:20:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.637+0000 7fe66deef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66806de20 0x7fe6681e0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.637+0000 7fe66deef700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6680c7360 0x7fe6681f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.637+0000 7fe66deef700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe668156160 0x7fe6681f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.637+0000 7fe66deef700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe668158ad0 con 0x7fe668156160 2023-07-13T14:20:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.637+0000 7fe66deef700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6681577c0 con 0x7fe66806de20 2023-07-13T14:20:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.637+0000 7fe66deef700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe668158ee0 con 0x7fe6680c7360 2023-07-13T14:20:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.638+0000 7fe667fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe668156160 0x7fe6681f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.638+0000 7fe666ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6680c7360 0x7fe6681f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.638+0000 7fe6677fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66806de20 0x7fe6681e0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.638+0000 7fe667fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe668156160 0x7fe6681f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:36756/0 (socket says 172.21.15.118:36756) 2023-07-13T14:20:19.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.638+0000 7fe667fff700 1 -- 172.21.15.118:0/3520017911 learned_addr learned my addr 172.21.15.118:0/3520017911 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.642+0000 7fe667fff700 1 -- 172.21.15.118:0/3520017911 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6680c7360 msgr2=0x7fe6681f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.642+0000 7fe667fff700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6680c7360 0x7fe6681f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.642+0000 7fe667fff700 1 -- 172.21.15.118:0/3520017911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66806de20 msgr2=0x7fe6681e0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.642+0000 7fe667fff700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66806de20 0x7fe6681e0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.642+0000 7fe667fff700 1 -- 172.21.15.118:0/3520017911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c009550 con 0x7fe668156160 2023-07-13T14:20:19.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.645+0000 7fe667fff700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe668156160 0x7fe6681f1c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe660009dd0 tx=0x7fe66000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:19.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.649+0000 7fe64ffff700 1 -- 172.21.15.118:0/3520017911 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660009c40 con 0x7fe668156160 2023-07-13T14:20:19.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.649+0000 7fe64ffff700 1 -- 172.21.15.118:0/3520017911 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66000f040 con 0x7fe668156160 2023-07-13T14:20:19.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.649+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe668159180 con 0x7fe668156160 2023-07-13T14:20:19.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.649+0000 7fe64ffff700 1 -- 172.21.15.118:0/3520017911 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66000ceb0 con 0x7fe668156160 2023-07-13T14:20:19.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.649+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6681e1960 con 0x7fe668156160 2023-07-13T14:20:19.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.650+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6680743c0 con 0x7fe668156160 2023-07-13T14:20:19.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.900+0000 7fe64ffff700 1 -- 172.21.15.118:0/3520017911 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe660014480 con 0x7fe668156160 2023-07-13T14:20:19.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.900+0000 7fe64ffff700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe65406ace0 0x7fe65406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:19.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.900+0000 7fe6677fe700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe65406ace0 0x7fe65406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:19.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.901+0000 7fe6677fe700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe65406ace0 0x7fe65406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe65c014040 tx=0x7fe65c008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:19.906 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.915+0000 7fe64ffff700 1 -- 172.21.15.118:0/3520017911 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe66005d250 con 0x7fe668156160 2023-07-13T14:20:19.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:19.915+0000 7fe64ffff700 1 -- 172.21.15.118:0/3520017911 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6600555d0 con 0x7fe668156160 2023-07-13T14:20:20.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.111+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6680c6f30 con 0x7fe668156160 2023-07-13T14:20:20.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.165+0000 7fe64ffff700 1 -- 172.21.15.118:0/3520017911 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20252 (secure 0 0 0) 0x7fe660018070 con 0x7fe668156160 2023-07-13T14:20:20.157 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:20:20.157 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:57.795549+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.35","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T14:20:20.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.167+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe65406ace0 msgr2=0x7fe65406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.167+0000 7fe66deef700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe65406ace0 0x7fe65406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe65c014040 tx=0x7fe65c008030 comp rx=0 tx=0).stop 2023-07-13T14:20:20.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.167+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe668156160 msgr2=0x7fe6681f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.167+0000 7fe66deef700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe668156160 0x7fe6681f1c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe660009dd0 tx=0x7fe66000c3a0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.168+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 shutdown_connections 2023-07-13T14:20:20.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.168+0000 7fe66deef700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe65406ace0 0x7fe65406d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.168+0000 7fe66deef700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe66806de20 0x7fe6681e0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.168+0000 7fe66deef700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe668156160 0x7fe6681f1c20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.168+0000 7fe66deef700 1 --2- 172.21.15.118:0/3520017911 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe6680c7360 0x7fe6681f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.168+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 >> 172.21.15.118:0/3520017911 conn(0x7fe668069f30 msgr2=0x7fe6680cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:20.160 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.168+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 shutdown_connections 2023-07-13T14:20:20.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.168+0000 7fe66deef700 1 -- 172.21.15.118:0/3520017911 wait complete. 2023-07-13T14:20:20.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-13T13:51:55.327381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-13T13:51:57.354158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-13T13:52:15.149076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-13T13:52:16.169659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-13T13:52:21.744112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-13T14:20:20.172 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-13T14:20:20.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.310+0000 7f9c054ba700 1 Processor -- start 2023-07-13T14:20:20.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.310+0000 7f9c054ba700 1 -- start start 2023-07-13T14:20:20.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.311+0000 7f9c054ba700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c001507d0 0x7f9c0015a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.311+0000 7f9c054ba700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c000c1820 con 0x7f9c000c6fc0 2023-07-13T14:20:20.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.311+0000 7f9c054ba700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c000c1b00 con 0x7f9c001565e0 2023-07-13T14:20:20.303 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.311+0000 7f9c054ba700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000c1de0 con 0x7f9c001507d0 2023-07-13T14:20:20.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.313+0000 7f9bff7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9c000c6fc0 0x7f9c00160f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45892/0 (socket says 172.21.15.118:45892) 2023-07-13T14:20:20.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.313+0000 7f9bff7fe700 1 -- 172.21.15.118:0/3653376744 learned_addr learned my addr 172.21.15.118:0/3653376744 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:20.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.319+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053966005 0 0) 0x7f9c000c1820 con 0x7f9c000c6fc0 2023-07-13T14:20:20.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.319+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9be80035b0 con 0x7f9c000c6fc0 2023-07-13T14:20:20.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1179157797 0 0) 0x7f9be80035b0 con 0x7f9c000c6fc0 2023-07-13T14:20:20.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c001507d0 msgr2=0x7f9c0015a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:20.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c001507d0 0x7f9c0015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 >> v1:172.21.15.123:6789/0 conn(0x7f9c001565e0 legacy=0x7f9c0006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:20.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00159d00 con 0x7f9c000c6fc0 2023-07-13T14:20:20.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2402946124 0 0) 0x7f9bf80019f0 con 0x7f9c000c6fc0 2023-07-13T14:20:20.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 >> v1:172.21.15.118:6789/0 conn(0x7f9c000c6fc0 legacy=0x7f9c00160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c001507d0 0x7f9be8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9be8004170 0x7f9be8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be8004eb0 0x7f9be8005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000c1de0 con 0x7f9be8004170 2023-07-13T14:20:20.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be800bd40 con 0x7f9be8004eb0 2023-07-13T14:20:20.317 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.324+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be800bf00 con 0x7f9c001507d0 2023-07-13T14:20:20.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.328+0000 7f9bfe7fc700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9be8004170 0x7f9be8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.331+0000 7f9bfe7fc700 1 -- 172.21.15.118:0/3653376744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c001507d0 msgr2=0x7f9be8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.331+0000 7f9bfe7fc700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c001507d0 0x7f9be8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.331+0000 7f9bfe7fc700 1 -- 172.21.15.118:0/3653376744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be8004eb0 msgr2=0x7f9be8005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.331+0000 7f9bfe7fc700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be8004eb0 0x7f9be8005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.331+0000 7f9bfe7fc700 1 -- 172.21.15.118:0/3653376744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be80035b0 con 0x7f9be8004170 2023-07-13T14:20:20.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.334+0000 7f9bfe7fc700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9be8004170 0x7f9be8004850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0007fd0 tx=0x7f9be8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0e4b5e42b4993a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:20.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00052d0 con 0x7f9be8004170 2023-07-13T14:20:20.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf0005430 con 0x7f9be8004170 2023-07-13T14:20:20.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9bfdffb700 1 -- 172.21.15.118:0/3653376744 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00038e0 con 0x7f9be8004170 2023-07-13T14:20:20.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9c054ba700 1 -- 172.21.15.118:0/3653376744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9be8004170 msgr2=0x7f9be8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9c054ba700 1 --2- 172.21.15.118:0/3653376744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9be8004170 0x7f9be8004850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0007fd0 tx=0x7f9be8005880 comp rx=0 tx=0).stop 2023-07-13T14:20:20.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9bff7fe700 1 -- 172.21.15.118:0/3653376744 reap_dead start 2023-07-13T14:20:20.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9c054ba700 1 -- 172.21.15.118:0/3653376744 shutdown_connections 2023-07-13T14:20:20.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9c054ba700 1 -- 172.21.15.118:0/3653376744 >> 172.21.15.118:0/3653376744 conn(0x7f9c0006e060 msgr2=0x7f9c0006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:20.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9c054ba700 1 -- 172.21.15.118:0/3653376744 shutdown_connections 2023-07-13T14:20:20.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.338+0000 7f9c054ba700 1 -- 172.21.15.118:0/3653376744 wait complete. 2023-07-13T14:20:20.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.340+0000 7f9c054ba700 1 Processor -- start 2023-07-13T14:20:20.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.340+0000 7f9c054ba700 1 -- start start 2023-07-13T14:20:20.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.340+0000 7f9c054ba700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000cb090 0x7f9c001ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.340+0000 7f9c054ba700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c0006ce30 0x7f9c001eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.340+0000 7f9c054ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000cb460 0x7f9c00140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.340+0000 7f9c054ba700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000ae830 con 0x7f9c000cb090 2023-07-13T14:20:20.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.340+0000 7f9c054ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0014fab0 con 0x7f9c000cb460 2023-07-13T14:20:20.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.340+0000 7f9c054ba700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0006c7f0 con 0x7f9c0006ce30 2023-07-13T14:20:20.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.341+0000 7f9bfeffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000cb090 0x7f9c001ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.341+0000 7f9bfeffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000cb090 0x7f9c001ee7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43634/0 (socket says 172.21.15.118:43634) 2023-07-13T14:20:20.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.341+0000 7f9bfeffd700 1 -- 172.21.15.118:0/989397625 learned_addr learned my addr 172.21.15.118:0/989397625 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:20.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.342+0000 7f9bff7fe700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000cb460 0x7f9c00140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.343+0000 7f9bfe7fc700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c0006ce30 0x7f9c001eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.346+0000 7f9bfeffd700 1 -- 172.21.15.118:0/989397625 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c0006ce30 msgr2=0x7f9c001eecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.346+0000 7f9bfeffd700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c0006ce30 0x7f9c001eecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.346+0000 7f9bfeffd700 1 -- 172.21.15.118:0/989397625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000cb460 msgr2=0x7f9c00140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.346+0000 7f9bfeffd700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000cb460 0x7f9c00140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.337 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.346+0000 7f9bfeffd700 1 -- 172.21.15.118:0/989397625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000ad5c0 con 0x7f9c000cb090 2023-07-13T14:20:20.342 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.351+0000 7f9bfeffd700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000cb090 0x7f9c001ee7b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400b570 tx=0x7f9bf400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:20.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.355+0000 7f9be77fe700 1 -- 172.21.15.118:0/989397625 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4011830 con 0x7f9c000cb090 2023-07-13T14:20:20.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.355+0000 7f9be77fe700 1 -- 172.21.15.118:0/989397625 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4011990 con 0x7f9c000cb090 2023-07-13T14:20:20.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.355+0000 7f9be77fe700 1 -- 172.21.15.118:0/989397625 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4011d00 con 0x7f9c000cb090 2023-07-13T14:20:20.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.355+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c000ad8a0 con 0x7f9c000cb090 2023-07-13T14:20:20.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.355+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c000ae4f0 con 0x7f9c000cb090 2023-07-13T14:20:20.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.356+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c000add60 con 0x7f9c000cb090 2023-07-13T14:20:20.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.625+0000 7f9be77fe700 1 -- 172.21.15.118:0/989397625 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9bf4023430 con 0x7f9c000cb090 2023-07-13T14:20:20.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.625+0000 7f9be77fe700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9bec06ace0 0x7f9bec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.625+0000 7f9be77fe700 1 -- 172.21.15.118:0/989397625 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9bf4089760 con 0x7f9c000cb090 2023-07-13T14:20:20.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.626+0000 7f9bfe7fc700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9bec06ace0 0x7f9bec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.626+0000 7f9be77fe700 1 -- 172.21.15.118:0/989397625 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9bf4089ba0 con 0x7f9c000cb090 2023-07-13T14:20:20.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.626+0000 7f9bfe7fc700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9bec06ace0 0x7f9bec06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c00068020 tx=0x7f9bf000a000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:20.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.818+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c0004e280 con 0x7f9c000cb090 2023-07-13T14:20:20.817 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.826+0000 7f9be77fe700 1 -- 172.21.15.118:0/989397625 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bf4054550 con 0x7f9c000cb090 2023-07-13T14:20:20.817 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-07-13T14:20:20.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9bec06ace0 msgr2=0x7f9bec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9bec06ace0 0x7f9bec06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c00068020 tx=0x7f9bf000a000 comp rx=0 tx=0).stop 2023-07-13T14:20:20.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000cb090 msgr2=0x7f9c001ee7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000cb090 0x7f9c001ee7b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400b570 tx=0x7f9bf400b880 comp rx=0 tx=0).stop 2023-07-13T14:20:20.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 shutdown_connections 2023-07-13T14:20:20.820 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f9bec06ace0 0x7f9bec06d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000cb460 0x7f9c00140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9c000cb090 0x7f9c001ee7b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 --2- 172.21.15.118:0/989397625 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9c0006ce30 0x7f9c001eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 >> 172.21.15.118:0/989397625 conn(0x7f9c0006e060 msgr2=0x7f9c00069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:20.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 shutdown_connections 2023-07-13T14:20:20.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.828+0000 7f9c054ba700 1 -- 172.21.15.118:0/989397625 wait complete. 2023-07-13T14:20:20.832 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-13T14:20:20.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.965+0000 7f1d91696700 1 Processor -- start 2023-07-13T14:20:20.956 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.965+0000 7f1d91696700 1 -- start start 2023-07-13T14:20:20.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.966+0000 7f1d91696700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b36d0 0x7f1d8c15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.966+0000 7f1d91696700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d8c0b3aa0 0x7f1d8c159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.966+0000 7f1d91696700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c158740 con 0x7f1d8c0ce7e0 2023-07-13T14:20:20.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.966+0000 7f1d91696700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0c3af0 con 0x7f1d8c0b3aa0 2023-07-13T14:20:20.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.966+0000 7f1d91696700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0c3dd0 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.966+0000 7f1d8a7fc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d8c0b3aa0 0x7f1d8c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.967+0000 7f1d8affd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b36d0 0x7f1d8c15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.967+0000 7f1d8affd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b36d0 0x7f1d8c15bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:56152/0 (socket says 172.21.15.118:56152) 2023-07-13T14:20:20.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.967+0000 7f1d8affd700 1 -- 172.21.15.118:0/2083429676 learned_addr learned my addr 172.21.15.118:0/2083429676 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:20.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.970+0000 7f1d8affd700 1 -- 172.21.15.118:0/2083429676 >> v2:172.21.15.118:3300/0 conn(0x7f1d8c0b3aa0 msgr2=0x7f1d8c159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:20.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.970+0000 7f1d8affd700 1 --2- 172.21.15.118:0/2083429676 >> v2:172.21.15.118:3300/0 conn(0x7f1d8c0b3aa0 0x7f1d8c159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.970+0000 7f1d8affd700 1 -- 172.21.15.118:0/2083429676 >> v1:172.21.15.118:6789/0 conn(0x7f1d8c0ce7e0 legacy=0x7f1d8c06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.970+0000 7f1d8affd700 1 -- 172.21.15.118:0/2083429676 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0c40b0 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.972+0000 7f1d8affd700 1 --2- 172.21.15.118:0/2083429676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b36d0 0x7f1d8c15bcb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d800098f0 tx=0x7f1d80009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4cc0120a78fc221 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:20.967 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.976+0000 7f1d89ffb700 1 -- 172.21.15.118:0/2083429676 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80011830 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.976+0000 7f1d89ffb700 1 -- 172.21.15.118:0/2083429676 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80011990 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.976+0000 7f1d89ffb700 1 -- 172.21.15.118:0/2083429676 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80011d20 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.977+0000 7f1d91696700 1 -- 172.21.15.118:0/2083429676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b36d0 msgr2=0x7f1d8c15bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.977+0000 7f1d91696700 1 --2- 172.21.15.118:0/2083429676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b36d0 0x7f1d8c15bcb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d800098f0 tx=0x7f1d80009c00 comp rx=0 tx=0).stop 2023-07-13T14:20:20.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.977+0000 7f1d91696700 1 -- 172.21.15.118:0/2083429676 shutdown_connections 2023-07-13T14:20:20.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.977+0000 7f1d91696700 1 --2- 172.21.15.118:0/2083429676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b36d0 0x7f1d8c15bcb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.977+0000 7f1d91696700 1 --2- 172.21.15.118:0/2083429676 >> v2:172.21.15.118:3300/0 conn(0x7f1d8c0b3aa0 0x7f1d8c159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.977+0000 7f1d91696700 1 -- 172.21.15.118:0/2083429676 >> 172.21.15.118:0/2083429676 conn(0x7f1d8c071840 msgr2=0x7f1d8c06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:20.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.977+0000 7f1d91696700 1 -- 172.21.15.118:0/2083429676 shutdown_connections 2023-07-13T14:20:20.969 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.977+0000 7f1d91696700 1 -- 172.21.15.118:0/2083429676 wait complete. 2023-07-13T14:20:20.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.979+0000 7f1d91696700 1 Processor -- start 2023-07-13T14:20:20.970 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.979+0000 7f1d91696700 1 -- start start 2023-07-13T14:20:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.980+0000 7f1d91696700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0b36d0 0x7f1d8c1eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.980+0000 7f1d91696700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b3aa0 0x7f1d8c0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.971 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.980+0000 7f1d91696700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0ce7e0 0x7f1d8c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.980+0000 7f1d91696700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c155990 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.980+0000 7f1d91696700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1572c0 con 0x7f1d8c0ce7e0 2023-07-13T14:20:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.980+0000 7f1d91696700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c15b680 con 0x7f1d8c0b3aa0 2023-07-13T14:20:20.972 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.981+0000 7f1d8affd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0b36d0 0x7f1d8c1eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.981+0000 7f1d8a7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b3aa0 0x7f1d8c0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.981+0000 7f1d8b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0ce7e0 0x7f1d8c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.981+0000 7f1d8affd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0b36d0 0x7f1d8c1eeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43652/0 (socket says 172.21.15.118:43652) 2023-07-13T14:20:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.981+0000 7f1d8a7fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b3aa0 0x7f1d8c0cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:56154/0 (socket says 172.21.15.118:56154) 2023-07-13T14:20:20.973 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.981+0000 7f1d8affd700 1 -- 172.21.15.118:0/581095875 learned_addr learned my addr 172.21.15.118:0/581095875 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.985+0000 7f1d8affd700 1 -- 172.21.15.118:0/581095875 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b3aa0 msgr2=0x7f1d8c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.985+0000 7f1d8affd700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b3aa0 0x7f1d8c0cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.985+0000 7f1d8affd700 1 -- 172.21.15.118:0/581095875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0ce7e0 msgr2=0x7f1d8c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:20.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.985+0000 7f1d8affd700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0ce7e0 0x7f1d8c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:20.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.985+0000 7f1d8affd700 1 -- 172.21.15.118:0/581095875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80009550 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.987+0000 7f1d8affd700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0b36d0 0x7f1d8c1eeac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009c40 tx=0x7f1d80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:20.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.991+0000 7f1d737fe700 1 -- 172.21.15.118:0/581095875 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80004510 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.991+0000 7f1d737fe700 1 -- 172.21.15.118:0/581095875 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8001e070 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.991+0000 7f1d737fe700 1 -- 172.21.15.118:0/581095875 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800038e0 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.992+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c15ab00 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.992+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c15b0c0 con 0x7f1d8c0b36d0 2023-07-13T14:20:20.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:20.992+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c0c5370 con 0x7f1d8c0b36d0 2023-07-13T14:20:21.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.011+0000 7f1d737fe700 1 -- 172.21.15.118:0/581095875 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d80003a40 con 0x7f1d8c0b36d0 2023-07-13T14:20:21.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.012+0000 7f1d737fe700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d7806ad30 0x7f1d7806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:21.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.012+0000 7f1d8a7fc700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d7806ad30 0x7f1d7806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:21.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.012+0000 7f1d8a7fc700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d7806ad30 0x7f1d7806d1e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0c8c20 tx=0x7f1d7c009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:21.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.232+0000 7f1d737fe700 1 -- 172.21.15.118:0/581095875 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d8002c3b0 con 0x7f1d8c0b36d0 2023-07-13T14:20:21.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.258+0000 7f1d737fe700 1 -- 172.21.15.118:0/581095875 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d80055830 con 0x7f1d8c0b36d0 2023-07-13T14:20:21.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.444+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1d8c0ca4f0 con 0x7f1d8c0b36d0 2023-07-13T14:20:21.440 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.449+0000 7f1d737fe700 1 -- 172.21.15.118:0/581095875 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1d80015020 con 0x7f1d8c0b36d0 2023-07-13T14:20:21.441 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-07-13T14:20:21.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d7806ad30 msgr2=0x7f1d7806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:21.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d7806ad30 0x7f1d7806d1e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0c8c20 tx=0x7f1d7c009210 comp rx=0 tx=0).stop 2023-07-13T14:20:21.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0b36d0 msgr2=0x7f1d8c1eeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:21.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0b36d0 0x7f1d8c1eeac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009c40 tx=0x7f1d80004750 comp rx=0 tx=0).stop 2023-07-13T14:20:21.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 shutdown_connections 2023-07-13T14:20:21.443 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1d7806ad30 0x7f1d7806d1e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d8c0ce7e0 0x7f1d8c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d8c0b36d0 0x7f1d8c1eeac0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 --2- 172.21.15.118:0/581095875 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d8c0b3aa0 0x7f1d8c0cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 >> 172.21.15.118:0/581095875 conn(0x7f1d8c071840 msgr2=0x7f1d8c159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:21.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 shutdown_connections 2023-07-13T14:20:21.444 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.451+0000 7f1d91696700 1 -- 172.21.15.118:0/581095875 wait complete. 2023-07-13T14:20:21.455 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-13T14:20:21.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.587+0000 7f41d3b69700 1 Processor -- start 2023-07-13T14:20:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.587+0000 7f41d3b69700 1 -- start start 2023-07-13T14:20:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.588+0000 7f41d3b69700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f41cc070570 0x7f41cc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:21.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.588+0000 7f41d3b69700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc14ecc0 0x7f41cc070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:21.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.588+0000 7f41d3b69700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f41cc06abc0 0x7f41cc154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:21.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.588+0000 7f41d3b69700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc070e80 con 0x7f41cc06abc0 2023-07-13T14:20:21.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.588+0000 7f41d3b69700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0c7040 con 0x7f41cc070570 2023-07-13T14:20:21.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.588+0000 7f41d3b69700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0c7320 con 0x7f41cc14ecc0 2023-07-13T14:20:21.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.589+0000 7f41d2106700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f41cc06abc0 0x7f41cc154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:21.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.589+0000 7f41d1104700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc14ecc0 0x7f41cc070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:21.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.589+0000 7f41d1905700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f41cc070570 0x7f41cc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:21.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.589+0000 7f41d2106700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f41cc06abc0 0x7f41cc154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43666/0 (socket says 172.21.15.118:43666) 2023-07-13T14:20:21.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.589+0000 7f41d2106700 1 -- 172.21.15.118:0/3788127969 learned_addr learned my addr 172.21.15.118:0/3788127969 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:21.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.592+0000 7f41d2106700 1 -- 172.21.15.118:0/3788127969 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc14ecc0 msgr2=0x7f41cc070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:21.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.592+0000 7f41d2106700 1 --2- 172.21.15.118:0/3788127969 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc14ecc0 0x7f41cc070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.592+0000 7f41d2106700 1 -- 172.21.15.118:0/3788127969 >> v2:172.21.15.123:3300/0 conn(0x7f41cc070570 msgr2=0x7f41cc0710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:21.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.592+0000 7f41d2106700 1 --2- 172.21.15.118:0/3788127969 >> v2:172.21.15.123:3300/0 conn(0x7f41cc070570 0x7f41cc0710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.592+0000 7f41d2106700 1 -- 172.21.15.118:0/3788127969 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc0c7600 con 0x7f41cc06abc0 2023-07-13T14:20:21.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.594+0000 7f41d2106700 1 --2- 172.21.15.118:0/3788127969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc06abc0 0x7f41cc154cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f41cc06fd90 tx=0x7f41c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71125e6f15d96de server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.598+0000 7f41d0903700 1 -- 172.21.15.118:0/3788127969 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400b910 con 0x7f41cc06abc0 2023-07-13T14:20:21.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.598+0000 7f41d0903700 1 -- 172.21.15.118:0/3788127969 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c400ba70 con 0x7f41cc06abc0 2023-07-13T14:20:21.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.598+0000 7f41d0903700 1 -- 172.21.15.118:0/3788127969 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400be20 con 0x7f41cc06abc0 2023-07-13T14:20:21.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 -- 172.21.15.118:0/3788127969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc06abc0 msgr2=0x7f41cc154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 --2- 172.21.15.118:0/3788127969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc06abc0 0x7f41cc154cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f41cc06fd90 tx=0x7f41c400b330 comp rx=0 tx=0).stop 2023-07-13T14:20:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 -- 172.21.15.118:0/3788127969 shutdown_connections 2023-07-13T14:20:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 --2- 172.21.15.118:0/3788127969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc06abc0 0x7f41cc154cb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 --2- 172.21.15.118:0/3788127969 >> v2:172.21.15.123:3300/0 conn(0x7f41cc070570 0x7f41cc0710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 --2- 172.21.15.118:0/3788127969 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc14ecc0 0x7f41cc070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 -- 172.21.15.118:0/3788127969 >> 172.21.15.118:0/3788127969 conn(0x7f41cc06bac0 msgr2=0x7f41cc06bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 -- 172.21.15.118:0/3788127969 shutdown_connections 2023-07-13T14:20:21.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.599+0000 7f41d3b69700 1 -- 172.21.15.118:0/3788127969 wait complete. 2023-07-13T14:20:21.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.600+0000 7f41d3b69700 1 Processor -- start 2023-07-13T14:20:21.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.600+0000 7f41d3b69700 1 -- start start 2023-07-13T14:20:21.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.601+0000 7f41d3b69700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc06abc0 0x7f41cc151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:21.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.601+0000 7f41d3b69700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41cc070570 0x7f41cc0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:21.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.601+0000 7f41d3b69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc14ecc0 0x7f41cc1ea990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:21.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.601+0000 7f41d3b69700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc151820 con 0x7f41cc14ecc0 2023-07-13T14:20:21.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.601+0000 7f41d3b69700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc1ea500 con 0x7f41cc070570 2023-07-13T14:20:21.593 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.601+0000 7f41d3b69700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc151280 con 0x7f41cc06abc0 2023-07-13T14:20:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.601+0000 7f41d2106700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc14ecc0 0x7f41cc1ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.602+0000 7f41d2106700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc14ecc0 0x7f41cc1ea990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43674/0 (socket says 172.21.15.118:43674) 2023-07-13T14:20:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.602+0000 7f41d2106700 1 -- 172.21.15.118:0/2669374973 learned_addr learned my addr 172.21.15.118:0/2669374973 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.602+0000 7f41d1905700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc06abc0 0x7f41cc151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:21.594 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.602+0000 7f41d1104700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41cc070570 0x7f41cc0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:21.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.606+0000 7f41d2106700 1 -- 172.21.15.118:0/2669374973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc06abc0 msgr2=0x7f41cc151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:21.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.606+0000 7f41d2106700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc06abc0 0x7f41cc151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.606+0000 7f41d2106700 1 -- 172.21.15.118:0/2669374973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41cc070570 msgr2=0x7f41cc0c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:21.597 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.606+0000 7f41d2106700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41cc070570 0x7f41cc0c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:21.598 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.606+0000 7f41d2106700 1 -- 172.21.15.118:0/2669374973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4009b30 con 0x7f41cc14ecc0 2023-07-13T14:20:21.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.608+0000 7f41d2106700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc14ecc0 0x7f41cc1ea990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41c4014040 tx=0x7f41c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.612+0000 7f41c27fc700 1 -- 172.21.15.118:0/2669374973 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400b910 con 0x7f41cc14ecc0 2023-07-13T14:20:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.612+0000 7f41c27fc700 1 -- 172.21.15.118:0/2669374973 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c40092e0 con 0x7f41cc14ecc0 2023-07-13T14:20:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.612+0000 7f41c27fc700 1 -- 172.21.15.118:0/2669374973 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4004470 con 0x7f41cc14ecc0 2023-07-13T14:20:21.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.612+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc151540 con 0x7f41cc14ecc0 2023-07-13T14:20:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.612+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc1ea190 con 0x7f41cc14ecc0 2023-07-13T14:20:21.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.613+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc1ea6b0 con 0x7f41cc14ecc0 2023-07-13T14:20:21.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.636+0000 7f41c27fc700 1 -- 172.21.15.118:0/2669374973 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41c40045d0 con 0x7f41cc14ecc0 2023-07-13T14:20:21.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.636+0000 7f41c27fc700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f41b006ace0 0x7f41b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:21.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.636+0000 7f41d1905700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f41b006ace0 0x7f41b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:21.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.637+0000 7f41d1905700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f41b006ace0 0x7f41b006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009b60 tx=0x7f41bc009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:21.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.700+0000 7f41c27fc700 1 -- 172.21.15.118:0/2669374973 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f41c405d190 con 0x7f41cc14ecc0 2023-07-13T14:20:21.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:21.895+0000 7f41c27fc700 1 -- 172.21.15.118:0/2669374973 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41c4058fa0 con 0x7f41cc14ecc0 2023-07-13T14:20:22.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.099+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41cc1ea6b0 con 0x7f41cc14ecc0 2023-07-13T14:20:22.102 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.111+0000 7f41c27fc700 1 -- 172.21.15.118:0/2669374973 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41c4029020 con 0x7f41cc14ecc0 2023-07-13T14:20:22.103 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T14:20:22.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f41b006ace0 msgr2=0x7f41b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f41b006ace0 0x7f41b006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009b60 tx=0x7f41bc009210 comp rx=0 tx=0).stop 2023-07-13T14:20:22.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc14ecc0 msgr2=0x7f41cc1ea990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc14ecc0 0x7f41cc1ea990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f41c4014040 tx=0x7f41c4004ad0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 shutdown_connections 2023-07-13T14:20:22.106 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f41b006ace0 0x7f41b006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41cc14ecc0 0x7f41cc1ea990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f41cc06abc0 0x7f41cc151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 --2- 172.21.15.118:0/2669374973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41cc070570 0x7f41cc0c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 >> 172.21.15.118:0/2669374973 conn(0x7f41cc06bac0 msgr2=0x7f41cc152b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:22.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 shutdown_connections 2023-07-13T14:20:22.107 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.114+0000 7f41d3b69700 1 -- 172.21.15.118:0/2669374973 wait complete. 2023-07-13T14:20:22.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-13T14:20:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.254+0000 7f49e41c3700 1 Processor -- start 2023-07-13T14:20:22.246 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.255+0000 7f49e41c3700 1 -- start start 2023-07-13T14:20:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e41c3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49dc070570 0x7f49dc0710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e41c3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49dc14ecc0 0x7f49dc070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e41c3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc06abc0 0x7f49dc154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.247 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e41c3700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc070e80 con 0x7f49dc14ecc0 2023-07-13T14:20:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e41c3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc0c7040 con 0x7f49dc070570 2023-07-13T14:20:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e41c3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0c7320 con 0x7f49dc06abc0 2023-07-13T14:20:22.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e175e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49dc14ecc0 0x7f49dc070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e2760700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc06abc0 0x7f49dc154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.256+0000 7f49e1f5f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49dc070570 0x7f49dc0710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.257+0000 7f49e1f5f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49dc070570 0x7f49dc0710b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:60512/0 (socket says 172.21.15.118:60512) 2023-07-13T14:20:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.257+0000 7f49e2760700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc06abc0 0x7f49dc154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:56188/0 (socket says 172.21.15.118:56188) 2023-07-13T14:20:22.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.257+0000 7f49e1f5f700 1 -- 172.21.15.118:0/1869802619 learned_addr learned my addr 172.21.15.118:0/1869802619 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:22.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.259+0000 7f49e1f5f700 1 -- 172.21.15.118:0/1869802619 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc06abc0 msgr2=0x7f49dc154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:22.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.259+0000 7f49e1f5f700 1 --2- 172.21.15.118:0/1869802619 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc06abc0 0x7f49dc154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.259+0000 7f49e1f5f700 1 -- 172.21.15.118:0/1869802619 >> v2:172.21.15.118:3300/0 conn(0x7f49dc14ecc0 msgr2=0x7f49dc070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:22.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.259+0000 7f49e1f5f700 1 --2- 172.21.15.118:0/1869802619 >> v2:172.21.15.118:3300/0 conn(0x7f49dc14ecc0 0x7f49dc070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.251 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.259+0000 7f49e1f5f700 1 -- 172.21.15.118:0/1869802619 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0c7600 con 0x7f49dc070570 2023-07-13T14:20:22.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.261+0000 7f49e1f5f700 1 --2- 172.21.15.118:0/1869802619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc070570 0x7f49dc0710b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f49dc06fd90 tx=0x7f49cc00be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c63f70bbc509e48a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:22.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.265+0000 7f49e0f5d700 1 -- 172.21.15.118:0/1869802619 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00db60 con 0x7f49dc070570 2023-07-13T14:20:22.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.265+0000 7f49e0f5d700 1 -- 172.21.15.118:0/1869802619 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc00dcc0 con 0x7f49dc070570 2023-07-13T14:20:22.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.265+0000 7f49e0f5d700 1 -- 172.21.15.118:0/1869802619 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc017630 con 0x7f49dc070570 2023-07-13T14:20:22.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 -- 172.21.15.118:0/1869802619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc070570 msgr2=0x7f49dc0710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1869802619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc070570 0x7f49dc0710b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f49dc06fd90 tx=0x7f49cc00be70 comp rx=0 tx=0).stop 2023-07-13T14:20:22.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 -- 172.21.15.118:0/1869802619 shutdown_connections 2023-07-13T14:20:22.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1869802619 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc06abc0 0x7f49dc154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1869802619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc070570 0x7f49dc0710b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1869802619 >> v2:172.21.15.118:3300/0 conn(0x7f49dc14ecc0 0x7f49dc070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 -- 172.21.15.118:0/1869802619 >> 172.21.15.118:0/1869802619 conn(0x7f49dc06bac0 msgr2=0x7f49dc06bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:22.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 -- 172.21.15.118:0/1869802619 shutdown_connections 2023-07-13T14:20:22.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.266+0000 7f49e41c3700 1 -- 172.21.15.118:0/1869802619 wait complete. 2023-07-13T14:20:22.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.267+0000 7f49e41c3700 1 Processor -- start 2023-07-13T14:20:22.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.268+0000 7f49e41c3700 1 -- start start 2023-07-13T14:20:22.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.268+0000 7f49e41c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc06abc0 0x7f49dc158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.268+0000 7f49e41c3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49dc070570 0x7f49dc155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.268+0000 7f49e41c3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc14ecc0 0x7f49dc148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.268+0000 7f49e41c3700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0ca340 con 0x7f49dc070570 2023-07-13T14:20:22.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.268+0000 7f49e41c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc1ead40 con 0x7f49dc06abc0 2023-07-13T14:20:22.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.268+0000 7f49e41c3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc1ea410 con 0x7f49dc14ecc0 2023-07-13T14:20:22.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.269+0000 7f49e175e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49dc070570 0x7f49dc155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.269+0000 7f49e1f5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc06abc0 0x7f49dc158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.269+0000 7f49e2760700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc14ecc0 0x7f49dc148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.269+0000 7f49e175e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49dc070570 0x7f49dc155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43682/0 (socket says 172.21.15.118:43682) 2023-07-13T14:20:22.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.269+0000 7f49e175e700 1 -- 172.21.15.118:0/1749251578 learned_addr learned my addr 172.21.15.118:0/1749251578 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:22.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.273+0000 7f49e1f5f700 1 -- 172.21.15.118:0/1749251578 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc14ecc0 msgr2=0x7f49dc148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.273+0000 7f49e1f5f700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc14ecc0 0x7f49dc148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.273+0000 7f49e1f5f700 1 -- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49dc070570 msgr2=0x7f49dc155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.273+0000 7f49e1f5f700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49dc070570 0x7f49dc155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.273+0000 7f49e1f5f700 1 -- 172.21.15.118:0/1749251578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc00b7f0 con 0x7f49dc06abc0 2023-07-13T14:20:22.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.275+0000 7f49e1f5f700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc06abc0 0x7f49dc158660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49cc018000 tx=0x7f49cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:22.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.279+0000 7f49d27fc700 1 -- 172.21.15.118:0/1749251578 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc003ab0 con 0x7f49dc06abc0 2023-07-13T14:20:22.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.279+0000 7f49d27fc700 1 -- 172.21.15.118:0/1749251578 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc003c30 con 0x7f49dc06abc0 2023-07-13T14:20:22.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.279+0000 7f49d27fc700 1 -- 172.21.15.118:0/1749251578 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc020440 con 0x7f49dc06abc0 2023-07-13T14:20:22.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.279+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc1ea6f0 con 0x7f49dc06abc0 2023-07-13T14:20:22.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.280+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc14d530 con 0x7f49dc06abc0 2023-07-13T14:20:22.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.280+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc0719c0 con 0x7f49dc06abc0 2023-07-13T14:20:22.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.531+0000 7f49d27fc700 1 -- 172.21.15.118:0/1749251578 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49cc015070 con 0x7f49dc06abc0 2023-07-13T14:20:22.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.532+0000 7f49d27fc700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f49c006ad60 0x7f49c006d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.532+0000 7f49e175e700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f49c006ad60 0x7f49c006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.532+0000 7f49e175e700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f49c006ad60 0x7f49c006d210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49dc152840 tx=0x7f49d8009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:22.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.537+0000 7f49d27fc700 1 -- 172.21.15.118:0/1749251578 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f49cc060020 con 0x7f49dc06abc0 2023-07-13T14:20:22.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.550+0000 7f49d27fc700 1 -- 172.21.15.118:0/1749251578 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49cc0583a0 con 0x7f49dc06abc0 2023-07-13T14:20:22.728 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.736+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49dc04e280 con 0x7f49dc06abc0 2023-07-13T14:20:22.735 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.744+0000 7f49d27fc700 1 -- 172.21.15.118:0/1749251578 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49cc0250a0 con 0x7f49dc06abc0 2023-07-13T14:20:22.735 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2023-07-13T14:20:22.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f49c006ad60 msgr2=0x7f49c006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f49c006ad60 0x7f49c006d210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49dc152840 tx=0x7f49d8009210 comp rx=0 tx=0).stop 2023-07-13T14:20:22.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc06abc0 msgr2=0x7f49dc158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc06abc0 0x7f49dc158660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49cc018000 tx=0x7f49cc004750 comp rx=0 tx=0).stop 2023-07-13T14:20:22.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 shutdown_connections 2023-07-13T14:20:22.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f49c006ad60 0x7f49c006d210 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49dc06abc0 0x7f49dc158660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.738 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f49dc14ecc0 0x7f49dc148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 --2- 172.21.15.118:0/1749251578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49dc070570 0x7f49dc155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 >> 172.21.15.118:0/1749251578 conn(0x7f49dc06bac0 msgr2=0x7f49dc154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 shutdown_connections 2023-07-13T14:20:22.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.746+0000 7f49e41c3700 1 -- 172.21.15.118:0/1749251578 wait complete. 2023-07-13T14:20:22.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-13T14:20:22.873 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.882+0000 7f99adbe1700 1 Processor -- start 2023-07-13T14:20:22.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.882+0000 7f99adbe1700 1 -- start start 2023-07-13T14:20:22.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.883+0000 7f99adbe1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f99a80c8370 0x7f99a80b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.883+0000 7f99adbe1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a815c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.883+0000 7f99adbe1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80c8740 con 0x7f99a8158870 2023-07-13T14:20:22.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.883+0000 7f99adbe1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a80b3180 con 0x7f99a80c8370 2023-07-13T14:20:22.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.883+0000 7f99adbe1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80c9180 con 0x7f99a80ca880 2023-07-13T14:20:22.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.884+0000 7f99a77fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f99a80c8370 0x7f99a80b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.884+0000 7f99a6ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.884+0000 7f99a6ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a815c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:56212/0 (socket says 172.21.15.118:56212) 2023-07-13T14:20:22.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.884+0000 7f99a6ffd700 1 -- 172.21.15.118:0/3663612453 learned_addr learned my addr 172.21.15.118:0/3663612453 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:22.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.887+0000 7f99a6ffd700 1 -- 172.21.15.118:0/3663612453 >> v2:172.21.15.123:3300/0 conn(0x7f99a80c8370 msgr2=0x7f99a80b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:22.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.887+0000 7f99a6ffd700 1 --2- 172.21.15.118:0/3663612453 >> v2:172.21.15.123:3300/0 conn(0x7f99a80c8370 0x7f99a80b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.887+0000 7f99a6ffd700 1 -- 172.21.15.118:0/3663612453 >> v1:172.21.15.123:6789/0 conn(0x7f99a8158870 legacy=0x7f99a80c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.887+0000 7f99a6ffd700 1 -- 172.21.15.118:0/3663612453 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a815be80 con 0x7f99a80ca880 2023-07-13T14:20:22.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.889+0000 7f99a6ffd700 1 --2- 172.21.15.118:0/3663612453 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a815c920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99980098f0 tx=0x7f9998009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330c0210e6880393 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:22.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.891+0000 7f99a67fc700 1 -- 172.21.15.118:0/3663612453 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998011830 con 0x7f99a80ca880 2023-07-13T14:20:22.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99a67fc700 1 -- 172.21.15.118:0/3663612453 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998011990 con 0x7f99a80ca880 2023-07-13T14:20:22.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99a67fc700 1 -- 172.21.15.118:0/3663612453 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998011d20 con 0x7f99a80ca880 2023-07-13T14:20:22.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99adbe1700 1 -- 172.21.15.118:0/3663612453 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 msgr2=0x7f99a815c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99adbe1700 1 --2- 172.21.15.118:0/3663612453 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a815c920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99980098f0 tx=0x7f9998009c00 comp rx=0 tx=0).stop 2023-07-13T14:20:22.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99adbe1700 1 -- 172.21.15.118:0/3663612453 shutdown_connections 2023-07-13T14:20:22.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99adbe1700 1 --2- 172.21.15.118:0/3663612453 >> v2:172.21.15.123:3300/0 conn(0x7f99a80c8370 0x7f99a80b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99adbe1700 1 --2- 172.21.15.118:0/3663612453 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a815c920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99adbe1700 1 -- 172.21.15.118:0/3663612453 >> 172.21.15.118:0/3663612453 conn(0x7f99a8065af0 msgr2=0x7f99a8065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:22.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99adbe1700 1 -- 172.21.15.118:0/3663612453 shutdown_connections 2023-07-13T14:20:22.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.893+0000 7f99adbe1700 1 -- 172.21.15.118:0/3663612453 wait complete. 2023-07-13T14:20:22.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.895+0000 7f99adbe1700 1 Processor -- start 2023-07-13T14:20:22.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.895+0000 7f99adbe1700 1 -- start start 2023-07-13T14:20:22.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.896+0000 7f99adbe1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99a80c8370 0x7f99a80cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.896+0000 7f99adbe1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.896+0000 7f99adbe1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99a8158870 0x7f99a814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:22.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.896+0000 7f99adbe1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81e1b70 con 0x7f99a8158870 2023-07-13T14:20:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.896+0000 7f99adbe1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81f18f0 con 0x7f99a80c8370 2023-07-13T14:20:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.896+0000 7f99adbe1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81f1bd0 con 0x7f99a80ca880 2023-07-13T14:20:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.896+0000 7f99a77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99a80c8370 0x7f99a80cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.897+0000 7f99a6ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.897+0000 7f99a7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99a8158870 0x7f99a814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.897+0000 7f99a77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99a80c8370 0x7f99a80cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:60536/0 (socket says 172.21.15.118:60536) 2023-07-13T14:20:22.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.897+0000 7f99a77fe700 1 -- 172.21.15.118:0/1888791669 learned_addr learned my addr 172.21.15.118:0/1888791669 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.900+0000 7f99a77fe700 1 -- 172.21.15.118:0/1888791669 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 msgr2=0x7f99a814e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.900+0000 7f99a77fe700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a814e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.900+0000 7f99a77fe700 1 -- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99a8158870 msgr2=0x7f99a814ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.900+0000 7f99a77fe700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99a8158870 0x7f99a814ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:22.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.900+0000 7f99a77fe700 1 -- 172.21.15.118:0/1888791669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009550 con 0x7f99a80c8370 2023-07-13T14:20:22.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.903+0000 7f99a77fe700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99a80c8370 0x7f99a80cd600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f999c00e9b0 tx=0x7f999c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:22.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.907+0000 7f998ffff700 1 -- 172.21.15.118:0/1888791669 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c009710 con 0x7f99a80c8370 2023-07-13T14:20:22.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.908+0000 7f998ffff700 1 -- 172.21.15.118:0/1888791669 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c00ee50 con 0x7f99a80c8370 2023-07-13T14:20:22.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.908+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a81f1eb0 con 0x7f99a80c8370 2023-07-13T14:20:22.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.908+0000 7f998ffff700 1 -- 172.21.15.118:0/1888791669 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c00ca50 con 0x7f99a80c8370 2023-07-13T14:20:22.899 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.908+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a81f2470 con 0x7f99a80c8370 2023-07-13T14:20:22.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:22.908+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a81f2660 con 0x7f99a80c8370 2023-07-13T14:20:23.104 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.113+0000 7f998ffff700 1 -- 172.21.15.118:0/1888791669 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f999c00cbb0 con 0x7f99a80c8370 2023-07-13T14:20:23.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.113+0000 7f998ffff700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f999406ad10 0x7f999406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:23.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.113+0000 7f99a6ffd700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f999406ad10 0x7f999406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:23.105 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.114+0000 7f99a6ffd700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f999406ad10 0x7f999406d1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9998009c40 tx=0x7f9998008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:23.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.159+0000 7f998ffff700 1 -- 172.21.15.118:0/1888791669 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f999c05c970 con 0x7f99a80c8370 2023-07-13T14:20:23.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.173+0000 7f998ffff700 1 -- 172.21.15.118:0/1888791669 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f999c058780 con 0x7f99a80c8370 2023-07-13T14:20:23.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.384+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f99a804e280 con 0x7f99a80c8370 2023-07-13T14:20:23.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.390+0000 7f998ffff700 1 -- 172.21.15.118:0/1888791669 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f999c0170a0 con 0x7f99a80c8370 2023-07-13T14:20:23.381 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T14:20:23.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f999406ad10 msgr2=0x7f999406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:23.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f999406ad10 0x7f999406d1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9998009c40 tx=0x7f9998008030 comp rx=0 tx=0).stop 2023-07-13T14:20:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99a80c8370 msgr2=0x7f99a80cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99a80c8370 0x7f99a80cd600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f999c00e9b0 tx=0x7f999c00ecc0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 shutdown_connections 2023-07-13T14:20:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f999406ad10 0x7f999406d1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99a80c8370 0x7f99a80cd600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99a8158870 0x7f99a814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 --2- 172.21.15.118:0/1888791669 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99a80ca880 0x7f99a814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 >> 172.21.15.118:0/1888791669 conn(0x7f99a8065af0 msgr2=0x7f99a8150ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 shutdown_connections 2023-07-13T14:20:23.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.392+0000 7f99adbe1700 1 -- 172.21.15.118:0/1888791669 wait complete. 2023-07-13T14:20:23.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-13T14:20:23.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.528+0000 7f0a719ea700 1 Processor -- start 2023-07-13T14:20:23.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.528+0000 7f0a719ea700 1 -- start start 2023-07-13T14:20:23.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.529+0000 7f0a719ea700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a6c14eeb0 0x7f0a6c155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:23.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.529+0000 7f0a719ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c06a360 0x7f0a6c071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:23.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.529+0000 7f0a719ea700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c155aa0 con 0x7f0a6c069f30 2023-07-13T14:20:23.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.529+0000 7f0a719ea700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c56b0 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.529+0000 7f0a719ea700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c14f280 con 0x7f0a6c06a360 2023-07-13T14:20:23.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.530+0000 7f0a6affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a6c14eeb0 0x7f0a6c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:23.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.530+0000 7f0a6b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c06a360 0x7f0a6c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:23.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.530+0000 7f0a6b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c06a360 0x7f0a6c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:56228/0 (socket says 172.21.15.118:56228) 2023-07-13T14:20:23.522 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.530+0000 7f0a6b7fe700 1 -- 172.21.15.118:0/262665776 learned_addr learned my addr 172.21.15.118:0/262665776 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:23.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.534+0000 7f0a6b7fe700 1 -- 172.21.15.118:0/262665776 >> v2:172.21.15.123:3300/0 conn(0x7f0a6c14eeb0 msgr2=0x7f0a6c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:23.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.534+0000 7f0a6b7fe700 1 --2- 172.21.15.118:0/262665776 >> v2:172.21.15.123:3300/0 conn(0x7f0a6c14eeb0 0x7f0a6c155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.534+0000 7f0a6b7fe700 1 -- 172.21.15.118:0/262665776 >> v1:172.21.15.123:6789/0 conn(0x7f0a6c069f30 legacy=0x7f0a6c070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:23.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.534+0000 7f0a6b7fe700 1 -- 172.21.15.118:0/262665776 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0c73f0 con 0x7f0a6c06a360 2023-07-13T14:20:23.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.536+0000 7f0a6b7fe700 1 --2- 172.21.15.118:0/262665776 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c06a360 0x7f0a6c071570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009e50 tx=0x7f0a6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3edcf2093c66b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:23.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.540+0000 7f0a69ffb700 1 -- 172.21.15.118:0/262665776 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400e070 con 0x7f0a6c06a360 2023-07-13T14:20:23.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.540+0000 7f0a69ffb700 1 -- 172.21.15.118:0/262665776 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6400b910 con 0x7f0a6c06a360 2023-07-13T14:20:23.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.540+0000 7f0a69ffb700 1 -- 172.21.15.118:0/262665776 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400bcc0 con 0x7f0a6c06a360 2023-07-13T14:20:23.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.541+0000 7f0a719ea700 1 -- 172.21.15.118:0/262665776 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c06a360 msgr2=0x7f0a6c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:23.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.541+0000 7f0a719ea700 1 --2- 172.21.15.118:0/262665776 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c06a360 0x7f0a6c071570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009e50 tx=0x7f0a6400b330 comp rx=0 tx=0).stop 2023-07-13T14:20:23.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.541+0000 7f0a719ea700 1 -- 172.21.15.118:0/262665776 shutdown_connections 2023-07-13T14:20:23.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.541+0000 7f0a719ea700 1 --2- 172.21.15.118:0/262665776 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c06a360 0x7f0a6c071570 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.541+0000 7f0a719ea700 1 --2- 172.21.15.118:0/262665776 >> v2:172.21.15.123:3300/0 conn(0x7f0a6c14eeb0 0x7f0a6c155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.541+0000 7f0a719ea700 1 -- 172.21.15.118:0/262665776 >> 172.21.15.118:0/262665776 conn(0x7f0a6c0cb880 msgr2=0x7f0a6c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:23.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.541+0000 7f0a719ea700 1 -- 172.21.15.118:0/262665776 shutdown_connections 2023-07-13T14:20:23.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.541+0000 7f0a719ea700 1 -- 172.21.15.118:0/262665776 wait complete. 2023-07-13T14:20:23.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.542+0000 7f0a719ea700 1 Processor -- start 2023-07-13T14:20:23.534 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.543+0000 7f0a719ea700 1 -- start start 2023-07-13T14:20:23.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.543+0000 7f0a719ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c069f30 0x7f0a6c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:23.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.543+0000 7f0a719ea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c06a360 0x7f0a6c14c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:23.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.543+0000 7f0a719ea700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a6c14eeb0 0x7f0a6c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:23.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.543+0000 7f0a719ea700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c150e90 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.543+0000 7f0a719ea700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c150000 con 0x7f0a6c06a360 2023-07-13T14:20:23.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.543+0000 7f0a719ea700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c14f4f0 con 0x7f0a6c069f30 2023-07-13T14:20:23.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.544+0000 7f0a6affd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c069f30 0x7f0a6c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:23.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.544+0000 7f0a6a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c06a360 0x7f0a6c14c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:23.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.544+0000 7f0a6b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a6c14eeb0 0x7f0a6c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:23.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.544+0000 7f0a6a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c06a360 0x7f0a6c14c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:60558/0 (socket says 172.21.15.118:60558) 2023-07-13T14:20:23.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.544+0000 7f0a6a7fc700 1 -- 172.21.15.118:0/1702692084 learned_addr learned my addr 172.21.15.118:0/1702692084 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:23.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.544+0000 7f0a6affd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c069f30 0x7f0a6c152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:56240/0 (socket says 172.21.15.118:56240) 2023-07-13T14:20:23.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.549+0000 7f0a6b7fe700 1 -- 172.21.15.118:0/1702692084 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c069f30 msgr2=0x7f0a6c152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:23.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.549+0000 7f0a6b7fe700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c069f30 0x7f0a6c152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.549+0000 7f0a6b7fe700 1 -- 172.21.15.118:0/1702692084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c06a360 msgr2=0x7f0a6c14c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:23.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.549+0000 7f0a6b7fe700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c06a360 0x7f0a6c14c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:23.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.549+0000 7f0a6b7fe700 1 -- 172.21.15.118:0/1702692084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64009b30 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.551+0000 7f0a6b7fe700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a6c14eeb0 0x7f0a6c14d710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a64015000 tx=0x7f0a64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:23.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.555+0000 7f0a53fff700 1 -- 172.21.15.118:0/1702692084 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640099b0 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.555+0000 7f0a53fff700 1 -- 172.21.15.118:0/1702692084 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a640092e0 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.555+0000 7f0a53fff700 1 -- 172.21.15.118:0/1702692084 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64004450 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.555+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c14f760 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.555+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c14fd20 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.556+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c04e280 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.813 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.822+0000 7f0a53fff700 1 -- 172.21.15.118:0/1702692084 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a640045b0 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.822+0000 7f0a53fff700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0a5806ad30 0x7f0a5806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:23.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.823+0000 7f0a53fff700 1 -- 172.21.15.118:0/1702692084 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a6408aee0 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.814 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.823+0000 7f0a6affd700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0a5806ad30 0x7f0a5806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:23.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.823+0000 7f0a53fff700 1 -- 172.21.15.118:0/1702692084 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a6408b2a0 con 0x7f0a6c14eeb0 2023-07-13T14:20:23.815 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:23.823+0000 7f0a6affd700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0a5806ad30 0x7f0a5806d1e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009b40 tx=0x7f0a60009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:24.019 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.028+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0a6c070a30 con 0x7f0a6c14eeb0 2023-07-13T14:20:24.025 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.034+0000 7f0a53fff700 1 -- 172.21.15.118:0/1702692084 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0a64059760 con 0x7f0a6c14eeb0 2023-07-13T14:20:24.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0a5806ad30 msgr2=0x7f0a5806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:24.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0a5806ad30 0x7f0a5806d1e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009b40 tx=0x7f0a60009210 comp rx=0 tx=0).stop 2023-07-13T14:20:24.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a6c14eeb0 msgr2=0x7f0a6c14d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:24.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a6c14eeb0 0x7f0a6c14d710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a64015000 tx=0x7f0a64004ad0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 shutdown_connections 2023-07-13T14:20:24.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f0a5806ad30 0x7f0a5806d1e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0a6c14eeb0 0x7f0a6c14d710 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.028 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a6c069f30 0x7f0a6c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 --2- 172.21.15.118:0/1702692084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c06a360 0x7f0a6c14c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 >> 172.21.15.118:0/1702692084 conn(0x7f0a6c0cb880 msgr2=0x7f0a6c06a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:24.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 shutdown_connections 2023-07-13T14:20:24.029 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.036+0000 7f0a719ea700 1 -- 172.21.15.118:0/1702692084 wait complete. 2023-07-13T14:20:24.029 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2023-07-13T14:20:24.039 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-07-13T14:20:24.040 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-13T14:20:24.058 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T14:20:24.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.232+0000 7f5672633700 1 Processor -- start 2023-07-13T14:20:24.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.232+0000 7f5672633700 1 -- start start 2023-07-13T14:20:24.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.233+0000 7f5672633700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f566c06a1a0 0x7f566c159460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.233+0000 7f5672633700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f566c06a570 0x7f566c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.233+0000 7f5672633700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c070e90 0x7f566c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.233+0000 7f5672633700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c1599a0 con 0x7f566c06a570 2023-07-13T14:20:24.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.233+0000 7f5672633700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c155680 con 0x7f566c06a1a0 2023-07-13T14:20:24.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.233+0000 7f5672633700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0c2740 con 0x7f566c070e90 2023-07-13T14:20:24.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.257+0000 7f566bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f566c06a1a0 0x7f566c159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:24.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.258+0000 7f566bfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f566c06a1a0 0x7f566c159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:60568/0 (socket says 172.21.15.118:60568) 2023-07-13T14:20:24.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.258+0000 7f566bfff700 1 -- 172.21.15.118:0/4083119017 learned_addr learned my addr 172.21.15.118:0/4083119017 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:24.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.261+0000 7f566bfff700 1 -- 172.21.15.118:0/4083119017 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c070e90 msgr2=0x7f566c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:24.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.261+0000 7f566bfff700 1 --2- 172.21.15.118:0/4083119017 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c070e90 0x7f566c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.261+0000 7f566bfff700 1 -- 172.21.15.118:0/4083119017 >> v2:172.21.15.118:3300/0 conn(0x7f566c06a570 msgr2=0x7f566c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:24.252 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.261+0000 7f566bfff700 1 --2- 172.21.15.118:0/4083119017 >> v2:172.21.15.118:3300/0 conn(0x7f566c06a570 0x7f566c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.253 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.261+0000 7f566bfff700 1 -- 172.21.15.118:0/4083119017 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0bdb70 con 0x7f566c06a1a0 2023-07-13T14:20:24.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.263+0000 7f566bfff700 1 --2- 172.21.15.118:0/4083119017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c06a1a0 0x7f566c159460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f566c0730a0 tx=0x7f565c00be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98634adf5c066af6 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:24.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.267+0000 7f566affd700 1 -- 172.21.15.118:0/4083119017 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00dd30 con 0x7f566c06a1a0 2023-07-13T14:20:24.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.267+0000 7f566affd700 1 -- 172.21.15.118:0/4083119017 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c00de90 con 0x7f566c06a1a0 2023-07-13T14:20:24.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.267+0000 7f566affd700 1 -- 172.21.15.118:0/4083119017 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c010690 con 0x7f566c06a1a0 2023-07-13T14:20:24.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 -- 172.21.15.118:0/4083119017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c06a1a0 msgr2=0x7f566c159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:24.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 --2- 172.21.15.118:0/4083119017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c06a1a0 0x7f566c159460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f566c0730a0 tx=0x7f565c00be70 comp rx=0 tx=0).stop 2023-07-13T14:20:24.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 -- 172.21.15.118:0/4083119017 shutdown_connections 2023-07-13T14:20:24.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 --2- 172.21.15.118:0/4083119017 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c070e90 0x7f566c14f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 --2- 172.21.15.118:0/4083119017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c06a1a0 0x7f566c159460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 --2- 172.21.15.118:0/4083119017 >> v2:172.21.15.118:3300/0 conn(0x7f566c06a570 0x7f566c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 -- 172.21.15.118:0/4083119017 >> 172.21.15.118:0/4083119017 conn(0x7f566c071c30 msgr2=0x7f566c072030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:24.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 -- 172.21.15.118:0/4083119017 shutdown_connections 2023-07-13T14:20:24.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.268+0000 7f5672633700 1 -- 172.21.15.118:0/4083119017 wait complete. 2023-07-13T14:20:24.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.269+0000 7f5672633700 1 Processor -- start 2023-07-13T14:20:24.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.270+0000 7f5672633700 1 -- start start 2023-07-13T14:20:24.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.270+0000 7f5672633700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c06a1a0 0x7f566c148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.270+0000 7f5672633700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f566c06a570 0x7f566c146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.270+0000 7f5672633700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c070e90 0x7f566c145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.270+0000 7f5672633700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c143040 con 0x7f566c06a570 2023-07-13T14:20:24.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.270+0000 7f5672633700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c143250 con 0x7f566c070e90 2023-07-13T14:20:24.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.270+0000 7f5672633700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c143530 con 0x7f566c06a1a0 2023-07-13T14:20:24.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.271+0000 7f5670bd0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c070e90 0x7f566c145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:24.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.272+0000 7f5670bd0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c070e90 0x7f566c145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:60574/0 (socket says 172.21.15.118:60574) 2023-07-13T14:20:24.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.272+0000 7f5670bd0700 1 -- 172.21.15.118:0/239906359 learned_addr learned my addr 172.21.15.118:0/239906359 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:24.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.274+0000 7f566bfff700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c06a1a0 0x7f566c148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:24.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.276+0000 7f5670bd0700 1 -- 172.21.15.118:0/239906359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c06a1a0 msgr2=0x7f566c148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:24.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.276+0000 7f5670bd0700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c06a1a0 0x7f566c148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.276+0000 7f5670bd0700 1 -- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f566c06a570 msgr2=0x7f566c146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:24.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.276+0000 7f5670bd0700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f566c06a570 0x7f566c146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.276+0000 7f5670bd0700 1 -- 172.21.15.118:0/239906359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c00b7f0 con 0x7f566c070e90 2023-07-13T14:20:24.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.279+0000 7f5670bd0700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c070e90 0x7f566c145010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f566400b970 tx=0x7f566400bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:24.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.282+0000 7f5668ff9700 1 -- 172.21.15.118:0/239906359 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400c930 con 0x7f566c070e90 2023-07-13T14:20:24.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.282+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c147840 con 0x7f566c070e90 2023-07-13T14:20:24.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.282+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c147e00 con 0x7f566c070e90 2023-07-13T14:20:24.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.282+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c072070 con 0x7f566c070e90 2023-07-13T14:20:24.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.283+0000 7f5668ff9700 1 -- 172.21.15.118:0/239906359 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56640098b0 con 0x7f566c070e90 2023-07-13T14:20:24.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.283+0000 7f5668ff9700 1 -- 172.21.15.118:0/239906359 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400ccb0 con 0x7f566c070e90 2023-07-13T14:20:24.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.550+0000 7f5668ff9700 1 -- 172.21.15.118:0/239906359 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f566401d3b0 con 0x7f566c070e90 2023-07-13T14:20:24.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.550+0000 7f5668ff9700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f565806ace0 0x7f565806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.550+0000 7f566bfff700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f565806ace0 0x7f565806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:24.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.550+0000 7f566bfff700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f565806ace0 0x7f565806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f565c00beb0 tx=0x7f565c01c040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:24.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.555+0000 7f5668ff9700 1 -- 172.21.15.118:0/239906359 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f56640582c0 con 0x7f566c070e90 2023-07-13T14:20:24.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.566+0000 7f5668ff9700 1 -- 172.21.15.118:0/239906359 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5664058090 con 0x7f566c070e90 2023-07-13T14:20:24.768 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.777+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f566c156260 con 0x7f566c070e90 2023-07-13T14:20:24.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.861+0000 7f5668ff9700 1 -- 172.21.15.118:0/239906359 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f5664023090 con 0x7f566c070e90 2023-07-13T14:20:24.853 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:20:24.853 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:57.795549+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.35","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T14:20:24.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f565806ace0 msgr2=0x7f565806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:24.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f565806ace0 0x7f565806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f565c00beb0 tx=0x7f565c01c040 comp rx=0 tx=0).stop 2023-07-13T14:20:24.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c070e90 msgr2=0x7f566c145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:24.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c070e90 0x7f566c145010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f566400b970 tx=0x7f566400bc80 comp rx=0 tx=0).stop 2023-07-13T14:20:24.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 shutdown_connections 2023-07-13T14:20:24.855 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f565806ace0 0x7f565806d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f566c070e90 0x7f566c145010 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f566c06a1a0 0x7f566c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 --2- 172.21.15.118:0/239906359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f566c06a570 0x7f566c146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 >> 172.21.15.118:0/239906359 conn(0x7f566c071c30 msgr2=0x7f566c14af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:24.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 shutdown_connections 2023-07-13T14:20:24.856 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:24.863+0000 7f5672633700 1 -- 172.21.15.118:0/239906359 wait complete. 2023-07-13T14:20:24.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-13T13:51:55.327381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-13T13:51:57.354158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-13T13:52:15.149076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-13T13:52:16.169659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-13T13:52:21.744112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-13T14:20:24.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-13T14:20:24.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.000+0000 7fb258ef9700 1 Processor -- start 2023-07-13T14:20:24.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.000+0000 7fb258ef9700 1 -- start start 2023-07-13T14:20:24.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.001+0000 7fb258ef9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb25414c4c0 0x7fb2540c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.001+0000 7fb258ef9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb25406db50 0x7fb25406ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:24.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.001+0000 7fb258ef9700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25414c890 con 0x7fb25406d3c0 2023-07-13T14:20:24.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.001+0000 7fb258ef9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb254155560 con 0x7fb25414c4c0 2023-07-13T14:20:24.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.001+0000 7fb258ef9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2540c5e70 con 0x7fb25406db50 2023-07-13T14:20:24.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.001+0000 7fb25259c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb25414c4c0 0x7fb2540c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:24.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.001+0000 7fb251d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb25406db50 0x7fb25406ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:24.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.002+0000 7fb251d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb25406db50 0x7fb25406ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:60580/0 (socket says 172.21.15.118:60580) 2023-07-13T14:20:24.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.002+0000 7fb251d9b700 1 -- 172.21.15.118:0/1218783094 learned_addr learned my addr 172.21.15.118:0/1218783094 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:24.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.005+0000 7fb251d9b700 1 -- 172.21.15.118:0/1218783094 >> v2:172.21.15.118:3300/0 conn(0x7fb25414c4c0 msgr2=0x7fb2540c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:24.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.005+0000 7fb251d9b700 1 --2- 172.21.15.118:0/1218783094 >> v2:172.21.15.118:3300/0 conn(0x7fb25414c4c0 0x7fb2540c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:24.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.005+0000 7fb251d9b700 1 -- 172.21.15.118:0/1218783094 >> v1:172.21.15.118:6789/0 conn(0x7fb25406d3c0 legacy=0x7fb2540c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:24.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.005+0000 7fb251d9b700 1 -- 172.21.15.118:0/1218783094 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2540c3f00 con 0x7fb25406db50 2023-07-13T14:20:24.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.007+0000 7fb251d9b700 1 --2- 172.21.15.118:0/1218783094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406db50 0x7fb25406ce80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2440098f0 tx=0x7fb244009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a012966bc85b2ef5 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:25.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.011+0000 7fb25159a700 1 -- 172.21.15.118:0/1218783094 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244011830 con 0x7fb25406db50 2023-07-13T14:20:25.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.011+0000 7fb25159a700 1 -- 172.21.15.118:0/1218783094 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244011990 con 0x7fb25406db50 2023-07-13T14:20:25.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.011+0000 7fb25159a700 1 -- 172.21.15.118:0/1218783094 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244011d20 con 0x7fb25406db50 2023-07-13T14:20:25.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.012+0000 7fb258ef9700 1 -- 172.21.15.118:0/1218783094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406db50 msgr2=0x7fb25406ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.012+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1218783094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406db50 0x7fb25406ce80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb2440098f0 tx=0x7fb244009c00 comp rx=0 tx=0).stop 2023-07-13T14:20:25.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.012+0000 7fb258ef9700 1 -- 172.21.15.118:0/1218783094 shutdown_connections 2023-07-13T14:20:25.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.012+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1218783094 >> v2:172.21.15.118:3300/0 conn(0x7fb25414c4c0 0x7fb2540c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.012+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1218783094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406db50 0x7fb25406ce80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.012+0000 7fb258ef9700 1 -- 172.21.15.118:0/1218783094 >> 172.21.15.118:0/1218783094 conn(0x7fb25406e8b0 msgr2=0x7fb25406ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:25.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.012+0000 7fb258ef9700 1 -- 172.21.15.118:0/1218783094 shutdown_connections 2023-07-13T14:20:25.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.012+0000 7fb258ef9700 1 -- 172.21.15.118:0/1218783094 wait complete. 2023-07-13T14:20:25.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.013+0000 7fb258ef9700 1 Processor -- start 2023-07-13T14:20:25.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.014+0000 7fb258ef9700 1 -- start start 2023-07-13T14:20:25.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.014+0000 7fb258ef9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406d3c0 0x7fb2541db850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.014+0000 7fb258ef9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25406db50 0x7fb2540c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.014+0000 7fb258ef9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb25414c4c0 0x7fb2541ec000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.014+0000 7fb258ef9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541dcd20 con 0x7fb25414c4c0 2023-07-13T14:20:25.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.014+0000 7fb258ef9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541ebbe0 con 0x7fb25406d3c0 2023-07-13T14:20:25.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.014+0000 7fb258ef9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541efe40 con 0x7fb25406db50 2023-07-13T14:20:25.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.015+0000 7fb25259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406d3c0 0x7fb2541db850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.015+0000 7fb251d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25406db50 0x7fb2540c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.015+0000 7fb252d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb25414c4c0 0x7fb2541ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.015+0000 7fb25259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406d3c0 0x7fb2541db850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:60584/0 (socket says 172.21.15.118:60584) 2023-07-13T14:20:25.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.015+0000 7fb25259c700 1 -- 172.21.15.118:0/1871910498 learned_addr learned my addr 172.21.15.118:0/1871910498 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:25.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.019+0000 7fb25259c700 1 -- 172.21.15.118:0/1871910498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25406db50 msgr2=0x7fb2540c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.019+0000 7fb25259c700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25406db50 0x7fb2540c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.019+0000 7fb25259c700 1 -- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb25414c4c0 msgr2=0x7fb2541ec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.019+0000 7fb25259c700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb25414c4c0 0x7fb2541ec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.011 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.019+0000 7fb25259c700 1 -- 172.21.15.118:0/1871910498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244009550 con 0x7fb25406d3c0 2023-07-13T14:20:25.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.022+0000 7fb25259c700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406d3c0 0x7fb2541db850 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00e8d0 tx=0x7fb23c00ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:25.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.026+0000 7fb24affd700 1 -- 172.21.15.118:0/1871910498 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c009590 con 0x7fb25406d3c0 2023-07-13T14:20:25.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.026+0000 7fb24affd700 1 -- 172.21.15.118:0/1871910498 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c013680 con 0x7fb25406d3c0 2023-07-13T14:20:25.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.026+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2541ef2c0 con 0x7fb25406d3c0 2023-07-13T14:20:25.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.026+0000 7fb24affd700 1 -- 172.21.15.118:0/1871910498 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0139f0 con 0x7fb25406d3c0 2023-07-13T14:20:25.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.026+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2541ef880 con 0x7fb25406d3c0 2023-07-13T14:20:25.018 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.027+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2541ebe50 con 0x7fb25406d3c0 2023-07-13T14:20:25.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.049+0000 7fb24affd700 1 -- 172.21.15.118:0/1871910498 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb23c013b50 con 0x7fb25406d3c0 2023-07-13T14:20:25.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.049+0000 7fb24affd700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb23406ace0 0x7fb23406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.049+0000 7fb251d9b700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb23406ace0 0x7fb23406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.049+0000 7fb251d9b700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb23406ace0 0x7fb23406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb244009c40 tx=0x7fb244008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:25.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.181+0000 7fb24affd700 1 -- 172.21.15.118:0/1871910498 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb23c05c870 con 0x7fb25406d3c0 2023-07-13T14:20:25.282 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.292+0000 7fb24affd700 1 -- 172.21.15.118:0/1871910498 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb23c054bf0 con 0x7fb25406d3c0 2023-07-13T14:20:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.478+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb25404e210 con 0x7fb25406d3c0 2023-07-13T14:20:25.475 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.485+0000 7fb24affd700 1 -- 172.21.15.118:0/1871910498 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb23c021020 con 0x7fb25406d3c0 2023-07-13T14:20:25.476 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2023-07-13T14:20:25.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb23406ace0 msgr2=0x7fb23406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb23406ace0 0x7fb23406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb244009c40 tx=0x7fb244008030 comp rx=0 tx=0).stop 2023-07-13T14:20:25.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406d3c0 msgr2=0x7fb2541db850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406d3c0 0x7fb2541db850 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00e8d0 tx=0x7fb23c00ebe0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 shutdown_connections 2023-07-13T14:20:25.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb23406ace0 0x7fb23406d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb25406d3c0 0x7fb2541db850 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb25414c4c0 0x7fb2541ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 --2- 172.21.15.118:0/1871910498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb25406db50 0x7fb2540c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 >> 172.21.15.118:0/1871910498 conn(0x7fb25406e8b0 msgr2=0x7fb25406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:25.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 shutdown_connections 2023-07-13T14:20:25.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.486+0000 7fb258ef9700 1 -- 172.21.15.118:0/1871910498 wait complete. 2023-07-13T14:20:25.490 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-13T14:20:25.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.623+0000 7f981f024700 1 Processor -- start 2023-07-13T14:20:25.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.623+0000 7f981f024700 1 -- start start 2023-07-13T14:20:25.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.624+0000 7f981f024700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f981806fc00 0x7f98180c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.624+0000 7f981f024700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9818159a20 con 0x7f98180c7b30 2023-07-13T14:20:25.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.624+0000 7f981f024700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180c6f90 con 0x7f9818150440 2023-07-13T14:20:25.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.624+0000 7f981f024700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98180c45f0 con 0x7f981806fc00 2023-07-13T14:20:25.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.625+0000 7f9817fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f981806fc00 0x7f98180c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.625+0000 7f981cdc0700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9818150440 0x7f9818156b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:56392/0 (socket says 172.21.15.118:56392) 2023-07-13T14:20:25.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.625+0000 7f981cdc0700 1 -- 172.21.15.118:0/724187647 learned_addr learned my addr 172.21.15.118:0/724187647 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.628+0000 7f98177fe700 1 -- 172.21.15.118:0/724187647 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238888299 0 0) 0x7f980c001110 con 0x7f9818150440 2023-07-13T14:20:25.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.628+0000 7f98177fe700 1 -- 172.21.15.118:0/724187647 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98080035b0 con 0x7f9818150440 2023-07-13T14:20:25.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.628+0000 7f9817fff700 1 -- 172.21.15.118:0/724187647 >> v1:172.21.15.123:6789/0 conn(0x7f9818150440 legacy=0x7f9818156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.628+0000 7f9817fff700 1 -- 172.21.15.118:0/724187647 >> v1:172.21.15.118:6789/0 conn(0x7f98180c7b30 legacy=0x7f9818160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:25.620 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.628+0000 7f9817fff700 1 -- 172.21.15.118:0/724187647 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180c6410 con 0x7f981806fc00 2023-07-13T14:20:25.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.630+0000 7f9817fff700 1 --2- 172.21.15.118:0/724187647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f981806fc00 0x7f98180c39a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9804009840 tx=0x7f9804009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3836698417bb531 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:25.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.635+0000 7f98177fe700 1 -- 172.21.15.118:0/724187647 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804004230 con 0x7f981806fc00 2023-07-13T14:20:25.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.635+0000 7f98177fe700 1 -- 172.21.15.118:0/724187647 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9804004390 con 0x7f981806fc00 2023-07-13T14:20:25.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.635+0000 7f98177fe700 1 -- 172.21.15.118:0/724187647 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98040036c0 con 0x7f981806fc00 2023-07-13T14:20:25.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.636+0000 7f981f024700 1 -- 172.21.15.118:0/724187647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f981806fc00 msgr2=0x7f98180c39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.636+0000 7f981f024700 1 --2- 172.21.15.118:0/724187647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f981806fc00 0x7f98180c39a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9804009840 tx=0x7f9804009b50 comp rx=0 tx=0).stop 2023-07-13T14:20:25.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.636+0000 7f981f024700 1 -- 172.21.15.118:0/724187647 shutdown_connections 2023-07-13T14:20:25.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.636+0000 7f981f024700 1 --2- 172.21.15.118:0/724187647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f981806fc00 0x7f98180c39a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.636+0000 7f981f024700 1 -- 172.21.15.118:0/724187647 >> 172.21.15.118:0/724187647 conn(0x7f981806bac0 msgr2=0x7f981806bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:25.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.636+0000 7f981f024700 1 -- 172.21.15.118:0/724187647 shutdown_connections 2023-07-13T14:20:25.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.636+0000 7f981f024700 1 -- 172.21.15.118:0/724187647 wait complete. 2023-07-13T14:20:25.629 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.637+0000 7f981f024700 1 Processor -- start 2023-07-13T14:20:25.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.637+0000 7f981f024700 1 -- start start 2023-07-13T14:20:25.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.638+0000 7f981f024700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f981806fc00 0x7f9818155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.638+0000 7f981f024700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98180c7b30 0x7f9818154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.638+0000 7f981f024700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9818150440 0x7f98180c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.638+0000 7f981f024700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9818156450 con 0x7f9818150440 2023-07-13T14:20:25.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.638+0000 7f981f024700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9818156070 con 0x7f98180c7b30 2023-07-13T14:20:25.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.638+0000 7f981f024700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98181547f0 con 0x7f981806fc00 2023-07-13T14:20:25.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.639+0000 7f9817fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98180c7b30 0x7f9818154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.639+0000 7f981d5c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9818150440 0x7f98180c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.639+0000 7f981cdc0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f981806fc00 0x7f9818155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.639+0000 7f981d5c1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9818150440 0x7f98180c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43796/0 (socket says 172.21.15.118:43796) 2023-07-13T14:20:25.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.639+0000 7f981d5c1700 1 -- 172.21.15.118:0/3260371535 learned_addr learned my addr 172.21.15.118:0/3260371535 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.643+0000 7f981d5c1700 1 -- 172.21.15.118:0/3260371535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f981806fc00 msgr2=0x7f9818155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.634 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.643+0000 7f981d5c1700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f981806fc00 0x7f9818155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.643+0000 7f981d5c1700 1 -- 172.21.15.118:0/3260371535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98180c7b30 msgr2=0x7f9818154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.643+0000 7f981d5c1700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98180c7b30 0x7f9818154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:25.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.643+0000 7f981d5c1700 1 -- 172.21.15.118:0/3260371535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040094a0 con 0x7f9818150440 2023-07-13T14:20:25.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.645+0000 7f981d5c1700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9818150440 0x7f98180c8170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f981000cc40 tx=0x7f981000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:25.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.649+0000 7f98157fa700 1 -- 172.21.15.118:0/3260371535 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810004bf0 con 0x7f9818150440 2023-07-13T14:20:25.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.649+0000 7f98157fa700 1 -- 172.21.15.118:0/3260371535 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9810004d50 con 0x7f9818150440 2023-07-13T14:20:25.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.649+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98181551c0 con 0x7f9818150440 2023-07-13T14:20:25.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.649+0000 7f98157fa700 1 -- 172.21.15.118:0/3260371535 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000aa00 con 0x7f9818150440 2023-07-13T14:20:25.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.649+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98180ca270 con 0x7f9818150440 2023-07-13T14:20:25.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.650+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9818154930 con 0x7f9818150440 2023-07-13T14:20:25.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.672+0000 7f98157fa700 1 -- 172.21.15.118:0/3260371535 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f981000ab60 con 0x7f9818150440 2023-07-13T14:20:25.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.672+0000 7f98157fa700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97fc06ad30 0x7f97fc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:25.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.672+0000 7f981cdc0700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97fc06ad30 0x7f97fc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:25.664 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.673+0000 7f981cdc0700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97fc06ad30 0x7f97fc06d1e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f980c005910 tx=0x7f980c009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:25.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.790+0000 7f98157fa700 1 -- 172.21.15.118:0/3260371535 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f981005cf50 con 0x7f9818150440 2023-07-13T14:20:25.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:25.917+0000 7f98157fa700 1 -- 172.21.15.118:0/3260371535 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98100552d0 con 0x7f9818150440 2023-07-13T14:20:26.108 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.117+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98180c9f90 con 0x7f9818150440 2023-07-13T14:20:26.115 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.124+0000 7f98157fa700 1 -- 172.21.15.118:0/3260371535 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f98100588f0 con 0x7f9818150440 2023-07-13T14:20:26.115 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 8 2023-07-13T14:20:26.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97fc06ad30 msgr2=0x7f97fc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97fc06ad30 0x7f97fc06d1e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f980c005910 tx=0x7f980c009040 comp rx=0 tx=0).stop 2023-07-13T14:20:26.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9818150440 msgr2=0x7f98180c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9818150440 0x7f98180c8170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f981000cc40 tx=0x7f981000cf50 comp rx=0 tx=0).stop 2023-07-13T14:20:26.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 shutdown_connections 2023-07-13T14:20:26.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f97fc06ad30 0x7f97fc06d1e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9818150440 0x7f98180c8170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f981806fc00 0x7f9818155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 --2- 172.21.15.118:0/3260371535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98180c7b30 0x7f9818154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 >> 172.21.15.118:0/3260371535 conn(0x7f981806bac0 msgr2=0x7f9818070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:26.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 shutdown_connections 2023-07-13T14:20:26.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.126+0000 7f981f024700 1 -- 172.21.15.118:0/3260371535 wait complete. 2023-07-13T14:20:26.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-13T14:20:26.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.263+0000 7fa75e968700 1 Processor -- start 2023-07-13T14:20:26.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.263+0000 7fa75e968700 1 -- start start 2023-07-13T14:20:26.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.263+0000 7fa75e968700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7580c8c50 0x7fa7580c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.264+0000 7fa75e968700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7580c8160 0x7fa75815c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.264+0000 7fa75e968700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75806bd50 con 0x7fa758152700 2023-07-13T14:20:26.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.264+0000 7fa75e968700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7580c85a0 con 0x7fa7580c8c50 2023-07-13T14:20:26.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.264+0000 7fa75e968700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580722d0 con 0x7fa7580c8160 2023-07-13T14:20:26.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.264+0000 7fa757fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa758152700 0x7fa758071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45926/0 (socket says 172.21.15.118:45926) 2023-07-13T14:20:26.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.264+0000 7fa7577fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7580c8c50 0x7fa7580c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.264+0000 7fa75cf05700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7580c8160 0x7fa75815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.264+0000 7fa757fff700 1 -- 172.21.15.118:0/922940251 learned_addr learned my addr 172.21.15.118:0/922940251 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:26.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.267+0000 7fa7577fe700 1 -- 172.21.15.118:0/922940251 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7580c8160 msgr2=0x7fa75815c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:26.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.267+0000 7fa7577fe700 1 --2- 172.21.15.118:0/922940251 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7580c8160 0x7fa75815c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.267+0000 7fa7577fe700 1 -- 172.21.15.118:0/922940251 >> v1:172.21.15.118:6789/0 conn(0x7fa758152700 legacy=0x7fa758071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.267+0000 7fa7577fe700 1 -- 172.21.15.118:0/922940251 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75815bbd0 con 0x7fa7580c8c50 2023-07-13T14:20:26.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.269+0000 7fa7577fe700 1 --2- 172.21.15.118:0/922940251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8c50 0x7fa7580c7c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009840 tx=0x7fa74c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ef2596835d01c2b server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:26.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.273+0000 7fa756ffd700 1 -- 172.21.15.118:0/922940251 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c011830 con 0x7fa7580c8c50 2023-07-13T14:20:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.273+0000 7fa756ffd700 1 -- 172.21.15.118:0/922940251 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c011990 con 0x7fa7580c8c50 2023-07-13T14:20:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.273+0000 7fa756ffd700 1 -- 172.21.15.118:0/922940251 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c011d20 con 0x7fa7580c8c50 2023-07-13T14:20:26.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.274+0000 7fa75e968700 1 -- 172.21.15.118:0/922940251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8c50 msgr2=0x7fa7580c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.274+0000 7fa75e968700 1 --2- 172.21.15.118:0/922940251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8c50 0x7fa7580c7c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009840 tx=0x7fa74c009b50 comp rx=0 tx=0).stop 2023-07-13T14:20:26.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.274+0000 7fa75e968700 1 -- 172.21.15.118:0/922940251 shutdown_connections 2023-07-13T14:20:26.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.274+0000 7fa75e968700 1 --2- 172.21.15.118:0/922940251 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa7580c8160 0x7fa75815c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.274+0000 7fa75e968700 1 --2- 172.21.15.118:0/922940251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8c50 0x7fa7580c7c20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.274+0000 7fa75e968700 1 -- 172.21.15.118:0/922940251 >> 172.21.15.118:0/922940251 conn(0x7fa75806b040 msgr2=0x7fa75806b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:26.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.274+0000 7fa75e968700 1 -- 172.21.15.118:0/922940251 shutdown_connections 2023-07-13T14:20:26.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.274+0000 7fa75e968700 1 -- 172.21.15.118:0/922940251 wait complete. 2023-07-13T14:20:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.275+0000 7fa75e968700 1 Processor -- start 2023-07-13T14:20:26.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.275+0000 7fa75e968700 1 -- start start 2023-07-13T14:20:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.276+0000 7fa75e968700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8160 0x7fa75814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.276+0000 7fa75e968700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7580c8c50 0x7fa7581496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.276+0000 7fa75e968700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa758152700 0x7fa758143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.276+0000 7fa75e968700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758148ad0 con 0x7fa7580c8c50 2023-07-13T14:20:26.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.276+0000 7fa75e968700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7581f27a0 con 0x7fa7580c8160 2023-07-13T14:20:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.276+0000 7fa75e968700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7581f2310 con 0x7fa758152700 2023-07-13T14:20:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.277+0000 7fa7577fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7580c8c50 0x7fa7581496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.277+0000 7fa75cf05700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa758152700 0x7fa758143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.277+0000 7fa757fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8160 0x7fa75814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.277+0000 7fa75cf05700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa758152700 0x7fa758143cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:56310/0 (socket says 172.21.15.118:56310) 2023-07-13T14:20:26.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.277+0000 7fa75cf05700 1 -- 172.21.15.118:0/2603628918 learned_addr learned my addr 172.21.15.118:0/2603628918 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:26.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.281+0000 7fa757fff700 1 -- 172.21.15.118:0/2603628918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa758152700 msgr2=0x7fa758143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.281+0000 7fa757fff700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa758152700 0x7fa758143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.281+0000 7fa757fff700 1 -- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7580c8c50 msgr2=0x7fa7581496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.281+0000 7fa757fff700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7580c8c50 0x7fa7581496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.281+0000 7fa757fff700 1 -- 172.21.15.118:0/2603628918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0094a0 con 0x7fa7580c8160 2023-07-13T14:20:26.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.283+0000 7fa757fff700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8160 0x7fa75814f590 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c3f0 tx=0x7fa74800c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:26.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.287+0000 7fa754ff9700 1 -- 172.21.15.118:0/2603628918 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748005b40 con 0x7fa7580c8160 2023-07-13T14:20:26.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.287+0000 7fa754ff9700 1 -- 172.21.15.118:0/2603628918 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748005ca0 con 0x7fa7580c8160 2023-07-13T14:20:26.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.287+0000 7fa754ff9700 1 -- 172.21.15.118:0/2603628918 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480072f0 con 0x7fa7580c8160 2023-07-13T14:20:26.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.287+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7581487f0 con 0x7fa7580c8160 2023-07-13T14:20:26.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.287+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7581f1cc0 con 0x7fa7580c8160 2023-07-13T14:20:26.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.288+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7581f25f0 con 0x7fa7580c8160 2023-07-13T14:20:26.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.537+0000 7fa754ff9700 1 -- 172.21.15.118:0/2603628918 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa748007450 con 0x7fa7580c8160 2023-07-13T14:20:26.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.537+0000 7fa754ff9700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa74406ad30 0x7fa74406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.538+0000 7fa7577fe700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa74406ad30 0x7fa74406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.529 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.538+0000 7fa7577fe700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa74406ad30 0x7fa74406d1e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7580c9040 tx=0x7fa74c008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:26.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.541+0000 7fa754ff9700 1 -- 172.21.15.118:0/2603628918 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa74805b940 con 0x7fa7580c8160 2023-07-13T14:20:26.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.551+0000 7fa754ff9700 1 -- 172.21.15.118:0/2603628918 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa748053cc0 con 0x7fa7580c8160 2023-07-13T14:20:26.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.739+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa75806bee0 con 0x7fa7580c8160 2023-07-13T14:20:26.739 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.748+0000 7fa754ff9700 1 -- 172.21.15.118:0/2603628918 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa7480572e0 con 0x7fa7580c8160 2023-07-13T14:20:26.739 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T14:20:26.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa74406ad30 msgr2=0x7fa74406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa74406ad30 0x7fa74406d1e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7580c9040 tx=0x7fa74c008030 comp rx=0 tx=0).stop 2023-07-13T14:20:26.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8160 msgr2=0x7fa75814f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8160 0x7fa75814f590 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c3f0 tx=0x7fa74800c700 comp rx=0 tx=0).stop 2023-07-13T14:20:26.742 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 shutdown_connections 2023-07-13T14:20:26.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa74406ad30 0x7fa74406d1e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7580c8160 0x7fa75814f590 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa758152700 0x7fa758143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 --2- 172.21.15.118:0/2603628918 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7580c8c50 0x7fa7581496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.750+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 >> 172.21.15.118:0/2603628918 conn(0x7fa75806b040 msgr2=0x7fa7580719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:26.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.751+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 shutdown_connections 2023-07-13T14:20:26.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.751+0000 7fa75e968700 1 -- 172.21.15.118:0/2603628918 wait complete. 2023-07-13T14:20:26.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-13T14:20:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.887+0000 7f72dc11e700 1 Processor -- start 2023-07-13T14:20:26.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.887+0000 7f72dc11e700 1 -- start start 2023-07-13T14:20:26.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72dc11e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f72d4152730 0x7f72d415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72dc11e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 0x7f72d4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72dc11e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d40c6d30 con 0x7f72d40703b0 2023-07-13T14:20:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72dc11e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d415c930 con 0x7f72d4152730 2023-07-13T14:20:26.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72dc11e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40c6440 con 0x7f72d40c71c0 2023-07-13T14:20:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72d9eba700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f72d4152730 0x7f72d415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72d96b9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 0x7f72d4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72da6bb700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72d40703b0 0x7f72d40707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:56396/0 (socket says 172.21.15.118:56396) 2023-07-13T14:20:26.881 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.888+0000 7f72da6bb700 1 -- 172.21.15.118:0/2046768756 learned_addr learned my addr 172.21.15.118:0/2046768756 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:26.882 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.891+0000 7f72d9eba700 1 -- 172.21.15.118:0/2046768756 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 msgr2=0x7f72d4069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.891+0000 7f72d9eba700 1 --2- 172.21.15.118:0/2046768756 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 0x7f72d4069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.891+0000 7f72d9eba700 1 -- 172.21.15.118:0/2046768756 >> v1:172.21.15.123:6789/0 conn(0x7f72d40703b0 legacy=0x7f72d40707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.891+0000 7f72d9eba700 1 -- 172.21.15.118:0/2046768756 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40c8160 con 0x7f72d4152730 2023-07-13T14:20:26.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.893+0000 7f72d9eba700 1 --2- 172.21.15.118:0/2046768756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d415c3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009840 tx=0x7f72d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471eb43dc51ce1d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:26.888 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.897+0000 7f72d8eb8700 1 -- 172.21.15.118:0/2046768756 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011830 con 0x7f72d4152730 2023-07-13T14:20:26.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.897+0000 7f72d8eb8700 1 -- 172.21.15.118:0/2046768756 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d0011990 con 0x7f72d4152730 2023-07-13T14:20:26.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.897+0000 7f72d8eb8700 1 -- 172.21.15.118:0/2046768756 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011d20 con 0x7f72d4152730 2023-07-13T14:20:26.889 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.898+0000 7f72dc11e700 1 -- 172.21.15.118:0/2046768756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 msgr2=0x7f72d415c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.898+0000 7f72dc11e700 1 --2- 172.21.15.118:0/2046768756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d415c3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009840 tx=0x7f72d0009b50 comp rx=0 tx=0).stop 2023-07-13T14:20:26.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.898+0000 7f72dc11e700 1 -- 172.21.15.118:0/2046768756 shutdown_connections 2023-07-13T14:20:26.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.898+0000 7f72dc11e700 1 --2- 172.21.15.118:0/2046768756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d415c3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.898+0000 7f72dc11e700 1 --2- 172.21.15.118:0/2046768756 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 0x7f72d4069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.898+0000 7f72dc11e700 1 -- 172.21.15.118:0/2046768756 >> 172.21.15.118:0/2046768756 conn(0x7f72d40cb800 msgr2=0x7f72d40c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:26.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.898+0000 7f72dc11e700 1 -- 172.21.15.118:0/2046768756 shutdown_connections 2023-07-13T14:20:26.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.898+0000 7f72dc11e700 1 -- 172.21.15.118:0/2046768756 wait complete. 2023-07-13T14:20:26.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.899+0000 7f72dc11e700 1 Processor -- start 2023-07-13T14:20:26.891 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.899+0000 7f72dc11e700 1 -- start start 2023-07-13T14:20:26.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.900+0000 7f72dc11e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d40703b0 0x7f72d40beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.900+0000 7f72dc11e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 0x7f72d41e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.900+0000 7f72dc11e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d4150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:26.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.900+0000 7f72dc11e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40bf730 con 0x7f72d4152730 2023-07-13T14:20:26.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.900+0000 7f72dc11e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4159640 con 0x7f72d40703b0 2023-07-13T14:20:26.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.900+0000 7f72dc11e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40bf2e0 con 0x7f72d40c71c0 2023-07-13T14:20:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.901+0000 7f72da6bb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d4150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.901+0000 7f72d9eba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d40703b0 0x7f72d40beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.901+0000 7f72d96b9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 0x7f72d41e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:26.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.901+0000 7f72da6bb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d4150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43816/0 (socket says 172.21.15.118:43816) 2023-07-13T14:20:26.894 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.901+0000 7f72da6bb700 1 -- 172.21.15.118:0/1675153485 learned_addr learned my addr 172.21.15.118:0/1675153485 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:26.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.905+0000 7f72da6bb700 1 -- 172.21.15.118:0/1675153485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 msgr2=0x7f72d41e3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.905+0000 7f72da6bb700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 0x7f72d41e3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.905+0000 7f72da6bb700 1 -- 172.21.15.118:0/1675153485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d40703b0 msgr2=0x7f72d40beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.905+0000 7f72da6bb700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d40703b0 0x7f72d40beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:26.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.905+0000 7f72da6bb700 1 -- 172.21.15.118:0/1675153485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d00094a0 con 0x7f72d4152730 2023-07-13T14:20:26.898 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.907+0000 7f72da6bb700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d4150280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00cc20 tx=0x7f72cc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.911+0000 7f72ca7fc700 1 -- 172.21.15.118:0/1675153485 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00a9c0 con 0x7f72d4152730 2023-07-13T14:20:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.911+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d40be630 con 0x7f72d4152730 2023-07-13T14:20:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.911+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d40be910 con 0x7f72d4152730 2023-07-13T14:20:26.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.911+0000 7f72ca7fc700 1 -- 172.21.15.118:0/1675153485 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc00ab20 con 0x7f72d4152730 2023-07-13T14:20:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.911+0000 7f72ca7fc700 1 -- 172.21.15.118:0/1675153485 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00ae90 con 0x7f72d4152730 2023-07-13T14:20:26.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:26.912+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc0052f0 con 0x7f72d4152730 2023-07-13T14:20:27.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.179+0000 7f72ca7fc700 1 -- 172.21.15.118:0/1675153485 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f72cc01c440 con 0x7f72d4152730 2023-07-13T14:20:27.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.179+0000 7f72ca7fc700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f72b806ace0 0x7f72b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:27.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.179+0000 7f72ca7fc700 1 -- 172.21.15.118:0/1675153485 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f72cc0898a0 con 0x7f72d4152730 2023-07-13T14:20:27.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.179+0000 7f72d9eba700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f72b806ace0 0x7f72b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:27.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.179+0000 7f72ca7fc700 1 -- 172.21.15.118:0/1675153485 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f72cc0b53d0 con 0x7f72d4152730 2023-07-13T14:20:27.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.180+0000 7f72d9eba700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f72b806ace0 0x7f72b806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f72d0000c00 tx=0x7f72d001c040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:27.366 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.375+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72bc005b20 con 0x7f72d4152730 2023-07-13T14:20:27.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.382+0000 7f72ca7fc700 1 -- 172.21.15.118:0/1675153485 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72cc021020 con 0x7f72d4152730 2023-07-13T14:20:27.373 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2023-07-13T14:20:27.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f72b806ace0 msgr2=0x7f72b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f72b806ace0 0x7f72b806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f72d0000c00 tx=0x7f72d001c040 comp rx=0 tx=0).stop 2023-07-13T14:20:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 msgr2=0x7f72d4150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d4150280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00cc20 tx=0x7f72cc00cf30 comp rx=0 tx=0).stop 2023-07-13T14:20:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 shutdown_connections 2023-07-13T14:20:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f72b806ace0 0x7f72b806d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d40703b0 0x7f72d40beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72d4152730 0x7f72d4150280 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 --2- 172.21.15.118:0/1675153485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72d40c71c0 0x7f72d41e3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 >> 172.21.15.118:0/1675153485 conn(0x7f72d40cb800 msgr2=0x7f72d40c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 shutdown_connections 2023-07-13T14:20:27.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.384+0000 7f72dc11e700 1 -- 172.21.15.118:0/1675153485 wait complete. 2023-07-13T14:20:27.387 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-13T14:20:27.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.521+0000 7f963125c700 1 Processor -- start 2023-07-13T14:20:27.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.521+0000 7f963125c700 1 -- start start 2023-07-13T14:20:27.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.522+0000 7f963125c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c069f30 0x7f962c06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:27.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.522+0000 7f963125c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f962c0c9810 0x7f962c06a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:27.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.522+0000 7f963125c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f962c0c7400 0x7f962c15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:27.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.522+0000 7f963125c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c06a840 con 0x7f962c0c9810 2023-07-13T14:20:27.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.522+0000 7f963125c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c0c8d40 con 0x7f962c0c7400 2023-07-13T14:20:27.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.522+0000 7f963125c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0aeeb0 con 0x7f962c069f30 2023-07-13T14:20:27.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.522+0000 7f962a59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f962c0c9810 0x7f962c06a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:27.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.522+0000 7f962ad9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c069f30 0x7f962c06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:27.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.523+0000 7f962b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f962c0c7400 0x7f962c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:27.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.523+0000 7f962a59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f962c0c9810 0x7f962c06a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43822/0 (socket says 172.21.15.118:43822) 2023-07-13T14:20:27.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.523+0000 7f962a59c700 1 -- 172.21.15.118:0/2369711957 learned_addr learned my addr 172.21.15.118:0/2369711957 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:27.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.526+0000 7f962ad9d700 1 -- 172.21.15.118:0/2369711957 >> v2:172.21.15.123:3300/0 conn(0x7f962c0c7400 msgr2=0x7f962c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:27.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.526+0000 7f962ad9d700 1 --2- 172.21.15.118:0/2369711957 >> v2:172.21.15.123:3300/0 conn(0x7f962c0c7400 0x7f962c15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.526+0000 7f962ad9d700 1 -- 172.21.15.118:0/2369711957 >> v2:172.21.15.118:3300/0 conn(0x7f962c0c9810 msgr2=0x7f962c06a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:27.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.526+0000 7f962ad9d700 1 --2- 172.21.15.118:0/2369711957 >> v2:172.21.15.118:3300/0 conn(0x7f962c0c9810 0x7f962c06a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.526+0000 7f962ad9d700 1 -- 172.21.15.118:0/2369711957 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0af190 con 0x7f962c069f30 2023-07-13T14:20:27.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.526+0000 7f962a59c700 1 --2- 172.21.15.118:0/2369711957 >> v2:172.21.15.118:3300/0 conn(0x7f962c0c9810 0x7f962c06a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T14:20:27.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.528+0000 7f962ad9d700 1 --2- 172.21.15.118:0/2369711957 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c069f30 0x7f962c06ba50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f962c0c7b20 tx=0x7f9620009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e4fcaf5f7ede409 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:27.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f9629d9b700 1 -- 172.21.15.118:0/2369711957 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620011830 con 0x7f962c069f30 2023-07-13T14:20:27.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f9629d9b700 1 -- 172.21.15.118:0/2369711957 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620011990 con 0x7f962c069f30 2023-07-13T14:20:27.523 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f9629d9b700 1 -- 172.21.15.118:0/2369711957 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620011d20 con 0x7f962c069f30 2023-07-13T14:20:27.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 -- 172.21.15.118:0/2369711957 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c069f30 msgr2=0x7f962c06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:27.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 --2- 172.21.15.118:0/2369711957 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c069f30 0x7f962c06ba50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f962c0c7b20 tx=0x7f9620009b20 comp rx=0 tx=0).stop 2023-07-13T14:20:27.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 -- 172.21.15.118:0/2369711957 shutdown_connections 2023-07-13T14:20:27.524 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 --2- 172.21.15.118:0/2369711957 >> v2:172.21.15.123:3300/0 conn(0x7f962c0c7400 0x7f962c15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 --2- 172.21.15.118:0/2369711957 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c069f30 0x7f962c06ba50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 --2- 172.21.15.118:0/2369711957 >> v2:172.21.15.118:3300/0 conn(0x7f962c0c9810 0x7f962c06a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 -- 172.21.15.118:0/2369711957 >> 172.21.15.118:0/2369711957 conn(0x7f962c06ebd0 msgr2=0x7f962c06efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:27.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 -- 172.21.15.118:0/2369711957 shutdown_connections 2023-07-13T14:20:27.525 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.532+0000 7f963125c700 1 -- 172.21.15.118:0/2369711957 wait complete. 2023-07-13T14:20:27.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.534+0000 7f963125c700 1 Processor -- start 2023-07-13T14:20:27.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.534+0000 7f963125c700 1 -- start start 2023-07-13T14:20:27.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.535+0000 7f963125c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f962c069f30 0x7f962c146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:27.526 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.535+0000 7f963125c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f962c0c7400 0x7f962c0c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:27.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.535+0000 7f963125c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c0c9810 0x7f962c0c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:27.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.535+0000 7f963125c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0c1ac0 con 0x7f962c069f30 2023-07-13T14:20:27.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.535+0000 7f963125c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c15b700 con 0x7f962c0c7400 2023-07-13T14:20:27.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.535+0000 7f963125c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c15a260 con 0x7f962c0c9810 2023-07-13T14:20:27.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.535+0000 7f962ad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f962c069f30 0x7f962c146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:27.527 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.535+0000 7f962a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f962c0c7400 0x7f962c0c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:27.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.536+0000 7f962b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c0c9810 0x7f962c0c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:27.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.536+0000 7f962ad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f962c069f30 0x7f962c146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43836/0 (socket says 172.21.15.118:43836) 2023-07-13T14:20:27.528 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.536+0000 7f962ad9d700 1 -- 172.21.15.118:0/2673135672 learned_addr learned my addr 172.21.15.118:0/2673135672 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:27.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.540+0000 7f962b59e700 1 -- 172.21.15.118:0/2673135672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f962c0c7400 msgr2=0x7f962c0c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:27.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.540+0000 7f962b59e700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f962c0c7400 0x7f962c0c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.540+0000 7f962b59e700 1 -- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f962c069f30 msgr2=0x7f962c146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:27.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.540+0000 7f962b59e700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f962c069f30 0x7f962c146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.540+0000 7f962b59e700 1 -- 172.21.15.118:0/2673135672 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c009550 con 0x7f962c0c9810 2023-07-13T14:20:27.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.542+0000 7f962b59e700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c0c9810 0x7f962c0c2420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9624009d90 tx=0x7f962400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:27.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.546+0000 7f96137fe700 1 -- 172.21.15.118:0/2673135672 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624009c00 con 0x7f962c0c9810 2023-07-13T14:20:27.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.546+0000 7f96137fe700 1 -- 172.21.15.118:0/2673135672 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962400f040 con 0x7f962c0c9810 2023-07-13T14:20:27.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.546+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96200094a0 con 0x7f962c0c9810 2023-07-13T14:20:27.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.546+0000 7f96137fe700 1 -- 172.21.15.118:0/2673135672 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624014480 con 0x7f962c0c9810 2023-07-13T14:20:27.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.546+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c15b8f0 con 0x7f962c0c9810 2023-07-13T14:20:27.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.547+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c0c8240 con 0x7f962c0c9810 2023-07-13T14:20:27.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.568+0000 7f96137fe700 1 -- 172.21.15.118:0/2673135672 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96240145e0 con 0x7f962c0c9810 2023-07-13T14:20:27.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.569+0000 7f96137fe700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f961806ad60 0x7f961806d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:27.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.569+0000 7f962ad9d700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f961806ad60 0x7f961806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:27.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.569+0000 7f962ad9d700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f961806ad60 0x7f961806d210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9620000c00 tx=0x7f9620008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:27.795 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.803+0000 7f96137fe700 1 -- 172.21.15.118:0/2673135672 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f962405d0b0 con 0x7f962c0c9810 2023-07-13T14:20:27.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.813+0000 7f96137fe700 1 -- 172.21.15.118:0/2673135672 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9624055430 con 0x7f962c0c9810 2023-07-13T14:20:27.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:27.996+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f962c0c1c00 con 0x7f962c0c9810 2023-07-13T14:20:27.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.003+0000 7f96137fe700 1 -- 172.21.15.118:0/2673135672 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f962c0c1c00 con 0x7f962c0c9810 2023-07-13T14:20:27.995 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2023-07-13T14:20:27.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f961806ad60 msgr2=0x7f961806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:27.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f961806ad60 0x7f961806d210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9620000c00 tx=0x7f9620008030 comp rx=0 tx=0).stop 2023-07-13T14:20:27.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c0c9810 msgr2=0x7f962c0c2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:27.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c0c9810 0x7f962c0c2420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9624009d90 tx=0x7f962400c3a0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 shutdown_connections 2023-07-13T14:20:27.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f961806ad60 0x7f961806d210 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f962c0c9810 0x7f962c0c2420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f962c069f30 0x7f962c146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 --2- 172.21.15.118:0/2673135672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f962c0c7400 0x7f962c0c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:27.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 >> 172.21.15.118:0/2673135672 conn(0x7f962c06ebd0 msgr2=0x7f962c1e19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:27.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 shutdown_connections 2023-07-13T14:20:27.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.005+0000 7f963125c700 1 -- 172.21.15.118:0/2673135672 wait complete. 2023-07-13T14:20:28.010 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-13T14:20:28.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:20:28.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:20:28.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.144+0000 7f8687418700 1 Processor -- start 2023-07-13T14:20:28.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.144+0000 7f8687418700 1 -- start start 2023-07-13T14:20:28.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.145+0000 7f8687418700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f868006d0f0 0x7f868006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:28.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.145+0000 7f8687418700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f868006aa80 0x7f86800c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:28.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.145+0000 7f8687418700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86800c6b60 con 0x7f8680150b30 2023-07-13T14:20:28.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.145+0000 7f8687418700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86800c4f90 con 0x7f868006aa80 2023-07-13T14:20:28.138 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.145+0000 7f8687418700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868015a300 con 0x7f868006d0f0 2023-07-13T14:20:28.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.146+0000 7f86851b4700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8680150b30 0x7f8680159bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45930/0 (socket says 172.21.15.118:45930) 2023-07-13T14:20:28.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.146+0000 7f86851b4700 1 -- 172.21.15.118:0/1226793593 learned_addr learned my addr 172.21.15.118:0/1226793593 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:28.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.146+0000 7f86849b3700 1 --2- 172.21.15.118:0/1226793593 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f868006d0f0 0x7f868006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:28.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.147+0000 7f86859b5700 1 --2- 172.21.15.118:0/1226793593 >> v2:172.21.15.123:3300/0 conn(0x7f868006aa80 0x7f86800c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:28.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.149+0000 7f8673fff700 1 -- 172.21.15.118:0/1226793593 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720307007 0 0) 0x7f8674001110 con 0x7f8680150b30 2023-07-13T14:20:28.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.149+0000 7f8673fff700 1 -- 172.21.15.118:0/1226793593 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f866c0035b0 con 0x7f8680150b30 2023-07-13T14:20:28.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.149+0000 7f86859b5700 1 -- 172.21.15.118:0/1226793593 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f868006d0f0 msgr2=0x7f868006bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:28.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.149+0000 7f86859b5700 1 --2- 172.21.15.118:0/1226793593 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f868006d0f0 0x7f868006bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.149+0000 7f86859b5700 1 -- 172.21.15.118:0/1226793593 >> v1:172.21.15.118:6789/0 conn(0x7f8680150b30 legacy=0x7f8680159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:28.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.149+0000 7f86859b5700 1 -- 172.21.15.118:0/1226793593 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680157500 con 0x7f868006aa80 2023-07-13T14:20:28.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.152+0000 7f86859b5700 1 --2- 172.21.15.118:0/1226793593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006aa80 0x7f86800c3980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8678009dc0 tx=0x7f867800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=129c98590339e978 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:28.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.156+0000 7f8673fff700 1 -- 172.21.15.118:0/1226793593 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867800e070 con 0x7f868006aa80 2023-07-13T14:20:28.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.156+0000 7f8673fff700 1 -- 172.21.15.118:0/1226793593 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867800bae0 con 0x7f868006aa80 2023-07-13T14:20:28.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.156+0000 7f8673fff700 1 -- 172.21.15.118:0/1226793593 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867800be90 con 0x7f868006aa80 2023-07-13T14:20:28.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.157+0000 7f8687418700 1 -- 172.21.15.118:0/1226793593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006aa80 msgr2=0x7f86800c3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:28.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.157+0000 7f8687418700 1 --2- 172.21.15.118:0/1226793593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006aa80 0x7f86800c3980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8678009dc0 tx=0x7f867800b330 comp rx=0 tx=0).stop 2023-07-13T14:20:28.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.157+0000 7f8687418700 1 -- 172.21.15.118:0/1226793593 shutdown_connections 2023-07-13T14:20:28.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.157+0000 7f8687418700 1 --2- 172.21.15.118:0/1226793593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006aa80 0x7f86800c3980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.157+0000 7f8687418700 1 --2- 172.21.15.118:0/1226793593 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f868006d0f0 0x7f868006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.157+0000 7f8687418700 1 -- 172.21.15.118:0/1226793593 >> 172.21.15.118:0/1226793593 conn(0x7f8680069f30 msgr2=0x7f868006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:28.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.157+0000 7f8687418700 1 -- 172.21.15.118:0/1226793593 shutdown_connections 2023-07-13T14:20:28.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.157+0000 7f8687418700 1 -- 172.21.15.118:0/1226793593 wait complete. 2023-07-13T14:20:28.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.158+0000 7f8687418700 1 Processor -- start 2023-07-13T14:20:28.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.158+0000 7f8687418700 1 -- start start 2023-07-13T14:20:28.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.159+0000 7f8687418700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868006aa80 0x7f8680146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:28.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.159+0000 7f8687418700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006d0f0 0x7f8680154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:28.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.159+0000 7f8687418700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8680150b30 0x7f86801ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:28.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.159+0000 7f8687418700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86801ec990 con 0x7f868006aa80 2023-07-13T14:20:28.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.159+0000 7f8687418700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86800708b0 con 0x7f868006d0f0 2023-07-13T14:20:28.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.159+0000 7f8687418700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86801ece20 con 0x7f8680150b30 2023-07-13T14:20:28.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.160+0000 7f86851b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868006aa80 0x7f8680146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:28.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.160+0000 7f86849b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006d0f0 0x7f8680154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:28.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.160+0000 7f86859b5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8680150b30 0x7f86801ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:28.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.160+0000 7f86851b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868006aa80 0x7f8680146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43852/0 (socket says 172.21.15.118:43852) 2023-07-13T14:20:28.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.160+0000 7f86851b4700 1 -- 172.21.15.118:0/3423855199 learned_addr learned my addr 172.21.15.118:0/3423855199 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:28.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.164+0000 7f86851b4700 1 -- 172.21.15.118:0/3423855199 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8680150b30 msgr2=0x7f86801ef4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:28.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.164+0000 7f86851b4700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8680150b30 0x7f86801ef4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.164+0000 7f86851b4700 1 -- 172.21.15.118:0/3423855199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006d0f0 msgr2=0x7f8680154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:28.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.164+0000 7f86851b4700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006d0f0 0x7f8680154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.164+0000 7f86851b4700 1 -- 172.21.15.118:0/3423855199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8678009a70 con 0x7f868006aa80 2023-07-13T14:20:28.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.166+0000 7f86851b4700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868006aa80 0x7f8680146af0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f867400c420 tx=0x7f867400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:28.162 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.170+0000 7f8671ffb700 1 -- 172.21.15.118:0/3423855199 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674005d70 con 0x7f868006aa80 2023-07-13T14:20:28.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.170+0000 7f8671ffb700 1 -- 172.21.15.118:0/3423855199 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867400ce30 con 0x7f868006aa80 2023-07-13T14:20:28.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.170+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86801ec060 con 0x7f868006aa80 2023-07-13T14:20:28.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.170+0000 7f8671ffb700 1 -- 172.21.15.118:0/3423855199 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674007310 con 0x7f868006aa80 2023-07-13T14:20:28.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.171+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86801ec620 con 0x7f868006aa80 2023-07-13T14:20:28.163 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.171+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86801ecc70 con 0x7f868006aa80 2023-07-13T14:20:28.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.432+0000 7f8671ffb700 1 -- 172.21.15.118:0/3423855199 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8674007470 con 0x7f868006aa80 2023-07-13T14:20:28.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.432+0000 7f8671ffb700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f866406ad30 0x7f866406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:28.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.433+0000 7f8671ffb700 1 -- 172.21.15.118:0/3423855199 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8674088f20 con 0x7f868006aa80 2023-07-13T14:20:28.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.433+0000 7f86849b3700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f866406ad30 0x7f866406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:28.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.433+0000 7f8671ffb700 1 -- 172.21.15.118:0/3423855199 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86740892e0 con 0x7f868006aa80 2023-07-13T14:20:28.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.433+0000 7f86849b3700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f866406ad30 0x7f866406d1e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86801e9b80 tx=0x7f867c009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:28.649 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.656+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f868004e280 con 0x7f868006aa80 2023-07-13T14:20:28.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.669+0000 7f8671ffb700 1 -- 172.21.15.118:0/3423855199 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8674017020 con 0x7f868006aa80 2023-07-13T14:20:28.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f866406ad30 msgr2=0x7f866406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:28.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f866406ad30 0x7f866406d1e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f86801e9b80 tx=0x7f867c009210 comp rx=0 tx=0).stop 2023-07-13T14:20:28.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868006aa80 msgr2=0x7f8680146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:28.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868006aa80 0x7f8680146af0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f867400c420 tx=0x7f867400c730 comp rx=0 tx=0).stop 2023-07-13T14:20:28.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 shutdown_connections 2023-07-13T14:20:28.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f866406ad30 0x7f866406d1e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8680150b30 0x7f86801ef4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f868006aa80 0x7f8680146af0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 --2- 172.21.15.118:0/3423855199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868006d0f0 0x7f8680154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:28.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 >> 172.21.15.118:0/3423855199 conn(0x7f8680069f30 msgr2=0x7f868014a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:28.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 shutdown_connections 2023-07-13T14:20:28.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:28.672+0000 7f8687418700 1 -- 172.21.15.118:0/3423855199 wait complete. 2023-07-13T14:20:28.667 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2023-07-13T14:20:28.677 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2023-07-13T14:20:28.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T14:20:28.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-13T14:20:28.763 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:20:28.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[156918]: fuse finished with error 0 and tester_r 0 2023-07-13T14:20:34.865 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T14:20:34.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T14:20:34.866 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-13T14:20:34.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T14:20:34.885 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2023-07-13T14:20:34.942 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-13T14:20:34.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T14:20:34.942 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-13T14:20:35.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-13T14:20:35.021 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2023-07-13T14:20:35.122 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-13T14:20:35.132 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-13T14:20:35.132 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T14:20:35.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.262+0000 7fd38bbd7700 1 Processor -- start 2023-07-13T14:20:35.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.263+0000 7fd38bbd7700 1 -- start start 2023-07-13T14:20:35.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.263+0000 7fd38bbd7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd38414bf30 0x7fd3841594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.263+0000 7fd38bbd7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3840c5280 0x7fd38406ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.263+0000 7fd38bbd7700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd384155c60 con 0x7fd384070c80 2023-07-13T14:20:35.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.263+0000 7fd38bbd7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3840c1fe0 con 0x7fd3840c5280 2023-07-13T14:20:35.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.263+0000 7fd38bbd7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38414c300 con 0x7fd38414bf30 2023-07-13T14:20:35.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.264+0000 7fd38a174700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3840c5280 0x7fd38406ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.264+0000 7fd389973700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd38414bf30 0x7fd3841594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.265+0000 7fd389973700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd38414bf30 0x7fd3841594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:49622/0 (socket says 172.21.15.118:49622) 2023-07-13T14:20:35.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.265+0000 7fd389973700 1 -- 172.21.15.118:0/4263903039 learned_addr learned my addr 172.21.15.118:0/4263903039 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:35.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.268+0000 7fd38a174700 1 -- 172.21.15.118:0/4263903039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd38414bf30 msgr2=0x7fd3841594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.268+0000 7fd38a174700 1 --2- 172.21.15.118:0/4263903039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd38414bf30 0x7fd3841594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.268+0000 7fd38a174700 1 -- 172.21.15.118:0/4263903039 >> v1:172.21.15.123:6789/0 conn(0x7fd384070c80 legacy=0x7fd3841553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.268+0000 7fd38a174700 1 -- 172.21.15.118:0/4263903039 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384155f20 con 0x7fd3840c5280 2023-07-13T14:20:35.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.268+0000 7fd389973700 1 --2- 172.21.15.118:0/4263903039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd38414bf30 0x7fd3841594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T14:20:35.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.271+0000 7fd38a174700 1 --2- 172.21.15.118:0/4263903039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3840c5280 0x7fd38406ff20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009d90 tx=0x7fd37c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96993d1a72929f2e server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:35.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.275+0000 7fd388971700 1 -- 172.21.15.118:0/4263903039 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00e070 con 0x7fd3840c5280 2023-07-13T14:20:35.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.278+0000 7fd388971700 1 -- 172.21.15.118:0/4263903039 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00bb20 con 0x7fd3840c5280 2023-07-13T14:20:35.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.278+0000 7fd388971700 1 -- 172.21.15.118:0/4263903039 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c012430 con 0x7fd3840c5280 2023-07-13T14:20:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.279+0000 7fd38bbd7700 1 -- 172.21.15.118:0/4263903039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3840c5280 msgr2=0x7fd38406ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.279+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/4263903039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3840c5280 0x7fd38406ff20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009d90 tx=0x7fd37c00b330 comp rx=0 tx=0).stop 2023-07-13T14:20:35.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.279+0000 7fd38bbd7700 1 -- 172.21.15.118:0/4263903039 shutdown_connections 2023-07-13T14:20:35.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.279+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/4263903039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3840c5280 0x7fd38406ff20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.279+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/4263903039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd38414bf30 0x7fd3841594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.279+0000 7fd38bbd7700 1 -- 172.21.15.118:0/4263903039 >> 172.21.15.118:0/4263903039 conn(0x7fd38406d830 msgr2=0x7fd38406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:35.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.279+0000 7fd38bbd7700 1 -- 172.21.15.118:0/4263903039 shutdown_connections 2023-07-13T14:20:35.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.279+0000 7fd38bbd7700 1 -- 172.21.15.118:0/4263903039 wait complete. 2023-07-13T14:20:35.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.280+0000 7fd38bbd7700 1 Processor -- start 2023-07-13T14:20:35.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.280+0000 7fd38bbd7700 1 -- start start 2023-07-13T14:20:35.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.281+0000 7fd38bbd7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd384070c80 0x7fd384150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.281+0000 7fd38bbd7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3840c5280 0x7fd384147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.281+0000 7fd38bbd7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd38414bf30 0x7fd3841ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.281+0000 7fd38bbd7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841ee170 con 0x7fd38414bf30 2023-07-13T14:20:35.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.281+0000 7fd38bbd7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd384154f20 con 0x7fd384070c80 2023-07-13T14:20:35.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.281+0000 7fd38bbd7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841eddd0 con 0x7fd3840c5280 2023-07-13T14:20:35.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.281+0000 7fd38a174700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd38414bf30 0x7fd3841ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.282+0000 7fd389973700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd384070c80 0x7fd384150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.282+0000 7fd389172700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3840c5280 0x7fd384147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.282+0000 7fd389973700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd384070c80 0x7fd384150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:57052/0 (socket says 172.21.15.118:57052) 2023-07-13T14:20:35.275 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.282+0000 7fd389973700 1 -- 172.21.15.118:0/1174960784 learned_addr learned my addr 172.21.15.118:0/1174960784 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:35.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.286+0000 7fd389973700 1 -- 172.21.15.118:0/1174960784 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3840c5280 msgr2=0x7fd384147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.286+0000 7fd389973700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3840c5280 0x7fd384147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.286+0000 7fd389973700 1 -- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd38414bf30 msgr2=0x7fd3841ee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.286+0000 7fd389973700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd38414bf30 0x7fd3841ee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.286+0000 7fd389973700 1 -- 172.21.15.118:0/1174960784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009550 con 0x7fd384070c80 2023-07-13T14:20:35.281 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.288+0000 7fd389973700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd384070c80 0x7fd384150850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd38000ec10 tx=0x7fd38000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:35.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.293+0000 7fd37a7fc700 1 -- 172.21.15.118:0/1174960784 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000c850 con 0x7fd384070c80 2023-07-13T14:20:35.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.293+0000 7fd37a7fc700 1 -- 172.21.15.118:0/1174960784 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38000c9b0 con 0x7fd384070c80 2023-07-13T14:20:35.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.293+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c009a70 con 0x7fd384070c80 2023-07-13T14:20:35.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.293+0000 7fd37a7fc700 1 -- 172.21.15.118:0/1174960784 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000cd40 con 0x7fd384070c80 2023-07-13T14:20:35.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.293+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd384154680 con 0x7fd384070c80 2023-07-13T14:20:35.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.294+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3841ee2b0 con 0x7fd384070c80 2023-07-13T14:20:35.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.542+0000 7fd37a7fc700 1 -- 172.21.15.118:0/1174960784 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd380013470 con 0x7fd384070c80 2023-07-13T14:20:35.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.543+0000 7fd37a7fc700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd36806ace0 0x7fd36806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.543+0000 7fd389172700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd36806ace0 0x7fd36806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.543+0000 7fd389172700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd36806ace0 0x7fd36806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd384150d90 tx=0x7fd374009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:35.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.548+0000 7fd37a7fc700 1 -- 172.21.15.118:0/1174960784 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd38005cb50 con 0x7fd384070c80 2023-07-13T14:20:35.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.560+0000 7fd37a7fc700 1 -- 172.21.15.118:0/1174960784 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd380054ed0 con 0x7fd384070c80 2023-07-13T14:20:35.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.756+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3841589c0 con 0x7fd36806ace0 2023-07-13T14:20:35.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.767+0000 7fd37a7fc700 1 -- 172.21.15.118:0/1174960784 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393319 (secure 0 0 0) 0x7fd374001cc0 con 0x7fd36806ace0 2023-07-13T14:20:35.764 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:20:35.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd36806ace0 msgr2=0x7fd36806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.766 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd36806ace0 0x7fd36806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd384150d90 tx=0x7fd374009040 comp rx=0 tx=0).stop 2023-07-13T14:20:35.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd384070c80 msgr2=0x7fd384150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd384070c80 0x7fd384150850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd38000ec10 tx=0x7fd38000ef20 comp rx=0 tx=0).stop 2023-07-13T14:20:35.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 shutdown_connections 2023-07-13T14:20:35.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd36806ace0 0x7fd36806d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd384070c80 0x7fd384150850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd38414bf30 0x7fd3841ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.767 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 --2- 172.21.15.118:0/1174960784 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd3840c5280 0x7fd384147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.768 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 >> 172.21.15.118:0/1174960784 conn(0x7fd38406d830 msgr2=0x7fd38406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:35.768 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 shutdown_connections 2023-07-13T14:20:35.768 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.771+0000 7fd38bbd7700 1 -- 172.21.15.118:0/1174960784 wait complete. 2023-07-13T14:20:35.768 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T14:20:35.776 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":879,"stamp":"2023-07-13T14:20:35.298035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35755431,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":925,"num_read_kb":952,"num_write":11483,"num_write_kb":323812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13364,"ondisk_log_size":13364,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406344,"kb_used_data":50824,"kb_used_omap":13,"kb_used_meta":355442,"kb_avail":754568376,"statfs":{"total":773094113280,"available":772678017024,"internally_reserved":0,"allocated":52043776,"data_stored":72647622,"data_compressed":6272288,"data_compressed_allocated":9814016,"data_compressed_original":32006144,"omap_allocated":14248,"internal_metadata":363972696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11527,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003155"},"pg_stats":[{"pgid":"4.3f","version":"31'26","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.070994+0000","last_change":"2023-07-13T13:52:17.926057+0000","last_active":"2023-07-13T14:20:29.070994+0000","last_peered":"2023-07-13T14:20:29.070994+0000","last_clean":"2023-07-13T14:20:29.070994+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T14:20:29.070994+0000","last_undegraded":"2023-07-13T14:20:29.070994+0000","last_fullsized":"2023-07-13T14:20:29.070994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:09.969490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"31'31","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.030541+0000","last_change":"2023-07-13T13:52:17.952706+0000","last_active":"2023-07-13T14:20:29.030541+0000","last_peered":"2023-07-13T14:20:29.030541+0000","last_clean":"2023-07-13T14:20:29.030541+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T14:20:29.030541+0000","last_undegraded":"2023-07-13T14:20:29.030541+0000","last_fullsized":"2023-07-13T14:20:29.030541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:47.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052353+0000","last_change":"2023-07-13T13:52:17.943505+0000","last_active":"2023-07-13T14:20:29.052353+0000","last_peered":"2023-07-13T14:20:29.052353+0000","last_clean":"2023-07-13T14:20:29.052353+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T14:20:29.052353+0000","last_undegraded":"2023-07-13T14:20:29.052353+0000","last_fullsized":"2023-07-13T14:20:29.052353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:57:33.638855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"31'25","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.116236+0000","last_change":"2023-07-13T13:52:17.933893+0000","last_active":"2023-07-13T14:20:29.116236+0000","last_peered":"2023-07-13T14:20:29.116236+0000","last_clean":"2023-07-13T14:20:29.116236+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T14:20:29.116236+0000","last_undegraded":"2023-07-13T14:20:29.116236+0000","last_fullsized":"2023-07-13T14:20:29.116236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:37:29.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"31'23","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218387+0000","last_change":"2023-07-13T13:52:17.886730+0000","last_active":"2023-07-13T14:20:29.218387+0000","last_peered":"2023-07-13T14:20:29.218387+0000","last_clean":"2023-07-13T14:20:29.218387+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T14:20:29.218387+0000","last_undegraded":"2023-07-13T14:20:29.218387+0000","last_fullsized":"2023-07-13T14:20:29.218387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:46:11.415041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.042967+0000","last_change":"2023-07-13T13:52:17.942599+0000","last_active":"2023-07-13T14:20:29.042967+0000","last_peered":"2023-07-13T14:20:29.042967+0000","last_clean":"2023-07-13T14:20:29.042967+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T14:20:29.042967+0000","last_undegraded":"2023-07-13T14:20:29.042967+0000","last_fullsized":"2023-07-13T14:20:29.042967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:15:36.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071363+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T14:20:29.071363+0000","last_peered":"2023-07-13T14:20:29.071363+0000","last_clean":"2023-07-13T14:20:29.071363+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T14:20:29.071363+0000","last_undegraded":"2023-07-13T14:20:29.071363+0000","last_fullsized":"2023-07-13T14:20:29.071363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:29.831587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"31'22","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037767+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T14:20:29.037767+0000","last_peered":"2023-07-13T14:20:29.037767+0000","last_clean":"2023-07-13T14:20:29.037767+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T14:20:29.037767+0000","last_undegraded":"2023-07-13T14:20:29.037767+0000","last_fullsized":"2023-07-13T14:20:29.037767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:05:01.082348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"31'35","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219321+0000","last_change":"2023-07-13T13:52:58.032563+0000","last_active":"2023-07-13T14:20:29.219321+0000","last_peered":"2023-07-13T14:20:29.219321+0000","last_clean":"2023-07-13T14:20:29.219321+0000","last_became_active":"2023-07-13T13:52:58.032221+0000","last_became_peered":"2023-07-13T13:52:58.032221+0000","last_unstale":"2023-07-13T14:20:29.219321+0000","last_undegraded":"2023-07-13T14:20:29.219321+0000","last_fullsized":"2023-07-13T14:20:29.219321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:17:32.249199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'37","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.040091+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T14:20:29.040091+0000","last_peered":"2023-07-13T14:20:29.040091+0000","last_clean":"2023-07-13T14:20:29.040091+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T14:20:29.040091+0000","last_undegraded":"2023-07-13T14:20:29.040091+0000","last_fullsized":"2023-07-13T14:20:29.040091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"31'30","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.045065+0000","last_change":"2023-07-13T13:52:58.431745+0000","last_active":"2023-07-13T14:20:29.045065+0000","last_peered":"2023-07-13T14:20:29.045065+0000","last_clean":"2023-07-13T14:20:29.045065+0000","last_became_active":"2023-07-13T13:52:58.431466+0000","last_became_peered":"2023-07-13T13:52:58.431466+0000","last_unstale":"2023-07-13T14:20:29.045065+0000","last_undegraded":"2023-07-13T14:20:29.045065+0000","last_fullsized":"2023-07-13T14:20:29.045065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:27:08.861062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"31'22","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.069318+0000","last_change":"2023-07-13T13:52:17.943253+0000","last_active":"2023-07-13T14:20:29.069318+0000","last_peered":"2023-07-13T14:20:29.069318+0000","last_clean":"2023-07-13T14:20:29.069318+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T14:20:29.069318+0000","last_undegraded":"2023-07-13T14:20:29.069318+0000","last_fullsized":"2023-07-13T14:20:29.069318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:19.844182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"31'35","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071128+0000","last_change":"2023-07-13T13:52:17.925230+0000","last_active":"2023-07-13T14:20:29.071128+0000","last_peered":"2023-07-13T14:20:29.071128+0000","last_clean":"2023-07-13T14:20:29.071128+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T14:20:29.071128+0000","last_undegraded":"2023-07-13T14:20:29.071128+0000","last_fullsized":"2023-07-13T14:20:29.071128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'35","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037770+0000","last_change":"2023-07-13T13:52:17.925445+0000","last_active":"2023-07-13T14:20:29.037770+0000","last_peered":"2023-07-13T14:20:29.037770+0000","last_clean":"2023-07-13T14:20:29.037770+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T14:20:29.037770+0000","last_undegraded":"2023-07-13T14:20:29.037770+0000","last_fullsized":"2023-07-13T14:20:29.037770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:38:34.228527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"31'35","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071487+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T14:20:29.071487+0000","last_peered":"2023-07-13T14:20:29.071487+0000","last_clean":"2023-07-13T14:20:29.071487+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T14:20:29.071487+0000","last_undegraded":"2023-07-13T14:20:29.071487+0000","last_fullsized":"2023-07-13T14:20:29.071487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:33.058046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"31'33","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052262+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T14:20:29.052262+0000","last_peered":"2023-07-13T14:20:29.052262+0000","last_clean":"2023-07-13T14:20:29.052262+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T14:20:29.052262+0000","last_undegraded":"2023-07-13T14:20:29.052262+0000","last_fullsized":"2023-07-13T14:20:29.052262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:58:13.171516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"31'32","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219090+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T14:20:29.219090+0000","last_peered":"2023-07-13T14:20:29.219090+0000","last_clean":"2023-07-13T14:20:29.219090+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T14:20:29.219090+0000","last_undegraded":"2023-07-13T14:20:29.219090+0000","last_fullsized":"2023-07-13T14:20:29.219090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:00:48.553687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"31'42","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.053186+0000","last_change":"2023-07-13T13:52:17.942704+0000","last_active":"2023-07-13T14:20:29.053186+0000","last_peered":"2023-07-13T14:20:29.053186+0000","last_clean":"2023-07-13T14:20:29.053186+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T14:20:29.053186+0000","last_undegraded":"2023-07-13T14:20:29.053186+0000","last_fullsized":"2023-07-13T14:20:29.053186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:55:37.936044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"31'31","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.066190+0000","last_change":"2023-07-13T13:52:17.934990+0000","last_active":"2023-07-13T14:20:29.066190+0000","last_peered":"2023-07-13T14:20:29.066190+0000","last_clean":"2023-07-13T14:20:29.066190+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T14:20:29.066190+0000","last_undegraded":"2023-07-13T14:20:29.066190+0000","last_fullsized":"2023-07-13T14:20:29.066190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:02.191186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"31'36","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052769+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T14:20:29.052769+0000","last_peered":"2023-07-13T14:20:29.052769+0000","last_clean":"2023-07-13T14:20:29.052769+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T14:20:29.052769+0000","last_undegraded":"2023-07-13T14:20:29.052769+0000","last_fullsized":"2023-07-13T14:20:29.052769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:06:12.632230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"31'46","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071286+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T14:20:29.071286+0000","last_peered":"2023-07-13T14:20:29.071286+0000","last_clean":"2023-07-13T14:20:29.071286+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T14:20:29.071286+0000","last_undegraded":"2023-07-13T14:20:29.071286+0000","last_fullsized":"2023-07-13T14:20:29.071286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:34.535336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"31'34","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218021+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T14:20:29.218021+0000","last_peered":"2023-07-13T14:20:29.218021+0000","last_clean":"2023-07-13T14:20:29.218021+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T14:20:29.218021+0000","last_undegraded":"2023-07-13T14:20:29.218021+0000","last_fullsized":"2023-07-13T14:20:29.218021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:35.504227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"31'37","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.060231+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T14:20:29.060231+0000","last_peered":"2023-07-13T14:20:29.060231+0000","last_clean":"2023-07-13T14:20:29.060231+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T14:20:29.060231+0000","last_undegraded":"2023-07-13T14:20:29.060231+0000","last_fullsized":"2023-07-13T14:20:29.060231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:47.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071246+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T14:20:29.071246+0000","last_peered":"2023-07-13T14:20:29.071246+0000","last_clean":"2023-07-13T14:20:29.071246+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T14:20:29.071246+0000","last_undegraded":"2023-07-13T14:20:29.071246+0000","last_fullsized":"2023-07-13T14:20:29.071246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"31'27","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.228712+0000","last_change":"2023-07-13T13:52:17.951443+0000","last_active":"2023-07-13T14:20:29.228712+0000","last_peered":"2023-07-13T14:20:29.228712+0000","last_clean":"2023-07-13T14:20:29.228712+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T14:20:29.228712+0000","last_undegraded":"2023-07-13T14:20:29.228712+0000","last_fullsized":"2023-07-13T14:20:29.228712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:38:59.029829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"31'39","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230308+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T14:20:29.230308+0000","last_peered":"2023-07-13T14:20:29.230308+0000","last_clean":"2023-07-13T14:20:29.230308+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T14:20:29.230308+0000","last_undegraded":"2023-07-13T14:20:29.230308+0000","last_fullsized":"2023-07-13T14:20:29.230308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:50:40.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"31'23","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035220+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T14:20:29.035220+0000","last_peered":"2023-07-13T14:20:29.035220+0000","last_clean":"2023-07-13T14:20:29.035220+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T14:20:29.035220+0000","last_undegraded":"2023-07-13T14:20:29.035220+0000","last_fullsized":"2023-07-13T14:20:29.035220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:12.557056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573994+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T14:19:53.573994+0000","last_peered":"2023-07-13T14:19:53.573994+0000","last_clean":"2023-07-13T14:19:53.573994+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T14:19:53.573994+0000","last_undegraded":"2023-07-13T14:19:53.573994+0000","last_fullsized":"2023-07-13T14:19:53.573994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:29:36.180810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"31'645","reported_seq":683,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.802282+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T14:19:57.802282+0000","last_peered":"2023-07-13T14:19:57.802282+0000","last_clean":"2023-07-13T14:19:57.802282+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T14:19:57.802282+0000","last_undegraded":"2023-07-13T14:19:57.802282+0000","last_fullsized":"2023-07-13T14:19:57.802282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:50:15.899141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'42","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055906+0000","last_change":"2023-07-13T13:52:17.948432+0000","last_active":"2023-07-13T14:20:29.055906+0000","last_peered":"2023-07-13T14:20:29.055906+0000","last_clean":"2023-07-13T14:20:29.055906+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T14:20:29.055906+0000","last_undegraded":"2023-07-13T14:20:29.055906+0000","last_fullsized":"2023-07-13T14:20:29.055906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:45:09.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'125","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:48.633658+0000","last_change":"2023-07-13T13:52:23.984769+0000","last_active":"2023-07-13T14:19:48.633658+0000","last_peered":"2023-07-13T14:19:48.633658+0000","last_clean":"2023-07-13T14:19:48.633658+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T14:19:48.633658+0000","last_undegraded":"2023-07-13T14:19:48.633658+0000","last_fullsized":"2023-07-13T14:19:48.633658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:01:10.403090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":11569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.881932+0000","last_change":"2023-07-13T13:52:16.667863+0000","last_active":"2023-07-13T14:20:06.881932+0000","last_peered":"2023-07-13T14:20:06.881932+0000","last_clean":"2023-07-13T14:20:06.881932+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T14:20:06.881932+0000","last_undegraded":"2023-07-13T14:20:06.881932+0000","last_fullsized":"2023-07-13T14:20:06.881932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:32:47.027923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'20","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217062+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T14:20:29.217062+0000","last_peered":"2023-07-13T14:20:29.217062+0000","last_clean":"2023-07-13T14:20:29.217062+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T14:20:29.217062+0000","last_undegraded":"2023-07-13T14:20:29.217062+0000","last_fullsized":"2023-07-13T14:20:29.217062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:30:22.976473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"31'103","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.770450+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T14:19:51.770450+0000","last_peered":"2023-07-13T14:19:51.770450+0000","last_clean":"2023-07-13T14:19:51.770450+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T14:19:51.770450+0000","last_undegraded":"2023-07-13T14:19:51.770450+0000","last_fullsized":"2023-07-13T14:19:51.770450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:59:03.195341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:10.959724+0000","last_change":"2023-07-13T13:52:16.607515+0000","last_active":"2023-07-13T14:20:10.959724+0000","last_peered":"2023-07-13T14:20:10.959724+0000","last_clean":"2023-07-13T14:20:10.959724+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T14:20:10.959724+0000","last_undegraded":"2023-07-13T14:20:10.959724+0000","last_fullsized":"2023-07-13T14:20:10.959724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:31.911995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'33","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.115258+0000","last_change":"2023-07-13T13:52:17.934538+0000","last_active":"2023-07-13T14:20:29.115258+0000","last_peered":"2023-07-13T14:20:29.115258+0000","last_clean":"2023-07-13T14:20:29.115258+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T14:20:29.115258+0000","last_undegraded":"2023-07-13T14:20:29.115258+0000","last_fullsized":"2023-07-13T14:20:29.115258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:01.447721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"31'138","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.568510+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T14:19:53.568510+0000","last_peered":"2023-07-13T14:19:53.568510+0000","last_clean":"2023-07-13T14:19:53.568510+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T14:19:53.568510+0000","last_undegraded":"2023-07-13T14:19:53.568510+0000","last_fullsized":"2023-07-13T14:19:53.568510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:13:08.564646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.193691+0000","last_change":"2023-07-13T13:52:16.668908+0000","last_active":"2023-07-13T14:20:17.193691+0000","last_peered":"2023-07-13T14:20:17.193691+0000","last_clean":"2023-07-13T14:20:17.193691+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T14:20:17.193691+0000","last_undegraded":"2023-07-13T14:20:17.193691+0000","last_fullsized":"2023-07-13T14:20:17.193691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:30:26.894929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'25","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056582+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T14:20:29.056582+0000","last_peered":"2023-07-13T14:20:29.056582+0000","last_clean":"2023-07-13T14:20:29.056582+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T14:20:29.056582+0000","last_undegraded":"2023-07-13T14:20:29.056582+0000","last_fullsized":"2023-07-13T14:20:29.056582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:48.380599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.577512+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T14:19:53.577512+0000","last_peered":"2023-07-13T14:19:53.577512+0000","last_clean":"2023-07-13T14:19:53.577512+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T14:19:53.577512+0000","last_undegraded":"2023-07-13T14:19:53.577512+0000","last_fullsized":"2023-07-13T14:19:53.577512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:34:34.679685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":9189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:08.889486+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T14:20:08.889486+0000","last_peered":"2023-07-13T14:20:08.889486+0000","last_clean":"2023-07-13T14:20:08.889486+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T14:20:08.889486+0000","last_undegraded":"2023-07-13T14:20:08.889486+0000","last_fullsized":"2023-07-13T14:20:08.889486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:02.471208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"31'28","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.060805+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T14:20:29.060805+0000","last_peered":"2023-07-13T14:20:29.060805+0000","last_clean":"2023-07-13T14:20:29.060805+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T14:20:29.060805+0000","last_undegraded":"2023-07-13T14:20:29.060805+0000","last_fullsized":"2023-07-13T14:20:29.060805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:23.423317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"31'148","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:54.594249+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T14:19:54.594249+0000","last_peered":"2023-07-13T14:19:54.594249+0000","last_clean":"2023-07-13T14:19:54.594249+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T14:19:54.594249+0000","last_undegraded":"2023-07-13T14:19:54.594249+0000","last_fullsized":"2023-07-13T14:19:54.594249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:18.763893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":18843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'535","reported_seq":573,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.083140+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T14:20:21.083140+0000","last_peered":"2023-07-13T14:20:21.083140+0000","last_clean":"2023-07-13T14:20:21.083140+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T14:20:21.083140+0000","last_undegraded":"2023-07-13T14:20:21.083140+0000","last_fullsized":"2023-07-13T14:20:21.083140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:47.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"31'35","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230975+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T14:20:29.230975+0000","last_peered":"2023-07-13T14:20:29.230975+0000","last_clean":"2023-07-13T14:20:29.230975+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T14:20:29.230975+0000","last_undegraded":"2023-07-13T14:20:29.230975+0000","last_fullsized":"2023-07-13T14:20:29.230975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:50:42.203743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'132","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.469982+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T14:19:52.469982+0000","last_peered":"2023-07-13T14:19:52.469982+0000","last_clean":"2023-07-13T14:19:52.469982+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T14:19:52.469982+0000","last_undegraded":"2023-07-13T14:19:52.469982+0000","last_fullsized":"2023-07-13T14:19:52.469982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:27:28.126700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":15927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'845","reported_seq":884,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:16.964985+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T14:20:16.964985+0000","last_peered":"2023-07-13T14:20:16.964985+0000","last_clean":"2023-07-13T14:20:16.964985+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T14:20:16.964985+0000","last_undegraded":"2023-07-13T14:20:16.964985+0000","last_fullsized":"2023-07-13T14:20:16.964985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:28:31.879491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"31'43","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055462+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T14:20:29.055462+0000","last_peered":"2023-07-13T14:20:29.055462+0000","last_clean":"2023-07-13T14:20:29.055462+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T14:20:29.055462+0000","last_undegraded":"2023-07-13T14:20:29.055462+0000","last_fullsized":"2023-07-13T14:20:29.055462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:20:57.526559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"31'113","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.764052+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T14:19:51.764052+0000","last_peered":"2023-07-13T14:19:51.764052+0000","last_clean":"2023-07-13T14:19:51.764052+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T14:19:51.764052+0000","last_undegraded":"2023-07-13T14:19:51.764052+0000","last_fullsized":"2023-07-13T14:19:51.764052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:54.587437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":11208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'8","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.097250+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T14:20:17.097250+0000","last_peered":"2023-07-13T14:20:17.097250+0000","last_clean":"2023-07-13T14:20:17.097250+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T14:20:17.097250+0000","last_undegraded":"2023-07-13T14:20:17.097250+0000","last_fullsized":"2023-07-13T14:20:17.097250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'27","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055907+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T14:20:29.055907+0000","last_peered":"2023-07-13T14:20:29.055907+0000","last_clean":"2023-07-13T14:20:29.055907+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T14:20:29.055907+0000","last_undegraded":"2023-07-13T14:20:29.055907+0000","last_fullsized":"2023-07-13T14:20:29.055907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:21:54.287499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'88","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576577+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T14:19:53.576577+0000","last_peered":"2023-07-13T14:19:53.576577+0000","last_clean":"2023-07-13T14:19:53.576577+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T14:19:53.576577+0000","last_undegraded":"2023-07-13T14:19:53.576577+0000","last_fullsized":"2023-07-13T14:19:53.576577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:39:40.932985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:16.902628+0000","last_change":"2023-07-13T13:52:16.663350+0000","last_active":"2023-07-13T14:20:16.902628+0000","last_peered":"2023-07-13T14:20:16.902628+0000","last_clean":"2023-07-13T14:20:16.902628+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T14:20:16.902628+0000","last_undegraded":"2023-07-13T14:20:16.902628+0000","last_fullsized":"2023-07-13T14:20:16.902628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:42:33.767450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.032664+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T14:20:29.032664+0000","last_peered":"2023-07-13T14:20:29.032664+0000","last_clean":"2023-07-13T14:20:29.032664+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T14:20:29.032664+0000","last_undegraded":"2023-07-13T14:20:29.032664+0000","last_fullsized":"2023-07-13T14:20:29.032664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:20:42.938534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"31'107","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.773562+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T14:19:51.773562+0000","last_peered":"2023-07-13T14:19:51.773562+0000","last_clean":"2023-07-13T14:19:51.773562+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T14:19:51.773562+0000","last_undegraded":"2023-07-13T14:19:51.773562+0000","last_fullsized":"2023-07-13T14:19:51.773562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:14:55.793442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:20.085088+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T14:20:20.085088+0000","last_peered":"2023-07-13T14:20:20.085088+0000","last_clean":"2023-07-13T14:20:20.085088+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T14:20:20.085088+0000","last_undegraded":"2023-07-13T14:20:20.085088+0000","last_fullsized":"2023-07-13T14:20:20.085088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:04.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"31'37","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217508+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T14:20:29.217508+0000","last_peered":"2023-07-13T14:20:29.217508+0000","last_clean":"2023-07-13T14:20:29.217508+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T14:20:29.217508+0000","last_undegraded":"2023-07-13T14:20:29.217508+0000","last_fullsized":"2023-07-13T14:20:29.217508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:18:20.394545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'128","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.462763+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T14:19:52.462763+0000","last_peered":"2023-07-13T14:19:52.462763+0000","last_clean":"2023-07-13T14:19:52.462763+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T14:19:52.462763+0000","last_undegraded":"2023-07-13T14:19:52.462763+0000","last_fullsized":"2023-07-13T14:19:52.462763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:36.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'14","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.005215+0000","last_change":"2023-07-13T13:52:16.692808+0000","last_active":"2023-07-13T14:20:17.005215+0000","last_peered":"2023-07-13T14:20:17.005215+0000","last_clean":"2023-07-13T14:20:17.005215+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T14:20:17.005215+0000","last_undegraded":"2023-07-13T14:20:17.005215+0000","last_fullsized":"2023-07-13T14:20:17.005215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:10.067515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'32","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055961+0000","last_change":"2023-07-13T13:52:17.838408+0000","last_active":"2023-07-13T14:20:29.055961+0000","last_peered":"2023-07-13T14:20:29.055961+0000","last_clean":"2023-07-13T14:20:29.055961+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T14:20:29.055961+0000","last_undegraded":"2023-07-13T14:20:29.055961+0000","last_fullsized":"2023-07-13T14:20:29.055961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:57:58.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"31'122","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.418083+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T14:19:52.418083+0000","last_peered":"2023-07-13T14:19:52.418083+0000","last_clean":"2023-07-13T14:19:52.418083+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T14:19:52.418083+0000","last_undegraded":"2023-07-13T14:19:52.418083+0000","last_fullsized":"2023-07-13T14:19:52.418083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:53.223544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.158417+0000","last_change":"2023-07-13T13:52:16.666097+0000","last_active":"2023-07-13T14:20:17.158417+0000","last_peered":"2023-07-13T14:20:17.158417+0000","last_clean":"2023-07-13T14:20:17.158417+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T14:20:17.158417+0000","last_undegraded":"2023-07-13T14:20:17.158417+0000","last_fullsized":"2023-07-13T14:20:17.158417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"31'31","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035188+0000","last_change":"2023-07-13T13:52:17.838908+0000","last_active":"2023-07-13T14:20:29.035188+0000","last_peered":"2023-07-13T14:20:29.035188+0000","last_clean":"2023-07-13T14:20:29.035188+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T14:20:29.035188+0000","last_undegraded":"2023-07-13T14:20:29.035188+0000","last_fullsized":"2023-07-13T14:20:29.035188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:34:28.472848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'99","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.254376+0000","last_change":"2023-07-13T13:52:23.993113+0000","last_active":"2023-07-13T14:19:51.254376+0000","last_peered":"2023-07-13T14:19:51.254376+0000","last_clean":"2023-07-13T14:19:51.254376+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T14:19:51.254376+0000","last_undegraded":"2023-07-13T14:19:51.254376+0000","last_fullsized":"2023-07-13T14:19:51.254376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:50:50.731203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:09.919165+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T14:20:09.919165+0000","last_peered":"2023-07-13T14:20:09.919165+0000","last_clean":"2023-07-13T14:20:09.919165+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T14:20:09.919165+0000","last_undegraded":"2023-07-13T14:20:09.919165+0000","last_fullsized":"2023-07-13T14:20:09.919165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:22.277267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035068+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T14:20:29.035068+0000","last_peered":"2023-07-13T14:20:29.035068+0000","last_clean":"2023-07-13T14:20:29.035068+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T14:20:29.035068+0000","last_undegraded":"2023-07-13T14:20:29.035068+0000","last_fullsized":"2023-07-13T14:20:29.035068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:29:43.401303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"31'154","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:50.928044+0000","last_change":"2023-07-13T13:52:23.992085+0000","last_active":"2023-07-13T14:19:50.928044+0000","last_peered":"2023-07-13T14:19:50.928044+0000","last_clean":"2023-07-13T14:19:50.928044+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T14:19:50.928044+0000","last_undegraded":"2023-07-13T14:19:50.928044+0000","last_fullsized":"2023-07-13T14:19:50.928044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:11.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.792804+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T14:19:57.792804+0000","last_peered":"2023-07-13T14:19:57.792804+0000","last_clean":"2023-07-13T14:19:57.792804+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T14:19:57.792804+0000","last_undegraded":"2023-07-13T14:19:57.792804+0000","last_fullsized":"2023-07-13T14:19:57.792804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:18.416220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"31'24","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.116356+0000","last_change":"2023-07-13T13:52:17.952164+0000","last_active":"2023-07-13T14:20:29.116356+0000","last_peered":"2023-07-13T14:20:29.116356+0000","last_clean":"2023-07-13T14:20:29.116356+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T14:20:29.116356+0000","last_undegraded":"2023-07-13T14:20:29.116356+0000","last_fullsized":"2023-07-13T14:20:29.116356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:58:56.106442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'113","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.024082+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T14:19:51.024082+0000","last_peered":"2023-07-13T14:19:51.024082+0000","last_clean":"2023-07-13T14:19:51.024082+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T14:19:51.024082+0000","last_undegraded":"2023-07-13T14:19:51.024082+0000","last_fullsized":"2023-07-13T14:19:51.024082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:18.127640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:04.797820+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T14:20:04.797820+0000","last_peered":"2023-07-13T14:20:04.797820+0000","last_clean":"2023-07-13T14:20:04.797820+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T14:20:04.797820+0000","last_undegraded":"2023-07-13T14:20:04.797820+0000","last_fullsized":"2023-07-13T14:20:04.797820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:18.013759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'32","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218708+0000","last_change":"2023-07-13T13:52:17.952349+0000","last_active":"2023-07-13T14:20:29.218708+0000","last_peered":"2023-07-13T14:20:29.218708+0000","last_clean":"2023-07-13T14:20:29.218708+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T14:20:29.218708+0000","last_undegraded":"2023-07-13T14:20:29.218708+0000","last_fullsized":"2023-07-13T14:20:29.218708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:33.131082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'94","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:49.447041+0000","last_change":"2023-07-13T13:52:23.987269+0000","last_active":"2023-07-13T14:19:49.447041+0000","last_peered":"2023-07-13T14:19:49.447041+0000","last_clean":"2023-07-13T14:19:49.447041+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T14:19:49.447041+0000","last_undegraded":"2023-07-13T14:19:49.447041+0000","last_fullsized":"2023-07-13T14:19:49.447041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:04:05.152920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'580","reported_seq":619,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.881428+0000","last_change":"2023-07-13T13:52:16.607455+0000","last_active":"2023-07-13T14:20:06.881428+0000","last_peered":"2023-07-13T14:20:06.881428+0000","last_clean":"2023-07-13T14:20:06.881428+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T14:20:06.881428+0000","last_undegraded":"2023-07-13T14:20:06.881428+0000","last_fullsized":"2023-07-13T14:20:06.881428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:18.416220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"31'30","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.038118+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T14:20:29.038118+0000","last_peered":"2023-07-13T14:20:29.038118+0000","last_clean":"2023-07-13T14:20:29.038118+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T14:20:29.038118+0000","last_undegraded":"2023-07-13T14:20:29.038118+0000","last_fullsized":"2023-07-13T14:20:29.038118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:11.058247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'157","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.263137+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T14:19:51.263137+0000","last_peered":"2023-07-13T14:19:51.263137+0000","last_clean":"2023-07-13T14:19:51.263137+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T14:19:51.263137+0000","last_undegraded":"2023-07-13T14:19:51.263137+0000","last_fullsized":"2023-07-13T14:19:51.263137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:00:18.515871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":13657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:08.889681+0000","last_change":"2023-07-13T13:52:16.692899+0000","last_active":"2023-07-13T14:20:08.889681+0000","last_peered":"2023-07-13T14:20:08.889681+0000","last_clean":"2023-07-13T14:20:08.889681+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T14:20:08.889681+0000","last_undegraded":"2023-07-13T14:20:08.889681+0000","last_fullsized":"2023-07-13T14:20:08.889681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:16:15.151366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"31'28","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052840+0000","last_change":"2023-07-13T13:52:17.942165+0000","last_active":"2023-07-13T14:20:29.052840+0000","last_peered":"2023-07-13T14:20:29.052840+0000","last_clean":"2023-07-13T14:20:29.052840+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T14:20:29.052840+0000","last_undegraded":"2023-07-13T14:20:29.052840+0000","last_fullsized":"2023-07-13T14:20:29.052840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.112967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'108","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576192+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T14:19:53.576192+0000","last_peered":"2023-07-13T14:19:53.576192+0000","last_clean":"2023-07-13T14:19:53.576192+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T14:19:53.576192+0000","last_undegraded":"2023-07-13T14:19:53.576192+0000","last_fullsized":"2023-07-13T14:19:53.576192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:25.769108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":8018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.896456+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T14:20:06.896456+0000","last_peered":"2023-07-13T14:20:06.896456+0000","last_clean":"2023-07-13T14:20:06.896456+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T14:20:06.896456+0000","last_undegraded":"2023-07-13T14:20:06.896456+0000","last_fullsized":"2023-07-13T14:20:06.896456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:48:26.050917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"31'17","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.042824+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T14:20:29.042824+0000","last_peered":"2023-07-13T14:20:29.042824+0000","last_clean":"2023-07-13T14:20:29.042824+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T14:20:29.042824+0000","last_undegraded":"2023-07-13T14:20:29.042824+0000","last_fullsized":"2023-07-13T14:20:29.042824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:57:35.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.776600+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T14:19:51.776600+0000","last_peered":"2023-07-13T14:19:51.776600+0000","last_clean":"2023-07-13T14:19:51.776600+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T14:19:51.776600+0000","last_undegraded":"2023-07-13T14:19:51.776600+0000","last_fullsized":"2023-07-13T14:19:51.776600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:29:10.436681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:18.080416+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T14:20:18.080416+0000","last_peered":"2023-07-13T14:20:18.080416+0000","last_clean":"2023-07-13T14:20:18.080416+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T14:20:18.080416+0000","last_undegraded":"2023-07-13T14:20:18.080416+0000","last_fullsized":"2023-07-13T14:20:18.080416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'31","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227715+0000","last_change":"2023-07-13T13:52:17.949610+0000","last_active":"2023-07-13T14:20:29.227715+0000","last_peered":"2023-07-13T14:20:29.227715+0000","last_clean":"2023-07-13T14:20:29.227715+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T14:20:29.227715+0000","last_undegraded":"2023-07-13T14:20:29.227715+0000","last_fullsized":"2023-07-13T14:20:29.227715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:17:32.249199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.467905+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T14:19:52.467905+0000","last_peered":"2023-07-13T14:19:52.467905+0000","last_clean":"2023-07-13T14:19:52.467905+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T14:19:52.467905+0000","last_undegraded":"2023-07-13T14:19:52.467905+0000","last_fullsized":"2023-07-13T14:19:52.467905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:09:55.119214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:01.898722+0000","last_change":"2023-07-13T13:51:59.916015+0000","last_active":"2023-07-13T14:17:01.898722+0000","last_peered":"2023-07-13T14:17:01.898722+0000","last_clean":"2023-07-13T14:17:01.898722+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T14:17:01.898722+0000","last_undegraded":"2023-07-13T14:17:01.898722+0000","last_fullsized":"2023-07-13T14:17:01.898722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:19:25.211327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.882185+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T14:20:06.882185+0000","last_peered":"2023-07-13T14:20:06.882185+0000","last_clean":"2023-07-13T14:20:06.882185+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T14:20:06.882185+0000","last_undegraded":"2023-07-13T14:20:06.882185+0000","last_fullsized":"2023-07-13T14:20:06.882185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:31.911995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233750+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T14:20:29.233750+0000","last_peered":"2023-07-13T14:20:29.233750+0000","last_clean":"2023-07-13T14:20:29.233750+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T14:20:29.233750+0000","last_undegraded":"2023-07-13T14:20:29.233750+0000","last_fullsized":"2023-07-13T14:20:29.233750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:15.006259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'128","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.771202+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T14:19:51.771202+0000","last_peered":"2023-07-13T14:19:51.771202+0000","last_clean":"2023-07-13T14:19:51.771202+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T14:19:51.771202+0000","last_undegraded":"2023-07-13T14:19:51.771202+0000","last_fullsized":"2023-07-13T14:19:51.771202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:48:59.588023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":10905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.024467+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T14:17:02.024467+0000","last_peered":"2023-07-13T14:17:02.024467+0000","last_clean":"2023-07-13T14:17:02.024467+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T14:17:02.024467+0000","last_undegraded":"2023-07-13T14:17:02.024467+0000","last_fullsized":"2023-07-13T14:17:02.024467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:16.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:09.925212+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T14:20:09.925212+0000","last_peered":"2023-07-13T14:20:09.925212+0000","last_clean":"2023-07-13T14:20:09.925212+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T14:20:09.925212+0000","last_undegraded":"2023-07-13T14:20:09.925212+0000","last_fullsized":"2023-07-13T14:20:09.925212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:29:17.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"31'27","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230093+0000","last_change":"2023-07-13T13:52:17.947909+0000","last_active":"2023-07-13T14:20:29.230093+0000","last_peered":"2023-07-13T14:20:29.230093+0000","last_clean":"2023-07-13T14:20:29.230093+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T14:20:29.230093+0000","last_undegraded":"2023-07-13T14:20:29.230093+0000","last_fullsized":"2023-07-13T14:20:29.230093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:46:46.566206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'124","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.463674+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T14:19:51.463674+0000","last_peered":"2023-07-13T14:19:51.463674+0000","last_clean":"2023-07-13T14:19:51.463674+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T14:19:51.463674+0000","last_undegraded":"2023-07-13T14:19:51.463674+0000","last_fullsized":"2023-07-13T14:19:51.463674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:12:06.075843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.045790+0000","last_change":"2023-07-13T13:52:01.224691+0000","last_active":"2023-07-13T14:17:02.045790+0000","last_peered":"2023-07-13T14:17:02.045790+0000","last_clean":"2023-07-13T14:17:02.045790+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T14:17:02.045790+0000","last_undegraded":"2023-07-13T14:17:02.045790+0000","last_fullsized":"2023-07-13T14:17:02.045790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:24.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'185","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:28.835914+0000","last_change":"2023-07-13T13:52:16.668065+0000","last_active":"2023-07-13T14:20:28.835914+0000","last_peered":"2023-07-13T14:20:28.835914+0000","last_clean":"2023-07-13T14:20:28.835914+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T14:20:28.835914+0000","last_undegraded":"2023-07-13T14:20:28.835914+0000","last_fullsized":"2023-07-13T14:20:28.835914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:05:52.448061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1434466,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233347+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T14:20:29.233347+0000","last_peered":"2023-07-13T14:20:29.233347+0000","last_clean":"2023-07-13T14:20:29.233347+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T14:20:29.233347+0000","last_undegraded":"2023-07-13T14:20:29.233347+0000","last_fullsized":"2023-07-13T14:20:29.233347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:48:53.381186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:49.425871+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T14:19:49.425871+0000","last_peered":"2023-07-13T14:19:49.425871+0000","last_clean":"2023-07-13T14:19:49.425871+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T14:19:49.425871+0000","last_undegraded":"2023-07-13T14:19:49.425871+0000","last_fullsized":"2023-07-13T14:19:49.425871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:25.366647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.024504+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T14:17:02.024504+0000","last_peered":"2023-07-13T14:17:02.024504+0000","last_clean":"2023-07-13T14:17:02.024504+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T14:17:02.024504+0000","last_undegraded":"2023-07-13T14:17:02.024504+0000","last_fullsized":"2023-07-13T14:17:02.024504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:51:43.589579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:02.080996+0000","last_change":"2023-07-13T13:51:57.962882+0000","last_active":"2023-07-13T14:18:02.080996+0000","last_peered":"2023-07-13T14:18:02.080996+0000","last_clean":"2023-07-13T14:18:02.080996+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T14:18:02.080996+0000","last_undegraded":"2023-07-13T14:18:02.080996+0000","last_fullsized":"2023-07-13T14:18:02.080996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_clean_scrub_stamp":"2023-07-13T13:51:55.598839+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:04:40.216785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:16.894211+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T14:17:16.894211+0000","last_peered":"2023-07-13T14:17:16.894211+0000","last_clean":"2023-07-13T14:17:16.894211+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T14:17:16.894211+0000","last_undegraded":"2023-07-13T14:17:16.894211+0000","last_fullsized":"2023-07-13T14:17:16.894211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"31'29","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.108922+0000","last_change":"2023-07-13T13:52:17.942525+0000","last_active":"2023-07-13T14:20:29.108922+0000","last_peered":"2023-07-13T14:20:29.108922+0000","last_clean":"2023-07-13T14:20:29.108922+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T14:20:29.108922+0000","last_undegraded":"2023-07-13T14:20:29.108922+0000","last_fullsized":"2023-07-13T14:20:29.108922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:05.040114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"31'125","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.764052+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T14:19:51.764052+0000","last_peered":"2023-07-13T14:19:51.764052+0000","last_clean":"2023-07-13T14:19:51.764052+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T14:19:51.764052+0000","last_undegraded":"2023-07-13T14:19:51.764052+0000","last_fullsized":"2023-07-13T14:19:51.764052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:29.630154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:07.081687+0000","last_change":"2023-07-13T13:52:00.016430+0000","last_active":"2023-07-13T14:18:07.081687+0000","last_peered":"2023-07-13T14:18:07.081687+0000","last_clean":"2023-07-13T14:18:07.081687+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T14:18:07.081687+0000","last_undegraded":"2023-07-13T14:18:07.081687+0000","last_fullsized":"2023-07-13T14:18:07.081687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:38:16.040470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"31'816","reported_seq":1663,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:24.078247+0000","last_change":"2023-07-13T13:52:16.630297+0000","last_active":"2023-07-13T14:20:24.078247+0000","last_peered":"2023-07-13T14:20:24.078247+0000","last_clean":"2023-07-13T14:20:24.078247+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T14:20:24.078247+0000","last_undegraded":"2023-07-13T14:20:24.078247+0000","last_fullsized":"2023-07-13T14:20:24.078247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:50:41.057693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174695,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":810,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"31'38","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217477+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T14:20:29.217477+0000","last_peered":"2023-07-13T14:20:29.217477+0000","last_clean":"2023-07-13T14:20:29.217477+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T14:20:29.217477+0000","last_undegraded":"2023-07-13T14:20:29.217477+0000","last_fullsized":"2023-07-13T14:20:29.217477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:50:40.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"31'163","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.699178+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T14:19:51.699178+0000","last_peered":"2023-07-13T14:19:51.699178+0000","last_clean":"2023-07-13T14:19:51.699178+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T14:19:51.699178+0000","last_undegraded":"2023-07-13T14:19:51.699178+0000","last_fullsized":"2023-07-13T14:19:51.699178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:49:00.719154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":7667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:07.073993+0000","last_change":"2023-07-13T13:52:00.019670+0000","last_active":"2023-07-13T14:17:07.073993+0000","last_peered":"2023-07-13T14:17:07.073993+0000","last_clean":"2023-07-13T14:17:07.073993+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T14:17:07.073993+0000","last_undegraded":"2023-07-13T14:17:07.073993+0000","last_fullsized":"2023-07-13T14:17:07.073993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:23:45.429201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:05.809167+0000","last_change":"2023-07-13T13:52:16.668244+0000","last_active":"2023-07-13T14:20:05.809167+0000","last_peered":"2023-07-13T14:20:05.809167+0000","last_clean":"2023-07-13T14:20:05.809167+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T14:20:05.809167+0000","last_undegraded":"2023-07-13T14:20:05.809167+0000","last_fullsized":"2023-07-13T14:20:05.809167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:42:33.767450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219044+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T14:20:29.219044+0000","last_peered":"2023-07-13T14:20:29.219044+0000","last_clean":"2023-07-13T14:20:29.219044+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T14:20:29.219044+0000","last_undegraded":"2023-07-13T14:20:29.219044+0000","last_fullsized":"2023-07-13T14:20:29.219044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:23:56.694084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"31'90","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573245+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T14:19:53.573245+0000","last_peered":"2023-07-13T14:19:53.573245+0000","last_clean":"2023-07-13T14:19:53.573245+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T14:19:53.573245+0000","last_undegraded":"2023-07-13T14:19:53.573245+0000","last_fullsized":"2023-07-13T14:19:53.573245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:46:13.524291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.078016+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T14:20:21.078016+0000","last_peered":"2023-07-13T14:20:21.078016+0000","last_clean":"2023-07-13T14:20:21.078016+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T14:20:21.078016+0000","last_undegraded":"2023-07-13T14:20:21.078016+0000","last_fullsized":"2023-07-13T14:20:21.078016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:33.167123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:01.905109+0000","last_change":"2023-07-13T13:51:59.757569+0000","last_active":"2023-07-13T14:18:01.905109+0000","last_peered":"2023-07-13T14:18:01.905109+0000","last_clean":"2023-07-13T14:18:01.905109+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T14:18:01.905109+0000","last_undegraded":"2023-07-13T14:18:01.905109+0000","last_fullsized":"2023-07-13T14:18:01.905109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:17.316170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'30","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056742+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T14:20:29.056742+0000","last_peered":"2023-07-13T14:20:29.056742+0000","last_clean":"2023-07-13T14:20:29.056742+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T14:20:29.056742+0000","last_undegraded":"2023-07-13T14:20:29.056742+0000","last_fullsized":"2023-07-13T14:20:29.056742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:19.159810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"31'139","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.577318+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T14:19:53.577318+0000","last_peered":"2023-07-13T14:19:53.577318+0000","last_clean":"2023-07-13T14:19:53.577318+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T14:19:53.577318+0000","last_undegraded":"2023-07-13T14:19:53.577318+0000","last_fullsized":"2023-07-13T14:19:53.577318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:36.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":9717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:01.989782+0000","last_change":"2023-07-13T13:52:00.015919+0000","last_active":"2023-07-13T14:18:01.989782+0000","last_peered":"2023-07-13T14:18:01.989782+0000","last_clean":"2023-07-13T14:18:01.989782+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T14:18:01.989782+0000","last_undegraded":"2023-07-13T14:18:01.989782+0000","last_fullsized":"2023-07-13T14:18:01.989782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:04:39.121531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'314","reported_seq":352,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.903663+0000","last_change":"2023-07-13T13:52:16.665545+0000","last_active":"2023-07-13T14:20:26.903663+0000","last_peered":"2023-07-13T14:20:26.903663+0000","last_clean":"2023-07-13T14:20:26.903663+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T14:20:26.903663+0000","last_undegraded":"2023-07-13T14:20:26.903663+0000","last_fullsized":"2023-07-13T14:20:26.903663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:38:57.883779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"31'21","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052825+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T14:20:29.052825+0000","last_peered":"2023-07-13T14:20:29.052825+0000","last_clean":"2023-07-13T14:20:29.052825+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T14:20:29.052825+0000","last_undegraded":"2023-07-13T14:20:29.052825+0000","last_fullsized":"2023-07-13T14:20:29.052825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:18:29.892355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'134","reported_seq":162,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.470366+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T14:19:52.470366+0000","last_peered":"2023-07-13T14:19:52.470366+0000","last_clean":"2023-07-13T14:19:52.470366+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T14:19:52.470366+0000","last_undegraded":"2023-07-13T14:19:52.470366+0000","last_fullsized":"2023-07-13T14:19:52.470366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:09:55.119214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'713","reported_seq":749,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:14.073314+0000","last_change":"2023-07-13T13:52:16.631174+0000","last_active":"2023-07-13T14:20:14.073314+0000","last_peered":"2023-07-13T14:20:14.073314+0000","last_clean":"2023-07-13T14:20:14.073314+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T14:20:14.073314+0000","last_undegraded":"2023-07-13T14:20:14.073314+0000","last_fullsized":"2023-07-13T14:20:14.073314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:20:27.968678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'26","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071759+0000","last_change":"2023-07-13T13:52:17.952450+0000","last_active":"2023-07-13T14:20:29.071759+0000","last_peered":"2023-07-13T14:20:29.071759+0000","last_clean":"2023-07-13T14:20:29.071759+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T14:20:29.071759+0000","last_undegraded":"2023-07-13T14:20:29.071759+0000","last_fullsized":"2023-07-13T14:20:29.071759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:37.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"31'117","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576845+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T14:19:53.576845+0000","last_peered":"2023-07-13T14:19:53.576845+0000","last_clean":"2023-07-13T14:19:53.576845+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T14:19:53.576845+0000","last_undegraded":"2023-07-13T14:19:53.576845+0000","last_fullsized":"2023-07-13T14:19:53.576845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:52:07.984474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":13476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.735845+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T14:19:57.735845+0000","last_peered":"2023-07-13T14:19:57.735845+0000","last_clean":"2023-07-13T14:19:57.735845+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T14:19:57.735845+0000","last_undegraded":"2023-07-13T14:19:57.735845+0000","last_fullsized":"2023-07-13T14:19:57.735845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'33","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055762+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T14:20:29.055762+0000","last_peered":"2023-07-13T14:20:29.055762+0000","last_clean":"2023-07-13T14:20:29.055762+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T14:20:29.055762+0000","last_undegraded":"2023-07-13T14:20:29.055762+0000","last_fullsized":"2023-07-13T14:20:29.055762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:00.624407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'97","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576096+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T14:19:53.576096+0000","last_peered":"2023-07-13T14:19:53.576096+0000","last_clean":"2023-07-13T14:19:53.576096+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T14:19:53.576096+0000","last_undegraded":"2023-07-13T14:19:53.576096+0000","last_fullsized":"2023-07-13T14:19:53.576096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:12.309060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":9809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"31'1257","reported_seq":1295,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:15.025807+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T14:20:15.025807+0000","last_peered":"2023-07-13T14:20:15.025807+0000","last_clean":"2023-07-13T14:20:15.025807+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T14:20:15.025807+0000","last_undegraded":"2023-07-13T14:20:15.025807+0000","last_fullsized":"2023-07-13T14:20:15.025807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'30","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056304+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T14:20:29.056304+0000","last_peered":"2023-07-13T14:20:29.056304+0000","last_clean":"2023-07-13T14:20:29.056304+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T14:20:29.056304+0000","last_undegraded":"2023-07-13T14:20:29.056304+0000","last_fullsized":"2023-07-13T14:20:29.056304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:21:26.463017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"31'115","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573399+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T14:19:53.573399+0000","last_peered":"2023-07-13T14:19:53.573399+0000","last_clean":"2023-07-13T14:19:53.573399+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T14:19:53.573399+0000","last_undegraded":"2023-07-13T14:19:53.573399+0000","last_fullsized":"2023-07-13T14:19:53.573399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:30:47.139618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'763","reported_seq":804,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:03.781157+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T14:20:03.781157+0000","last_peered":"2023-07-13T14:20:03.781157+0000","last_clean":"2023-07-13T14:20:03.781157+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T14:20:03.781157+0000","last_undegraded":"2023-07-13T14:20:03.781157+0000","last_fullsized":"2023-07-13T14:20:03.781157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:52:00.662042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":4555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'35","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071562+0000","last_change":"2023-07-13T13:52:17.925281+0000","last_active":"2023-07-13T14:20:29.071562+0000","last_peered":"2023-07-13T14:20:29.071562+0000","last_clean":"2023-07-13T14:20:29.071562+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T14:20:29.071562+0000","last_undegraded":"2023-07-13T14:20:29.071562+0000","last_fullsized":"2023-07-13T14:20:29.071562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:03.617258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'135","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:45.194613+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T14:19:45.194613+0000","last_peered":"2023-07-13T14:19:45.194613+0000","last_clean":"2023-07-13T14:19:45.194613+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T14:19:45.194613+0000","last_undegraded":"2023-07-13T14:19:45.194613+0000","last_fullsized":"2023-07-13T14:19:45.194613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:32:12.577338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":6623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"31'733","reported_seq":771,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:18.081584+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T14:20:18.081584+0000","last_peered":"2023-07-13T14:20:18.081584+0000","last_clean":"2023-07-13T14:20:18.081584+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T14:20:18.081584+0000","last_undegraded":"2023-07-13T14:20:18.081584+0000","last_fullsized":"2023-07-13T14:20:18.081584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:24:48.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'37","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.044987+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T14:20:29.044987+0000","last_peered":"2023-07-13T14:20:29.044987+0000","last_clean":"2023-07-13T14:20:29.044987+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T14:20:29.044987+0000","last_undegraded":"2023-07-13T14:20:29.044987+0000","last_fullsized":"2023-07-13T14:20:29.044987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:11.485106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"31'43","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.109653+0000","last_change":"2023-07-13T13:52:17.933894+0000","last_active":"2023-07-13T14:20:29.109653+0000","last_peered":"2023-07-13T14:20:29.109653+0000","last_clean":"2023-07-13T14:20:29.109653+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T14:20:29.109653+0000","last_undegraded":"2023-07-13T14:20:29.109653+0000","last_fullsized":"2023-07-13T14:20:29.109653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:44:32.655763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.061494+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T14:20:29.061494+0000","last_peered":"2023-07-13T14:20:29.061494+0000","last_clean":"2023-07-13T14:20:29.061494+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T14:20:29.061494+0000","last_undegraded":"2023-07-13T14:20:29.061494+0000","last_fullsized":"2023-07-13T14:20:29.061494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:20:42.938534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"31'42","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.033130+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T14:20:29.033130+0000","last_peered":"2023-07-13T14:20:29.033130+0000","last_clean":"2023-07-13T14:20:29.033130+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T14:20:29.033130+0000","last_undegraded":"2023-07-13T14:20:29.033130+0000","last_fullsized":"2023-07-13T14:20:29.033130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:36:22.078595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"31'28","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.054230+0000","last_change":"2023-07-13T13:52:17.838377+0000","last_active":"2023-07-13T14:20:29.054230+0000","last_peered":"2023-07-13T14:20:29.054230+0000","last_clean":"2023-07-13T14:20:29.054230+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T14:20:29.054230+0000","last_undegraded":"2023-07-13T14:20:29.054230+0000","last_fullsized":"2023-07-13T14:20:29.054230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'22","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227758+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T14:20:29.227758+0000","last_peered":"2023-07-13T14:20:29.227758+0000","last_clean":"2023-07-13T14:20:29.227758+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T14:20:29.227758+0000","last_undegraded":"2023-07-13T14:20:29.227758+0000","last_fullsized":"2023-07-13T14:20:29.227758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:33.131082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3402,"num_write_kb":282366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3765,"ondisk_log_size":3765,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":35165063,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":7922,"num_write_kb":39030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49258496,"data_stored":70330126,"data_compressed":6207514,"data_compressed_allocated":9723904,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":0},"log_size":7484,"ondisk_log_size":7484,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509785,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34704,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337136,"statfs":{"total":96636764160,"available":96601227264,"internally_reserved":0,"allocated":3678208,"data_stored":4927655,"data_compressed":341063,"data_compressed_allocated":569344,"data_compressed_original":2035712,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.625,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.56100000000000005,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.315,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.442},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.28399999999999997,"15min":0.28199999999999997},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":3.2789999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67400000000000004,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.435},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.59499999999999997,"5min":1.0700000000000001,"15min":1.4630000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.35799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61099999999999999,"5min":0.93300000000000005,"15min":1.4650000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67900000000000005,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.626,"5min":0.67600000000000005,"15min":0.83399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.65500000000000003,"15min":0.83299999999999996},"last":0.33200000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.50800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66700000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.79700000000000004},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.86699999999999999},"last":0.5},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.53500000000000003},"min":{"1min":0.34100000000000003,"5min":0.33100000000000002,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.81399999999999995},"last":0.371}]}]},{"osd":6,"up_from":15,"seq":64424509785,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30324,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341516,"statfs":{"total":96636764160,"available":96605712384,"internally_reserved":0,"allocated":3387392,"data_stored":4336399,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.217},"max":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":1.2549999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.67100000000000004,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.56699999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.48599999999999999,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.23400000000000001},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.92500000000000004,"15min":2.1789999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45900000000000002,"15min":0.47799999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":3.4060000000000001},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.28599999999999998},"max":{"1min":2.9500000000000002,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.25900000000000001},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":5.3810000000000002},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.23799999999999999},"max":{"1min":0.59299999999999997,"5min":0.72099999999999997,"15min":0.749},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.80100000000000005},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47599999999999998,"15min":0.46200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63400000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.89500000000000002},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":0.745,"15min":0.75800000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63700000000000001,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575193,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39120,"kb_used_data":3912,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94332720,"statfs":{"total":96636764160,"available":96596705280,"internally_reserved":0,"allocated":4005888,"data_stored":5770865,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":3.7240000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.33800000000000002,"15min":0.34100000000000003},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":0.442,"5min":0.71099999999999997,"15min":0.76200000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.313,"15min":0.33300000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":1.49},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20300000000000001},"max":{"1min":0.57899999999999996,"5min":0.79700000000000004,"15min":0.996},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.60099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.51100000000000001,"5min":1.548,"15min":1.548},"last":0.375}]},{"osd":4,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.30099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.76200000000000001,"5min":0.80100000000000005,"15min":1.266},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.36899999999999999,"15min":0.309},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":1.2869999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.89300000000000002,"15min":0.92800000000000005},"last":0.439}]},{"osd":6,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.34799999999999998,"15min":0.33700000000000002},"max":{"1min":0.75,"5min":1.625,"15min":1.625},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.38,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":1.242},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.95299999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":1.657,"15min":1.657},"last":0.47999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542489,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66744,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94305096,"statfs":{"total":96636764160,"available":96568418304,"internally_reserved":0,"allocated":9617408,"data_stored":13490652,"data_compressed":1179065,"data_compressed_allocated":1941504,"data_compressed_original":6012928,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30399999999999999,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.185},"max":{"1min":0.40999999999999998,"5min":0.53600000000000003,"15min":0.64800000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.19},"max":{"1min":0.48799999999999999,"5min":0.64400000000000002,"15min":1.6879999999999999},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23000000000000001},"max":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.77200000000000002},"last":0.37},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":3.4940000000000002,"15min":3.4940000000000002},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22},"max":{"1min":0.69599999999999995,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":0.56699999999999995,"5min":1.2230000000000001,"15min":2.5379999999999998},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.85099999999999998,"15min":0.91400000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.753}]},{"osd":5,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.26100000000000001},"max":{"1min":0.74099999999999999,"5min":0.80700000000000005,"15min":0.94299999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.748,"5min":0.76900000000000002,"15min":1.0529999999999999},"last":0.629}]},{"osd":6,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.33900000000000002},"max":{"1min":0.753,"5min":0.83699999999999997,"15min":0.96599999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":0.83699999999999997,"15min":0.98299999999999998},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.81499999999999995,"15min":0.997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.86599999999999999,"15min":1.03},"last":0.71899999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509785,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1228800,"data_stored":1576561,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.308},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.46000000000000002,"5min":0.65200000000000002,"15min":0.751},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.34000000000000002,"15min":0.35899999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.42699999999999999,"5min":0.57099999999999995,"15min":3.0939999999999999},"last":0.379}]},{"osd":1,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.24299999999999999,"15min":0.19},"max":{"1min":0.56799999999999995,"5min":0.749,"15min":1.248},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.372,"15min":0.38500000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53300000000000003,"5min":1.081,"15min":2.9529999999999998},"last":0.313}]},{"osd":3,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.21299999999999999},"max":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":2.2490000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.51800000000000002,"5min":1.167,"15min":1.167},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":0.68500000000000005,"5min":0.79300000000000004,"15min":0.82999999999999996},"last":0.435},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.31900000000000001,"15min":0.26700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":2.3220000000000001},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.86899999999999999,"15min":2.3660000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.681},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.73699999999999999,"15min":1.6970000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78200000000000003,"5min":0.94699999999999995,"15min":0.98999999999999999},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.79300000000000004,"5min":0.83899999999999997,"15min":2.4020000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.32600000000000001},"max":{"1min":0.69299999999999995,"5min":0.73799999999999999,"15min":1.6619999999999999},"last":0.44500000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509785,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":6184960,"data_stored":8530793,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.31900000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.17899999999999999},"max":{"1min":0.37,"5min":0.65500000000000003,"15min":0.78300000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.313,"5min":0.316,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.19600000000000001,"15min":0.193},"max":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":2.972},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.374,"15min":0.35499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19900000000000001},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.377},"min":{"1min":0.221,"5min":0.221,"15min":0.218},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":2.173},"last":0.442}]},{"osd":2,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38100000000000001,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23200000000000001},"max":{"1min":0.48299999999999998,"5min":1.6759999999999999,"15min":2.335},"last":0.373},{"interface":"front","average":{"1min":0.379,"5min":0.41099999999999998,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.22800000000000001,"15min":0.214},"max":{"1min":0.501,"5min":0.71399999999999997,"15min":2.2000000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.26000000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.33200000000000002},"max":{"1min":0.82899999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.34300000000000003},"max":{"1min":0.68000000000000005,"5min":0.84299999999999997,"15min":0.84999999999999998},"last":0.626}]},{"osd":7,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.82299999999999995},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.747,"5min":0.91100000000000003,"15min":0.97599999999999998},"last":0.58699999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509785,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77928,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94293912,"statfs":{"total":96636764160,"available":96556965888,"internally_reserved":0,"allocated":15171584,"data_stored":21289038,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":1781,"internal_metadata":64616715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.23400000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.72399999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.441,"15min":0.432},"min":{"1min":0.35199999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68500000000000005},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.436,"15min":0.44},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.25},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.72599999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.33700000000000002,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.73499999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.72899999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":2.266,"15min":2.266},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64100000000000001,"5min":1.2849999999999999,"15min":1.5620000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":1.4259999999999999,"15min":2.6960000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.66200000000000003,"5min":0.73299999999999998,"15min":0.74199999999999999},"last":0.309},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.58799999999999997,"5min":0.65900000000000003,"15min":0.754},"last":0.38}]},{"osd":6,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.46899999999999997,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.25600000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.78900000000000003},"last":0.434}]},{"osd":7,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.41999999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.79000000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.48399999999999999,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.82799999999999996},"last":0.5}]}]},{"osd":5,"up_from":15,"seq":64424509785,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61820,"kb_used_data":8564,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94310020,"statfs":{"total":96636764160,"available":96573460480,"internally_reserved":0,"allocated":8769536,"data_stored":12725659,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.248,"15min":0.23899999999999999},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":0.72399999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.35399999999999998,"5min":0.29099999999999998,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.77700000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.57099999999999995,"5min":1.2729999999999999,"15min":1.7430000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.312,"5min":0.30299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58299999999999996,"5min":0.66800000000000004,"15min":1.284},"last":0.438}]},{"osd":3,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.056},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":0.63300000000000001,"5min":1.3879999999999999,"15min":1.78},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.438,"15min":0.439},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.77400000000000002},"last":0.40200000000000002}]},{"osd":7,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73499999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.496},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68300000000000005,"5min":1.351,"15min":1.351},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":12758189,"data_compressed":1146678,"data_compressed_allocated":1896448,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3674112,"data_stored":5628770,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897024,"data_stored":1434466,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5853184,"data_stored":8388698,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":21146943,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":12583564,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3055616,"data_stored":4194304,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":4195192,"data_compressed":308676,"data_compressed_allocated":524288,"data_compressed_original":1462272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T14:20:35.786 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T14:20:35.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.945+0000 7f918427c700 1 Processor -- start 2023-07-13T14:20:35.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.945+0000 7f918427c700 1 -- start start 2023-07-13T14:20:35.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.946+0000 7f918427c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f917c0c90c0 0x7f917c0c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.946+0000 7f918427c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c158390 0x7f917c162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.946+0000 7f918427c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c0c8b40 con 0x7f917c0c99c0 2023-07-13T14:20:35.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.946+0000 7f918427c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c06c080 con 0x7f917c0c90c0 2023-07-13T14:20:35.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.946+0000 7f918427c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0ca910 con 0x7f917c158390 2023-07-13T14:20:35.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.947+0000 7f9182018700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f917c0c99c0 0x7f917c0c8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47702/0 (socket says 172.21.15.118:47702) 2023-07-13T14:20:35.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.947+0000 7f9182018700 1 -- 172.21.15.118:0/1797443386 learned_addr learned my addr 172.21.15.118:0/1797443386 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:35.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.947+0000 7f9181817700 1 --2- 172.21.15.118:0/1797443386 >> v2:172.21.15.123:3300/0 conn(0x7f917c0c90c0 0x7f917c0c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.947+0000 7f9182819700 1 --2- 172.21.15.118:0/1797443386 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c158390 0x7f917c162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.950+0000 7f9181016700 1 -- 172.21.15.118:0/1797443386 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388825061 0 0) 0x7f917c0c8b40 con 0x7f917c0c99c0 2023-07-13T14:20:35.942 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.950+0000 7f9181016700 1 -- 172.21.15.118:0/1797443386 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91680035b0 con 0x7f917c0c99c0 2023-07-13T14:20:35.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.950+0000 7f9182819700 1 -- 172.21.15.118:0/1797443386 >> v2:172.21.15.123:3300/0 conn(0x7f917c0c90c0 msgr2=0x7f917c0c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:35.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.950+0000 7f9182819700 1 --2- 172.21.15.118:0/1797443386 >> v2:172.21.15.123:3300/0 conn(0x7f917c0c90c0 0x7f917c0c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.950+0000 7f9182819700 1 -- 172.21.15.118:0/1797443386 >> v1:172.21.15.118:6789/0 conn(0x7f917c0c99c0 legacy=0x7f917c0c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.950+0000 7f9182819700 1 -- 172.21.15.118:0/1797443386 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0ca2d0 con 0x7f917c158390 2023-07-13T14:20:35.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.952+0000 7f9182819700 1 --2- 172.21.15.118:0/1797443386 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c158390 0x7f917c162cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9174009d90 tx=0x7f917400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5e619bbb3b11a0f server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:35.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f9181016700 1 -- 172.21.15.118:0/1797443386 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400e070 con 0x7f917c158390 2023-07-13T14:20:35.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f9181016700 1 -- 172.21.15.118:0/1797443386 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917400bb20 con 0x7f917c158390 2023-07-13T14:20:35.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f9181016700 1 -- 172.21.15.118:0/1797443386 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174012430 con 0x7f917c158390 2023-07-13T14:20:35.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f918427c700 1 -- 172.21.15.118:0/1797443386 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c158390 msgr2=0x7f917c162cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f918427c700 1 --2- 172.21.15.118:0/1797443386 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c158390 0x7f917c162cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9174009d90 tx=0x7f917400b330 comp rx=0 tx=0).stop 2023-07-13T14:20:35.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f918427c700 1 -- 172.21.15.118:0/1797443386 shutdown_connections 2023-07-13T14:20:35.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f918427c700 1 --2- 172.21.15.118:0/1797443386 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c158390 0x7f917c162cd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f918427c700 1 --2- 172.21.15.118:0/1797443386 >> v2:172.21.15.123:3300/0 conn(0x7f917c0c90c0 0x7f917c0c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f918427c700 1 -- 172.21.15.118:0/1797443386 >> 172.21.15.118:0/1797443386 conn(0x7f917c06c750 msgr2=0x7f917c06cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f918427c700 1 -- 172.21.15.118:0/1797443386 shutdown_connections 2023-07-13T14:20:35.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.957+0000 7f918427c700 1 -- 172.21.15.118:0/1797443386 wait complete. 2023-07-13T14:20:35.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.959+0000 7f918427c700 1 Processor -- start 2023-07-13T14:20:35.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.959+0000 7f918427c700 1 -- start start 2023-07-13T14:20:35.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.959+0000 7f918427c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0c90c0 0x7f917c1edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.959+0000 7f918427c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c0c99c0 0x7f917c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.959+0000 7f918427c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f917c158390 0x7f917c1ee760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:35.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.959+0000 7f918427c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0c5120 con 0x7f917c0c90c0 2023-07-13T14:20:35.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.959+0000 7f918427c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0cce10 con 0x7f917c158390 2023-07-13T14:20:35.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.959+0000 7f918427c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0c4b80 con 0x7f917c0c99c0 2023-07-13T14:20:35.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.960+0000 7f9182018700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0c90c0 0x7f917c1edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.960+0000 7f9182819700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f917c158390 0x7f917c1ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.960+0000 7f9181817700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c0c99c0 0x7f917c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:35.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.960+0000 7f9182018700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0c90c0 0x7f917c1edbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43930/0 (socket says 172.21.15.118:43930) 2023-07-13T14:20:35.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.960+0000 7f9182018700 1 -- 172.21.15.118:0/632757854 learned_addr learned my addr 172.21.15.118:0/632757854 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:35.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.964+0000 7f9182819700 1 -- 172.21.15.118:0/632757854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c0c99c0 msgr2=0x7f917c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.964+0000 7f9182819700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c0c99c0 0x7f917c1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.964+0000 7f9182819700 1 -- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0c90c0 msgr2=0x7f917c1edbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:35.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.964+0000 7f9182819700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0c90c0 0x7f917c1edbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:35.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.964+0000 7f9182819700 1 -- 172.21.15.118:0/632757854 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9174009a70 con 0x7f917c158390 2023-07-13T14:20:35.959 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.967+0000 7f9182819700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f917c158390 0x7f917c1ee760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9174016000 tx=0x7f9174004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:35.961 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.969+0000 7f9172ffd700 1 -- 172.21.15.118:0/632757854 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174012430 con 0x7f917c158390 2023-07-13T14:20:35.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.969+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c1ee130 con 0x7f917c158390 2023-07-13T14:20:35.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.969+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c154d00 con 0x7f917c158390 2023-07-13T14:20:35.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.970+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c1557e0 con 0x7f917c158390 2023-07-13T14:20:35.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.970+0000 7f9172ffd700 1 -- 172.21.15.118:0/632757854 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9174020070 con 0x7f917c158390 2023-07-13T14:20:35.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:35.970+0000 7f9172ffd700 1 -- 172.21.15.118:0/632757854 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174003e30 con 0x7f917c158390 2023-07-13T14:20:36.216 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.224+0000 7f9172ffd700 1 -- 172.21.15.118:0/632757854 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9174004040 con 0x7f917c158390 2023-07-13T14:20:36.216 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.224+0000 7f9172ffd700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f916006ad10 0x7f916006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:36.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.224+0000 7f9172ffd700 1 -- 172.21.15.118:0/632757854 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9174022070 con 0x7f917c158390 2023-07-13T14:20:36.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.224+0000 7f9182018700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f916006ad10 0x7f916006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:36.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.224+0000 7f9182018700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f916006ad10 0x7f916006d1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f916c0011e0 tx=0x7f916c009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:36.226 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.234+0000 7f9172ffd700 1 -- 172.21.15.118:0/632757854 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91740569c0 con 0x7f917c158390 2023-07-13T14:20:36.408 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.416+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f917c0cec80 con 0x7f916006ad10 2023-07-13T14:20:36.418 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.426+0000 7f9172ffd700 1 -- 172.21.15.118:0/632757854 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393319 (secure 0 0 0) 0x7f916c00f690 con 0x7f916006ad10 2023-07-13T14:20:36.422 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:20:36.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f916006ad10 msgr2=0x7f916006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:36.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f916006ad10 0x7f916006d1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f916c0011e0 tx=0x7f916c009040 comp rx=0 tx=0).stop 2023-07-13T14:20:36.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f917c158390 msgr2=0x7f917c1ee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:36.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f917c158390 0x7f917c1ee760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9174016000 tx=0x7f9174004ad0 comp rx=0 tx=0).stop 2023-07-13T14:20:36.424 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 shutdown_connections 2023-07-13T14:20:36.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f916006ad10 0x7f916006d1c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:36.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f917c158390 0x7f917c1ee760 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:36.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f917c0c90c0 0x7f917c1edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:36.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 --2- 172.21.15.118:0/632757854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f917c0c99c0 0x7f917c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:36.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 >> 172.21.15.118:0/632757854 conn(0x7f917c06c750 msgr2=0x7f917c0cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:36.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 shutdown_connections 2023-07-13T14:20:36.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.430+0000 7f918427c700 1 -- 172.21.15.118:0/632757854 wait complete. 2023-07-13T14:20:36.426 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T14:20:36.434 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":879,"stamp":"2023-07-13T14:20:35.298035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35755431,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":925,"num_read_kb":952,"num_write":11483,"num_write_kb":323812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13364,"ondisk_log_size":13364,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406344,"kb_used_data":50824,"kb_used_omap":13,"kb_used_meta":355442,"kb_avail":754568376,"statfs":{"total":773094113280,"available":772678017024,"internally_reserved":0,"allocated":52043776,"data_stored":72647622,"data_compressed":6272288,"data_compressed_allocated":9814016,"data_compressed_original":32006144,"omap_allocated":14248,"internal_metadata":363972696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11527,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003155"},"pg_stats":[{"pgid":"4.3f","version":"31'26","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.070994+0000","last_change":"2023-07-13T13:52:17.926057+0000","last_active":"2023-07-13T14:20:29.070994+0000","last_peered":"2023-07-13T14:20:29.070994+0000","last_clean":"2023-07-13T14:20:29.070994+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T14:20:29.070994+0000","last_undegraded":"2023-07-13T14:20:29.070994+0000","last_fullsized":"2023-07-13T14:20:29.070994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:09.969490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"31'31","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.030541+0000","last_change":"2023-07-13T13:52:17.952706+0000","last_active":"2023-07-13T14:20:29.030541+0000","last_peered":"2023-07-13T14:20:29.030541+0000","last_clean":"2023-07-13T14:20:29.030541+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T14:20:29.030541+0000","last_undegraded":"2023-07-13T14:20:29.030541+0000","last_fullsized":"2023-07-13T14:20:29.030541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:47.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052353+0000","last_change":"2023-07-13T13:52:17.943505+0000","last_active":"2023-07-13T14:20:29.052353+0000","last_peered":"2023-07-13T14:20:29.052353+0000","last_clean":"2023-07-13T14:20:29.052353+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T14:20:29.052353+0000","last_undegraded":"2023-07-13T14:20:29.052353+0000","last_fullsized":"2023-07-13T14:20:29.052353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:57:33.638855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"31'25","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.116236+0000","last_change":"2023-07-13T13:52:17.933893+0000","last_active":"2023-07-13T14:20:29.116236+0000","last_peered":"2023-07-13T14:20:29.116236+0000","last_clean":"2023-07-13T14:20:29.116236+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T14:20:29.116236+0000","last_undegraded":"2023-07-13T14:20:29.116236+0000","last_fullsized":"2023-07-13T14:20:29.116236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:37:29.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"31'23","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218387+0000","last_change":"2023-07-13T13:52:17.886730+0000","last_active":"2023-07-13T14:20:29.218387+0000","last_peered":"2023-07-13T14:20:29.218387+0000","last_clean":"2023-07-13T14:20:29.218387+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T14:20:29.218387+0000","last_undegraded":"2023-07-13T14:20:29.218387+0000","last_fullsized":"2023-07-13T14:20:29.218387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:46:11.415041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.042967+0000","last_change":"2023-07-13T13:52:17.942599+0000","last_active":"2023-07-13T14:20:29.042967+0000","last_peered":"2023-07-13T14:20:29.042967+0000","last_clean":"2023-07-13T14:20:29.042967+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T14:20:29.042967+0000","last_undegraded":"2023-07-13T14:20:29.042967+0000","last_fullsized":"2023-07-13T14:20:29.042967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:15:36.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071363+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T14:20:29.071363+0000","last_peered":"2023-07-13T14:20:29.071363+0000","last_clean":"2023-07-13T14:20:29.071363+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T14:20:29.071363+0000","last_undegraded":"2023-07-13T14:20:29.071363+0000","last_fullsized":"2023-07-13T14:20:29.071363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:29.831587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"31'22","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037767+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T14:20:29.037767+0000","last_peered":"2023-07-13T14:20:29.037767+0000","last_clean":"2023-07-13T14:20:29.037767+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T14:20:29.037767+0000","last_undegraded":"2023-07-13T14:20:29.037767+0000","last_fullsized":"2023-07-13T14:20:29.037767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:05:01.082348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"31'35","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219321+0000","last_change":"2023-07-13T13:52:58.032563+0000","last_active":"2023-07-13T14:20:29.219321+0000","last_peered":"2023-07-13T14:20:29.219321+0000","last_clean":"2023-07-13T14:20:29.219321+0000","last_became_active":"2023-07-13T13:52:58.032221+0000","last_became_peered":"2023-07-13T13:52:58.032221+0000","last_unstale":"2023-07-13T14:20:29.219321+0000","last_undegraded":"2023-07-13T14:20:29.219321+0000","last_fullsized":"2023-07-13T14:20:29.219321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:17:32.249199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'37","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.040091+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T14:20:29.040091+0000","last_peered":"2023-07-13T14:20:29.040091+0000","last_clean":"2023-07-13T14:20:29.040091+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T14:20:29.040091+0000","last_undegraded":"2023-07-13T14:20:29.040091+0000","last_fullsized":"2023-07-13T14:20:29.040091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"31'30","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.045065+0000","last_change":"2023-07-13T13:52:58.431745+0000","last_active":"2023-07-13T14:20:29.045065+0000","last_peered":"2023-07-13T14:20:29.045065+0000","last_clean":"2023-07-13T14:20:29.045065+0000","last_became_active":"2023-07-13T13:52:58.431466+0000","last_became_peered":"2023-07-13T13:52:58.431466+0000","last_unstale":"2023-07-13T14:20:29.045065+0000","last_undegraded":"2023-07-13T14:20:29.045065+0000","last_fullsized":"2023-07-13T14:20:29.045065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:27:08.861062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"31'22","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.069318+0000","last_change":"2023-07-13T13:52:17.943253+0000","last_active":"2023-07-13T14:20:29.069318+0000","last_peered":"2023-07-13T14:20:29.069318+0000","last_clean":"2023-07-13T14:20:29.069318+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T14:20:29.069318+0000","last_undegraded":"2023-07-13T14:20:29.069318+0000","last_fullsized":"2023-07-13T14:20:29.069318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:19.844182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"31'35","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071128+0000","last_change":"2023-07-13T13:52:17.925230+0000","last_active":"2023-07-13T14:20:29.071128+0000","last_peered":"2023-07-13T14:20:29.071128+0000","last_clean":"2023-07-13T14:20:29.071128+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T14:20:29.071128+0000","last_undegraded":"2023-07-13T14:20:29.071128+0000","last_fullsized":"2023-07-13T14:20:29.071128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'35","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037770+0000","last_change":"2023-07-13T13:52:17.925445+0000","last_active":"2023-07-13T14:20:29.037770+0000","last_peered":"2023-07-13T14:20:29.037770+0000","last_clean":"2023-07-13T14:20:29.037770+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T14:20:29.037770+0000","last_undegraded":"2023-07-13T14:20:29.037770+0000","last_fullsized":"2023-07-13T14:20:29.037770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:38:34.228527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"31'35","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071487+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T14:20:29.071487+0000","last_peered":"2023-07-13T14:20:29.071487+0000","last_clean":"2023-07-13T14:20:29.071487+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T14:20:29.071487+0000","last_undegraded":"2023-07-13T14:20:29.071487+0000","last_fullsized":"2023-07-13T14:20:29.071487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:33.058046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"31'33","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052262+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T14:20:29.052262+0000","last_peered":"2023-07-13T14:20:29.052262+0000","last_clean":"2023-07-13T14:20:29.052262+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T14:20:29.052262+0000","last_undegraded":"2023-07-13T14:20:29.052262+0000","last_fullsized":"2023-07-13T14:20:29.052262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:58:13.171516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"31'32","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219090+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T14:20:29.219090+0000","last_peered":"2023-07-13T14:20:29.219090+0000","last_clean":"2023-07-13T14:20:29.219090+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T14:20:29.219090+0000","last_undegraded":"2023-07-13T14:20:29.219090+0000","last_fullsized":"2023-07-13T14:20:29.219090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:00:48.553687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"31'42","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.053186+0000","last_change":"2023-07-13T13:52:17.942704+0000","last_active":"2023-07-13T14:20:29.053186+0000","last_peered":"2023-07-13T14:20:29.053186+0000","last_clean":"2023-07-13T14:20:29.053186+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T14:20:29.053186+0000","last_undegraded":"2023-07-13T14:20:29.053186+0000","last_fullsized":"2023-07-13T14:20:29.053186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:55:37.936044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"31'31","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.066190+0000","last_change":"2023-07-13T13:52:17.934990+0000","last_active":"2023-07-13T14:20:29.066190+0000","last_peered":"2023-07-13T14:20:29.066190+0000","last_clean":"2023-07-13T14:20:29.066190+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T14:20:29.066190+0000","last_undegraded":"2023-07-13T14:20:29.066190+0000","last_fullsized":"2023-07-13T14:20:29.066190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:02.191186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"31'36","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052769+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T14:20:29.052769+0000","last_peered":"2023-07-13T14:20:29.052769+0000","last_clean":"2023-07-13T14:20:29.052769+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T14:20:29.052769+0000","last_undegraded":"2023-07-13T14:20:29.052769+0000","last_fullsized":"2023-07-13T14:20:29.052769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:06:12.632230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"31'46","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071286+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T14:20:29.071286+0000","last_peered":"2023-07-13T14:20:29.071286+0000","last_clean":"2023-07-13T14:20:29.071286+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T14:20:29.071286+0000","last_undegraded":"2023-07-13T14:20:29.071286+0000","last_fullsized":"2023-07-13T14:20:29.071286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:34.535336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"31'34","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218021+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T14:20:29.218021+0000","last_peered":"2023-07-13T14:20:29.218021+0000","last_clean":"2023-07-13T14:20:29.218021+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T14:20:29.218021+0000","last_undegraded":"2023-07-13T14:20:29.218021+0000","last_fullsized":"2023-07-13T14:20:29.218021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:35.504227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"31'37","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.060231+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T14:20:29.060231+0000","last_peered":"2023-07-13T14:20:29.060231+0000","last_clean":"2023-07-13T14:20:29.060231+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T14:20:29.060231+0000","last_undegraded":"2023-07-13T14:20:29.060231+0000","last_fullsized":"2023-07-13T14:20:29.060231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:47.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071246+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T14:20:29.071246+0000","last_peered":"2023-07-13T14:20:29.071246+0000","last_clean":"2023-07-13T14:20:29.071246+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T14:20:29.071246+0000","last_undegraded":"2023-07-13T14:20:29.071246+0000","last_fullsized":"2023-07-13T14:20:29.071246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"31'27","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.228712+0000","last_change":"2023-07-13T13:52:17.951443+0000","last_active":"2023-07-13T14:20:29.228712+0000","last_peered":"2023-07-13T14:20:29.228712+0000","last_clean":"2023-07-13T14:20:29.228712+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T14:20:29.228712+0000","last_undegraded":"2023-07-13T14:20:29.228712+0000","last_fullsized":"2023-07-13T14:20:29.228712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:38:59.029829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"31'39","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230308+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T14:20:29.230308+0000","last_peered":"2023-07-13T14:20:29.230308+0000","last_clean":"2023-07-13T14:20:29.230308+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T14:20:29.230308+0000","last_undegraded":"2023-07-13T14:20:29.230308+0000","last_fullsized":"2023-07-13T14:20:29.230308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:50:40.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"31'23","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035220+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T14:20:29.035220+0000","last_peered":"2023-07-13T14:20:29.035220+0000","last_clean":"2023-07-13T14:20:29.035220+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T14:20:29.035220+0000","last_undegraded":"2023-07-13T14:20:29.035220+0000","last_fullsized":"2023-07-13T14:20:29.035220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:12.557056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573994+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T14:19:53.573994+0000","last_peered":"2023-07-13T14:19:53.573994+0000","last_clean":"2023-07-13T14:19:53.573994+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T14:19:53.573994+0000","last_undegraded":"2023-07-13T14:19:53.573994+0000","last_fullsized":"2023-07-13T14:19:53.573994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:29:36.180810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"31'645","reported_seq":683,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.802282+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T14:19:57.802282+0000","last_peered":"2023-07-13T14:19:57.802282+0000","last_clean":"2023-07-13T14:19:57.802282+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T14:19:57.802282+0000","last_undegraded":"2023-07-13T14:19:57.802282+0000","last_fullsized":"2023-07-13T14:19:57.802282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:50:15.899141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'42","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055906+0000","last_change":"2023-07-13T13:52:17.948432+0000","last_active":"2023-07-13T14:20:29.055906+0000","last_peered":"2023-07-13T14:20:29.055906+0000","last_clean":"2023-07-13T14:20:29.055906+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T14:20:29.055906+0000","last_undegraded":"2023-07-13T14:20:29.055906+0000","last_fullsized":"2023-07-13T14:20:29.055906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:45:09.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'125","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:48.633658+0000","last_change":"2023-07-13T13:52:23.984769+0000","last_active":"2023-07-13T14:19:48.633658+0000","last_peered":"2023-07-13T14:19:48.633658+0000","last_clean":"2023-07-13T14:19:48.633658+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T14:19:48.633658+0000","last_undegraded":"2023-07-13T14:19:48.633658+0000","last_fullsized":"2023-07-13T14:19:48.633658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:01:10.403090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":11569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.881932+0000","last_change":"2023-07-13T13:52:16.667863+0000","last_active":"2023-07-13T14:20:06.881932+0000","last_peered":"2023-07-13T14:20:06.881932+0000","last_clean":"2023-07-13T14:20:06.881932+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T14:20:06.881932+0000","last_undegraded":"2023-07-13T14:20:06.881932+0000","last_fullsized":"2023-07-13T14:20:06.881932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:32:47.027923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'20","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217062+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T14:20:29.217062+0000","last_peered":"2023-07-13T14:20:29.217062+0000","last_clean":"2023-07-13T14:20:29.217062+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T14:20:29.217062+0000","last_undegraded":"2023-07-13T14:20:29.217062+0000","last_fullsized":"2023-07-13T14:20:29.217062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:30:22.976473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"31'103","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.770450+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T14:19:51.770450+0000","last_peered":"2023-07-13T14:19:51.770450+0000","last_clean":"2023-07-13T14:19:51.770450+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T14:19:51.770450+0000","last_undegraded":"2023-07-13T14:19:51.770450+0000","last_fullsized":"2023-07-13T14:19:51.770450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:59:03.195341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:10.959724+0000","last_change":"2023-07-13T13:52:16.607515+0000","last_active":"2023-07-13T14:20:10.959724+0000","last_peered":"2023-07-13T14:20:10.959724+0000","last_clean":"2023-07-13T14:20:10.959724+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T14:20:10.959724+0000","last_undegraded":"2023-07-13T14:20:10.959724+0000","last_fullsized":"2023-07-13T14:20:10.959724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:31.911995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'33","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.115258+0000","last_change":"2023-07-13T13:52:17.934538+0000","last_active":"2023-07-13T14:20:29.115258+0000","last_peered":"2023-07-13T14:20:29.115258+0000","last_clean":"2023-07-13T14:20:29.115258+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T14:20:29.115258+0000","last_undegraded":"2023-07-13T14:20:29.115258+0000","last_fullsized":"2023-07-13T14:20:29.115258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:01.447721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"31'138","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.568510+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T14:19:53.568510+0000","last_peered":"2023-07-13T14:19:53.568510+0000","last_clean":"2023-07-13T14:19:53.568510+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T14:19:53.568510+0000","last_undegraded":"2023-07-13T14:19:53.568510+0000","last_fullsized":"2023-07-13T14:19:53.568510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:13:08.564646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.193691+0000","last_change":"2023-07-13T13:52:16.668908+0000","last_active":"2023-07-13T14:20:17.193691+0000","last_peered":"2023-07-13T14:20:17.193691+0000","last_clean":"2023-07-13T14:20:17.193691+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T14:20:17.193691+0000","last_undegraded":"2023-07-13T14:20:17.193691+0000","last_fullsized":"2023-07-13T14:20:17.193691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:30:26.894929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'25","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056582+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T14:20:29.056582+0000","last_peered":"2023-07-13T14:20:29.056582+0000","last_clean":"2023-07-13T14:20:29.056582+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T14:20:29.056582+0000","last_undegraded":"2023-07-13T14:20:29.056582+0000","last_fullsized":"2023-07-13T14:20:29.056582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:48.380599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.577512+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T14:19:53.577512+0000","last_peered":"2023-07-13T14:19:53.577512+0000","last_clean":"2023-07-13T14:19:53.577512+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T14:19:53.577512+0000","last_undegraded":"2023-07-13T14:19:53.577512+0000","last_fullsized":"2023-07-13T14:19:53.577512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:34:34.679685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":9189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:08.889486+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T14:20:08.889486+0000","last_peered":"2023-07-13T14:20:08.889486+0000","last_clean":"2023-07-13T14:20:08.889486+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T14:20:08.889486+0000","last_undegraded":"2023-07-13T14:20:08.889486+0000","last_fullsized":"2023-07-13T14:20:08.889486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:02.471208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"31'28","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.060805+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T14:20:29.060805+0000","last_peered":"2023-07-13T14:20:29.060805+0000","last_clean":"2023-07-13T14:20:29.060805+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T14:20:29.060805+0000","last_undegraded":"2023-07-13T14:20:29.060805+0000","last_fullsized":"2023-07-13T14:20:29.060805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:23.423317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"31'148","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:54.594249+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T14:19:54.594249+0000","last_peered":"2023-07-13T14:19:54.594249+0000","last_clean":"2023-07-13T14:19:54.594249+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T14:19:54.594249+0000","last_undegraded":"2023-07-13T14:19:54.594249+0000","last_fullsized":"2023-07-13T14:19:54.594249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:18.763893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":18843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'535","reported_seq":573,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.083140+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T14:20:21.083140+0000","last_peered":"2023-07-13T14:20:21.083140+0000","last_clean":"2023-07-13T14:20:21.083140+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T14:20:21.083140+0000","last_undegraded":"2023-07-13T14:20:21.083140+0000","last_fullsized":"2023-07-13T14:20:21.083140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:47.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"31'35","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230975+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T14:20:29.230975+0000","last_peered":"2023-07-13T14:20:29.230975+0000","last_clean":"2023-07-13T14:20:29.230975+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T14:20:29.230975+0000","last_undegraded":"2023-07-13T14:20:29.230975+0000","last_fullsized":"2023-07-13T14:20:29.230975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:50:42.203743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'132","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.469982+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T14:19:52.469982+0000","last_peered":"2023-07-13T14:19:52.469982+0000","last_clean":"2023-07-13T14:19:52.469982+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T14:19:52.469982+0000","last_undegraded":"2023-07-13T14:19:52.469982+0000","last_fullsized":"2023-07-13T14:19:52.469982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:27:28.126700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":15927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'845","reported_seq":884,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:16.964985+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T14:20:16.964985+0000","last_peered":"2023-07-13T14:20:16.964985+0000","last_clean":"2023-07-13T14:20:16.964985+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T14:20:16.964985+0000","last_undegraded":"2023-07-13T14:20:16.964985+0000","last_fullsized":"2023-07-13T14:20:16.964985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:28:31.879491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"31'43","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055462+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T14:20:29.055462+0000","last_peered":"2023-07-13T14:20:29.055462+0000","last_clean":"2023-07-13T14:20:29.055462+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T14:20:29.055462+0000","last_undegraded":"2023-07-13T14:20:29.055462+0000","last_fullsized":"2023-07-13T14:20:29.055462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:20:57.526559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"31'113","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.764052+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T14:19:51.764052+0000","last_peered":"2023-07-13T14:19:51.764052+0000","last_clean":"2023-07-13T14:19:51.764052+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T14:19:51.764052+0000","last_undegraded":"2023-07-13T14:19:51.764052+0000","last_fullsized":"2023-07-13T14:19:51.764052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:54.587437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":11208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'8","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.097250+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T14:20:17.097250+0000","last_peered":"2023-07-13T14:20:17.097250+0000","last_clean":"2023-07-13T14:20:17.097250+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T14:20:17.097250+0000","last_undegraded":"2023-07-13T14:20:17.097250+0000","last_fullsized":"2023-07-13T14:20:17.097250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'27","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055907+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T14:20:29.055907+0000","last_peered":"2023-07-13T14:20:29.055907+0000","last_clean":"2023-07-13T14:20:29.055907+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T14:20:29.055907+0000","last_undegraded":"2023-07-13T14:20:29.055907+0000","last_fullsized":"2023-07-13T14:20:29.055907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:21:54.287499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'88","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576577+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T14:19:53.576577+0000","last_peered":"2023-07-13T14:19:53.576577+0000","last_clean":"2023-07-13T14:19:53.576577+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T14:19:53.576577+0000","last_undegraded":"2023-07-13T14:19:53.576577+0000","last_fullsized":"2023-07-13T14:19:53.576577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:39:40.932985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:16.902628+0000","last_change":"2023-07-13T13:52:16.663350+0000","last_active":"2023-07-13T14:20:16.902628+0000","last_peered":"2023-07-13T14:20:16.902628+0000","last_clean":"2023-07-13T14:20:16.902628+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T14:20:16.902628+0000","last_undegraded":"2023-07-13T14:20:16.902628+0000","last_fullsized":"2023-07-13T14:20:16.902628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:42:33.767450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.032664+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T14:20:29.032664+0000","last_peered":"2023-07-13T14:20:29.032664+0000","last_clean":"2023-07-13T14:20:29.032664+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T14:20:29.032664+0000","last_undegraded":"2023-07-13T14:20:29.032664+0000","last_fullsized":"2023-07-13T14:20:29.032664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:20:42.938534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"31'107","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.773562+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T14:19:51.773562+0000","last_peered":"2023-07-13T14:19:51.773562+0000","last_clean":"2023-07-13T14:19:51.773562+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T14:19:51.773562+0000","last_undegraded":"2023-07-13T14:19:51.773562+0000","last_fullsized":"2023-07-13T14:19:51.773562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:14:55.793442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:20.085088+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T14:20:20.085088+0000","last_peered":"2023-07-13T14:20:20.085088+0000","last_clean":"2023-07-13T14:20:20.085088+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T14:20:20.085088+0000","last_undegraded":"2023-07-13T14:20:20.085088+0000","last_fullsized":"2023-07-13T14:20:20.085088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:04.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"31'37","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217508+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T14:20:29.217508+0000","last_peered":"2023-07-13T14:20:29.217508+0000","last_clean":"2023-07-13T14:20:29.217508+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T14:20:29.217508+0000","last_undegraded":"2023-07-13T14:20:29.217508+0000","last_fullsized":"2023-07-13T14:20:29.217508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:18:20.394545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'128","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.462763+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T14:19:52.462763+0000","last_peered":"2023-07-13T14:19:52.462763+0000","last_clean":"2023-07-13T14:19:52.462763+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T14:19:52.462763+0000","last_undegraded":"2023-07-13T14:19:52.462763+0000","last_fullsized":"2023-07-13T14:19:52.462763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:36.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'14","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.005215+0000","last_change":"2023-07-13T13:52:16.692808+0000","last_active":"2023-07-13T14:20:17.005215+0000","last_peered":"2023-07-13T14:20:17.005215+0000","last_clean":"2023-07-13T14:20:17.005215+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T14:20:17.005215+0000","last_undegraded":"2023-07-13T14:20:17.005215+0000","last_fullsized":"2023-07-13T14:20:17.005215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:10.067515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'32","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055961+0000","last_change":"2023-07-13T13:52:17.838408+0000","last_active":"2023-07-13T14:20:29.055961+0000","last_peered":"2023-07-13T14:20:29.055961+0000","last_clean":"2023-07-13T14:20:29.055961+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T14:20:29.055961+0000","last_undegraded":"2023-07-13T14:20:29.055961+0000","last_fullsized":"2023-07-13T14:20:29.055961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:57:58.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"31'122","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.418083+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T14:19:52.418083+0000","last_peered":"2023-07-13T14:19:52.418083+0000","last_clean":"2023-07-13T14:19:52.418083+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T14:19:52.418083+0000","last_undegraded":"2023-07-13T14:19:52.418083+0000","last_fullsized":"2023-07-13T14:19:52.418083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:53.223544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.158417+0000","last_change":"2023-07-13T13:52:16.666097+0000","last_active":"2023-07-13T14:20:17.158417+0000","last_peered":"2023-07-13T14:20:17.158417+0000","last_clean":"2023-07-13T14:20:17.158417+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T14:20:17.158417+0000","last_undegraded":"2023-07-13T14:20:17.158417+0000","last_fullsized":"2023-07-13T14:20:17.158417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"31'31","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035188+0000","last_change":"2023-07-13T13:52:17.838908+0000","last_active":"2023-07-13T14:20:29.035188+0000","last_peered":"2023-07-13T14:20:29.035188+0000","last_clean":"2023-07-13T14:20:29.035188+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T14:20:29.035188+0000","last_undegraded":"2023-07-13T14:20:29.035188+0000","last_fullsized":"2023-07-13T14:20:29.035188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:34:28.472848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'99","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.254376+0000","last_change":"2023-07-13T13:52:23.993113+0000","last_active":"2023-07-13T14:19:51.254376+0000","last_peered":"2023-07-13T14:19:51.254376+0000","last_clean":"2023-07-13T14:19:51.254376+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T14:19:51.254376+0000","last_undegraded":"2023-07-13T14:19:51.254376+0000","last_fullsized":"2023-07-13T14:19:51.254376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:50:50.731203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:09.919165+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T14:20:09.919165+0000","last_peered":"2023-07-13T14:20:09.919165+0000","last_clean":"2023-07-13T14:20:09.919165+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T14:20:09.919165+0000","last_undegraded":"2023-07-13T14:20:09.919165+0000","last_fullsized":"2023-07-13T14:20:09.919165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:22.277267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035068+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T14:20:29.035068+0000","last_peered":"2023-07-13T14:20:29.035068+0000","last_clean":"2023-07-13T14:20:29.035068+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T14:20:29.035068+0000","last_undegraded":"2023-07-13T14:20:29.035068+0000","last_fullsized":"2023-07-13T14:20:29.035068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:29:43.401303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"31'154","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:50.928044+0000","last_change":"2023-07-13T13:52:23.992085+0000","last_active":"2023-07-13T14:19:50.928044+0000","last_peered":"2023-07-13T14:19:50.928044+0000","last_clean":"2023-07-13T14:19:50.928044+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T14:19:50.928044+0000","last_undegraded":"2023-07-13T14:19:50.928044+0000","last_fullsized":"2023-07-13T14:19:50.928044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:11.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.792804+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T14:19:57.792804+0000","last_peered":"2023-07-13T14:19:57.792804+0000","last_clean":"2023-07-13T14:19:57.792804+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T14:19:57.792804+0000","last_undegraded":"2023-07-13T14:19:57.792804+0000","last_fullsized":"2023-07-13T14:19:57.792804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:18.416220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"31'24","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.116356+0000","last_change":"2023-07-13T13:52:17.952164+0000","last_active":"2023-07-13T14:20:29.116356+0000","last_peered":"2023-07-13T14:20:29.116356+0000","last_clean":"2023-07-13T14:20:29.116356+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T14:20:29.116356+0000","last_undegraded":"2023-07-13T14:20:29.116356+0000","last_fullsized":"2023-07-13T14:20:29.116356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:58:56.106442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'113","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.024082+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T14:19:51.024082+0000","last_peered":"2023-07-13T14:19:51.024082+0000","last_clean":"2023-07-13T14:19:51.024082+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T14:19:51.024082+0000","last_undegraded":"2023-07-13T14:19:51.024082+0000","last_fullsized":"2023-07-13T14:19:51.024082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:18.127640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:04.797820+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T14:20:04.797820+0000","last_peered":"2023-07-13T14:20:04.797820+0000","last_clean":"2023-07-13T14:20:04.797820+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T14:20:04.797820+0000","last_undegraded":"2023-07-13T14:20:04.797820+0000","last_fullsized":"2023-07-13T14:20:04.797820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:18.013759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'32","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218708+0000","last_change":"2023-07-13T13:52:17.952349+0000","last_active":"2023-07-13T14:20:29.218708+0000","last_peered":"2023-07-13T14:20:29.218708+0000","last_clean":"2023-07-13T14:20:29.218708+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T14:20:29.218708+0000","last_undegraded":"2023-07-13T14:20:29.218708+0000","last_fullsized":"2023-07-13T14:20:29.218708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:33.131082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'94","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:49.447041+0000","last_change":"2023-07-13T13:52:23.987269+0000","last_active":"2023-07-13T14:19:49.447041+0000","last_peered":"2023-07-13T14:19:49.447041+0000","last_clean":"2023-07-13T14:19:49.447041+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T14:19:49.447041+0000","last_undegraded":"2023-07-13T14:19:49.447041+0000","last_fullsized":"2023-07-13T14:19:49.447041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:04:05.152920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'580","reported_seq":619,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.881428+0000","last_change":"2023-07-13T13:52:16.607455+0000","last_active":"2023-07-13T14:20:06.881428+0000","last_peered":"2023-07-13T14:20:06.881428+0000","last_clean":"2023-07-13T14:20:06.881428+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T14:20:06.881428+0000","last_undegraded":"2023-07-13T14:20:06.881428+0000","last_fullsized":"2023-07-13T14:20:06.881428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:18.416220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"31'30","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.038118+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T14:20:29.038118+0000","last_peered":"2023-07-13T14:20:29.038118+0000","last_clean":"2023-07-13T14:20:29.038118+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T14:20:29.038118+0000","last_undegraded":"2023-07-13T14:20:29.038118+0000","last_fullsized":"2023-07-13T14:20:29.038118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:11.058247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'157","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.263137+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T14:19:51.263137+0000","last_peered":"2023-07-13T14:19:51.263137+0000","last_clean":"2023-07-13T14:19:51.263137+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T14:19:51.263137+0000","last_undegraded":"2023-07-13T14:19:51.263137+0000","last_fullsized":"2023-07-13T14:19:51.263137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:00:18.515871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":13657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:08.889681+0000","last_change":"2023-07-13T13:52:16.692899+0000","last_active":"2023-07-13T14:20:08.889681+0000","last_peered":"2023-07-13T14:20:08.889681+0000","last_clean":"2023-07-13T14:20:08.889681+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T14:20:08.889681+0000","last_undegraded":"2023-07-13T14:20:08.889681+0000","last_fullsized":"2023-07-13T14:20:08.889681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:16:15.151366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"31'28","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052840+0000","last_change":"2023-07-13T13:52:17.942165+0000","last_active":"2023-07-13T14:20:29.052840+0000","last_peered":"2023-07-13T14:20:29.052840+0000","last_clean":"2023-07-13T14:20:29.052840+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T14:20:29.052840+0000","last_undegraded":"2023-07-13T14:20:29.052840+0000","last_fullsized":"2023-07-13T14:20:29.052840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.112967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'108","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576192+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T14:19:53.576192+0000","last_peered":"2023-07-13T14:19:53.576192+0000","last_clean":"2023-07-13T14:19:53.576192+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T14:19:53.576192+0000","last_undegraded":"2023-07-13T14:19:53.576192+0000","last_fullsized":"2023-07-13T14:19:53.576192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:25.769108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":8018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.896456+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T14:20:06.896456+0000","last_peered":"2023-07-13T14:20:06.896456+0000","last_clean":"2023-07-13T14:20:06.896456+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T14:20:06.896456+0000","last_undegraded":"2023-07-13T14:20:06.896456+0000","last_fullsized":"2023-07-13T14:20:06.896456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:48:26.050917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"31'17","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.042824+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T14:20:29.042824+0000","last_peered":"2023-07-13T14:20:29.042824+0000","last_clean":"2023-07-13T14:20:29.042824+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T14:20:29.042824+0000","last_undegraded":"2023-07-13T14:20:29.042824+0000","last_fullsized":"2023-07-13T14:20:29.042824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:57:35.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.776600+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T14:19:51.776600+0000","last_peered":"2023-07-13T14:19:51.776600+0000","last_clean":"2023-07-13T14:19:51.776600+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T14:19:51.776600+0000","last_undegraded":"2023-07-13T14:19:51.776600+0000","last_fullsized":"2023-07-13T14:19:51.776600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:29:10.436681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:18.080416+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T14:20:18.080416+0000","last_peered":"2023-07-13T14:20:18.080416+0000","last_clean":"2023-07-13T14:20:18.080416+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T14:20:18.080416+0000","last_undegraded":"2023-07-13T14:20:18.080416+0000","last_fullsized":"2023-07-13T14:20:18.080416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'31","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227715+0000","last_change":"2023-07-13T13:52:17.949610+0000","last_active":"2023-07-13T14:20:29.227715+0000","last_peered":"2023-07-13T14:20:29.227715+0000","last_clean":"2023-07-13T14:20:29.227715+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T14:20:29.227715+0000","last_undegraded":"2023-07-13T14:20:29.227715+0000","last_fullsized":"2023-07-13T14:20:29.227715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:17:32.249199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.467905+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T14:19:52.467905+0000","last_peered":"2023-07-13T14:19:52.467905+0000","last_clean":"2023-07-13T14:19:52.467905+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T14:19:52.467905+0000","last_undegraded":"2023-07-13T14:19:52.467905+0000","last_fullsized":"2023-07-13T14:19:52.467905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:09:55.119214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:01.898722+0000","last_change":"2023-07-13T13:51:59.916015+0000","last_active":"2023-07-13T14:17:01.898722+0000","last_peered":"2023-07-13T14:17:01.898722+0000","last_clean":"2023-07-13T14:17:01.898722+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T14:17:01.898722+0000","last_undegraded":"2023-07-13T14:17:01.898722+0000","last_fullsized":"2023-07-13T14:17:01.898722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:19:25.211327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.882185+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T14:20:06.882185+0000","last_peered":"2023-07-13T14:20:06.882185+0000","last_clean":"2023-07-13T14:20:06.882185+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T14:20:06.882185+0000","last_undegraded":"2023-07-13T14:20:06.882185+0000","last_fullsized":"2023-07-13T14:20:06.882185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:31.911995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233750+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T14:20:29.233750+0000","last_peered":"2023-07-13T14:20:29.233750+0000","last_clean":"2023-07-13T14:20:29.233750+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T14:20:29.233750+0000","last_undegraded":"2023-07-13T14:20:29.233750+0000","last_fullsized":"2023-07-13T14:20:29.233750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:15.006259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'128","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.771202+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T14:19:51.771202+0000","last_peered":"2023-07-13T14:19:51.771202+0000","last_clean":"2023-07-13T14:19:51.771202+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T14:19:51.771202+0000","last_undegraded":"2023-07-13T14:19:51.771202+0000","last_fullsized":"2023-07-13T14:19:51.771202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:48:59.588023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":10905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.024467+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T14:17:02.024467+0000","last_peered":"2023-07-13T14:17:02.024467+0000","last_clean":"2023-07-13T14:17:02.024467+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T14:17:02.024467+0000","last_undegraded":"2023-07-13T14:17:02.024467+0000","last_fullsized":"2023-07-13T14:17:02.024467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:16.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:09.925212+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T14:20:09.925212+0000","last_peered":"2023-07-13T14:20:09.925212+0000","last_clean":"2023-07-13T14:20:09.925212+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T14:20:09.925212+0000","last_undegraded":"2023-07-13T14:20:09.925212+0000","last_fullsized":"2023-07-13T14:20:09.925212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:29:17.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"31'27","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230093+0000","last_change":"2023-07-13T13:52:17.947909+0000","last_active":"2023-07-13T14:20:29.230093+0000","last_peered":"2023-07-13T14:20:29.230093+0000","last_clean":"2023-07-13T14:20:29.230093+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T14:20:29.230093+0000","last_undegraded":"2023-07-13T14:20:29.230093+0000","last_fullsized":"2023-07-13T14:20:29.230093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:46:46.566206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'124","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.463674+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T14:19:51.463674+0000","last_peered":"2023-07-13T14:19:51.463674+0000","last_clean":"2023-07-13T14:19:51.463674+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T14:19:51.463674+0000","last_undegraded":"2023-07-13T14:19:51.463674+0000","last_fullsized":"2023-07-13T14:19:51.463674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:12:06.075843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.045790+0000","last_change":"2023-07-13T13:52:01.224691+0000","last_active":"2023-07-13T14:17:02.045790+0000","last_peered":"2023-07-13T14:17:02.045790+0000","last_clean":"2023-07-13T14:17:02.045790+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T14:17:02.045790+0000","last_undegraded":"2023-07-13T14:17:02.045790+0000","last_fullsized":"2023-07-13T14:17:02.045790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:24.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'185","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:28.835914+0000","last_change":"2023-07-13T13:52:16.668065+0000","last_active":"2023-07-13T14:20:28.835914+0000","last_peered":"2023-07-13T14:20:28.835914+0000","last_clean":"2023-07-13T14:20:28.835914+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T14:20:28.835914+0000","last_undegraded":"2023-07-13T14:20:28.835914+0000","last_fullsized":"2023-07-13T14:20:28.835914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:05:52.448061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1434466,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233347+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T14:20:29.233347+0000","last_peered":"2023-07-13T14:20:29.233347+0000","last_clean":"2023-07-13T14:20:29.233347+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T14:20:29.233347+0000","last_undegraded":"2023-07-13T14:20:29.233347+0000","last_fullsized":"2023-07-13T14:20:29.233347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:48:53.381186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:49.425871+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T14:19:49.425871+0000","last_peered":"2023-07-13T14:19:49.425871+0000","last_clean":"2023-07-13T14:19:49.425871+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T14:19:49.425871+0000","last_undegraded":"2023-07-13T14:19:49.425871+0000","last_fullsized":"2023-07-13T14:19:49.425871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:25.366647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.024504+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T14:17:02.024504+0000","last_peered":"2023-07-13T14:17:02.024504+0000","last_clean":"2023-07-13T14:17:02.024504+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T14:17:02.024504+0000","last_undegraded":"2023-07-13T14:17:02.024504+0000","last_fullsized":"2023-07-13T14:17:02.024504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:51:43.589579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:02.080996+0000","last_change":"2023-07-13T13:51:57.962882+0000","last_active":"2023-07-13T14:18:02.080996+0000","last_peered":"2023-07-13T14:18:02.080996+0000","last_clean":"2023-07-13T14:18:02.080996+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T14:18:02.080996+0000","last_undegraded":"2023-07-13T14:18:02.080996+0000","last_fullsized":"2023-07-13T14:18:02.080996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_clean_scrub_stamp":"2023-07-13T13:51:55.598839+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:04:40.216785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:16.894211+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T14:17:16.894211+0000","last_peered":"2023-07-13T14:17:16.894211+0000","last_clean":"2023-07-13T14:17:16.894211+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T14:17:16.894211+0000","last_undegraded":"2023-07-13T14:17:16.894211+0000","last_fullsized":"2023-07-13T14:17:16.894211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"31'29","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.108922+0000","last_change":"2023-07-13T13:52:17.942525+0000","last_active":"2023-07-13T14:20:29.108922+0000","last_peered":"2023-07-13T14:20:29.108922+0000","last_clean":"2023-07-13T14:20:29.108922+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T14:20:29.108922+0000","last_undegraded":"2023-07-13T14:20:29.108922+0000","last_fullsized":"2023-07-13T14:20:29.108922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:05.040114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"31'125","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.764052+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T14:19:51.764052+0000","last_peered":"2023-07-13T14:19:51.764052+0000","last_clean":"2023-07-13T14:19:51.764052+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T14:19:51.764052+0000","last_undegraded":"2023-07-13T14:19:51.764052+0000","last_fullsized":"2023-07-13T14:19:51.764052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:29.630154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:07.081687+0000","last_change":"2023-07-13T13:52:00.016430+0000","last_active":"2023-07-13T14:18:07.081687+0000","last_peered":"2023-07-13T14:18:07.081687+0000","last_clean":"2023-07-13T14:18:07.081687+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T14:18:07.081687+0000","last_undegraded":"2023-07-13T14:18:07.081687+0000","last_fullsized":"2023-07-13T14:18:07.081687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:38:16.040470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"31'816","reported_seq":1663,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:24.078247+0000","last_change":"2023-07-13T13:52:16.630297+0000","last_active":"2023-07-13T14:20:24.078247+0000","last_peered":"2023-07-13T14:20:24.078247+0000","last_clean":"2023-07-13T14:20:24.078247+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T14:20:24.078247+0000","last_undegraded":"2023-07-13T14:20:24.078247+0000","last_fullsized":"2023-07-13T14:20:24.078247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:50:41.057693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174695,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":810,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"31'38","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217477+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T14:20:29.217477+0000","last_peered":"2023-07-13T14:20:29.217477+0000","last_clean":"2023-07-13T14:20:29.217477+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T14:20:29.217477+0000","last_undegraded":"2023-07-13T14:20:29.217477+0000","last_fullsized":"2023-07-13T14:20:29.217477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:50:40.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"31'163","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.699178+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T14:19:51.699178+0000","last_peered":"2023-07-13T14:19:51.699178+0000","last_clean":"2023-07-13T14:19:51.699178+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T14:19:51.699178+0000","last_undegraded":"2023-07-13T14:19:51.699178+0000","last_fullsized":"2023-07-13T14:19:51.699178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:49:00.719154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":7667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:07.073993+0000","last_change":"2023-07-13T13:52:00.019670+0000","last_active":"2023-07-13T14:17:07.073993+0000","last_peered":"2023-07-13T14:17:07.073993+0000","last_clean":"2023-07-13T14:17:07.073993+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T14:17:07.073993+0000","last_undegraded":"2023-07-13T14:17:07.073993+0000","last_fullsized":"2023-07-13T14:17:07.073993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:23:45.429201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:05.809167+0000","last_change":"2023-07-13T13:52:16.668244+0000","last_active":"2023-07-13T14:20:05.809167+0000","last_peered":"2023-07-13T14:20:05.809167+0000","last_clean":"2023-07-13T14:20:05.809167+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T14:20:05.809167+0000","last_undegraded":"2023-07-13T14:20:05.809167+0000","last_fullsized":"2023-07-13T14:20:05.809167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:42:33.767450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219044+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T14:20:29.219044+0000","last_peered":"2023-07-13T14:20:29.219044+0000","last_clean":"2023-07-13T14:20:29.219044+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T14:20:29.219044+0000","last_undegraded":"2023-07-13T14:20:29.219044+0000","last_fullsized":"2023-07-13T14:20:29.219044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:23:56.694084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"31'90","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573245+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T14:19:53.573245+0000","last_peered":"2023-07-13T14:19:53.573245+0000","last_clean":"2023-07-13T14:19:53.573245+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T14:19:53.573245+0000","last_undegraded":"2023-07-13T14:19:53.573245+0000","last_fullsized":"2023-07-13T14:19:53.573245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:46:13.524291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.078016+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T14:20:21.078016+0000","last_peered":"2023-07-13T14:20:21.078016+0000","last_clean":"2023-07-13T14:20:21.078016+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T14:20:21.078016+0000","last_undegraded":"2023-07-13T14:20:21.078016+0000","last_fullsized":"2023-07-13T14:20:21.078016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:33.167123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:01.905109+0000","last_change":"2023-07-13T13:51:59.757569+0000","last_active":"2023-07-13T14:18:01.905109+0000","last_peered":"2023-07-13T14:18:01.905109+0000","last_clean":"2023-07-13T14:18:01.905109+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T14:18:01.905109+0000","last_undegraded":"2023-07-13T14:18:01.905109+0000","last_fullsized":"2023-07-13T14:18:01.905109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:17.316170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'30","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056742+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T14:20:29.056742+0000","last_peered":"2023-07-13T14:20:29.056742+0000","last_clean":"2023-07-13T14:20:29.056742+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T14:20:29.056742+0000","last_undegraded":"2023-07-13T14:20:29.056742+0000","last_fullsized":"2023-07-13T14:20:29.056742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:19.159810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"31'139","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.577318+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T14:19:53.577318+0000","last_peered":"2023-07-13T14:19:53.577318+0000","last_clean":"2023-07-13T14:19:53.577318+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T14:19:53.577318+0000","last_undegraded":"2023-07-13T14:19:53.577318+0000","last_fullsized":"2023-07-13T14:19:53.577318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:36.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":9717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:01.989782+0000","last_change":"2023-07-13T13:52:00.015919+0000","last_active":"2023-07-13T14:18:01.989782+0000","last_peered":"2023-07-13T14:18:01.989782+0000","last_clean":"2023-07-13T14:18:01.989782+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T14:18:01.989782+0000","last_undegraded":"2023-07-13T14:18:01.989782+0000","last_fullsized":"2023-07-13T14:18:01.989782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:04:39.121531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'314","reported_seq":352,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.903663+0000","last_change":"2023-07-13T13:52:16.665545+0000","last_active":"2023-07-13T14:20:26.903663+0000","last_peered":"2023-07-13T14:20:26.903663+0000","last_clean":"2023-07-13T14:20:26.903663+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T14:20:26.903663+0000","last_undegraded":"2023-07-13T14:20:26.903663+0000","last_fullsized":"2023-07-13T14:20:26.903663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:38:57.883779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"31'21","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052825+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T14:20:29.052825+0000","last_peered":"2023-07-13T14:20:29.052825+0000","last_clean":"2023-07-13T14:20:29.052825+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T14:20:29.052825+0000","last_undegraded":"2023-07-13T14:20:29.052825+0000","last_fullsized":"2023-07-13T14:20:29.052825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:18:29.892355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'134","reported_seq":162,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.470366+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T14:19:52.470366+0000","last_peered":"2023-07-13T14:19:52.470366+0000","last_clean":"2023-07-13T14:19:52.470366+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T14:19:52.470366+0000","last_undegraded":"2023-07-13T14:19:52.470366+0000","last_fullsized":"2023-07-13T14:19:52.470366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:09:55.119214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'713","reported_seq":749,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:14.073314+0000","last_change":"2023-07-13T13:52:16.631174+0000","last_active":"2023-07-13T14:20:14.073314+0000","last_peered":"2023-07-13T14:20:14.073314+0000","last_clean":"2023-07-13T14:20:14.073314+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T14:20:14.073314+0000","last_undegraded":"2023-07-13T14:20:14.073314+0000","last_fullsized":"2023-07-13T14:20:14.073314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:20:27.968678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'26","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071759+0000","last_change":"2023-07-13T13:52:17.952450+0000","last_active":"2023-07-13T14:20:29.071759+0000","last_peered":"2023-07-13T14:20:29.071759+0000","last_clean":"2023-07-13T14:20:29.071759+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T14:20:29.071759+0000","last_undegraded":"2023-07-13T14:20:29.071759+0000","last_fullsized":"2023-07-13T14:20:29.071759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:37.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"31'117","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576845+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T14:19:53.576845+0000","last_peered":"2023-07-13T14:19:53.576845+0000","last_clean":"2023-07-13T14:19:53.576845+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T14:19:53.576845+0000","last_undegraded":"2023-07-13T14:19:53.576845+0000","last_fullsized":"2023-07-13T14:19:53.576845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:52:07.984474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":13476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.735845+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T14:19:57.735845+0000","last_peered":"2023-07-13T14:19:57.735845+0000","last_clean":"2023-07-13T14:19:57.735845+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T14:19:57.735845+0000","last_undegraded":"2023-07-13T14:19:57.735845+0000","last_fullsized":"2023-07-13T14:19:57.735845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'33","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055762+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T14:20:29.055762+0000","last_peered":"2023-07-13T14:20:29.055762+0000","last_clean":"2023-07-13T14:20:29.055762+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T14:20:29.055762+0000","last_undegraded":"2023-07-13T14:20:29.055762+0000","last_fullsized":"2023-07-13T14:20:29.055762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:00.624407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'97","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576096+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T14:19:53.576096+0000","last_peered":"2023-07-13T14:19:53.576096+0000","last_clean":"2023-07-13T14:19:53.576096+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T14:19:53.576096+0000","last_undegraded":"2023-07-13T14:19:53.576096+0000","last_fullsized":"2023-07-13T14:19:53.576096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:12.309060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":9809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"31'1257","reported_seq":1295,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:15.025807+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T14:20:15.025807+0000","last_peered":"2023-07-13T14:20:15.025807+0000","last_clean":"2023-07-13T14:20:15.025807+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T14:20:15.025807+0000","last_undegraded":"2023-07-13T14:20:15.025807+0000","last_fullsized":"2023-07-13T14:20:15.025807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'30","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056304+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T14:20:29.056304+0000","last_peered":"2023-07-13T14:20:29.056304+0000","last_clean":"2023-07-13T14:20:29.056304+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T14:20:29.056304+0000","last_undegraded":"2023-07-13T14:20:29.056304+0000","last_fullsized":"2023-07-13T14:20:29.056304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:21:26.463017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"31'115","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573399+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T14:19:53.573399+0000","last_peered":"2023-07-13T14:19:53.573399+0000","last_clean":"2023-07-13T14:19:53.573399+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T14:19:53.573399+0000","last_undegraded":"2023-07-13T14:19:53.573399+0000","last_fullsized":"2023-07-13T14:19:53.573399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:30:47.139618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'763","reported_seq":804,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:03.781157+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T14:20:03.781157+0000","last_peered":"2023-07-13T14:20:03.781157+0000","last_clean":"2023-07-13T14:20:03.781157+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T14:20:03.781157+0000","last_undegraded":"2023-07-13T14:20:03.781157+0000","last_fullsized":"2023-07-13T14:20:03.781157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:52:00.662042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":4555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'35","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071562+0000","last_change":"2023-07-13T13:52:17.925281+0000","last_active":"2023-07-13T14:20:29.071562+0000","last_peered":"2023-07-13T14:20:29.071562+0000","last_clean":"2023-07-13T14:20:29.071562+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T14:20:29.071562+0000","last_undegraded":"2023-07-13T14:20:29.071562+0000","last_fullsized":"2023-07-13T14:20:29.071562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:03.617258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'135","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:45.194613+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T14:19:45.194613+0000","last_peered":"2023-07-13T14:19:45.194613+0000","last_clean":"2023-07-13T14:19:45.194613+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T14:19:45.194613+0000","last_undegraded":"2023-07-13T14:19:45.194613+0000","last_fullsized":"2023-07-13T14:19:45.194613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:32:12.577338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":6623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"31'733","reported_seq":771,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:18.081584+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T14:20:18.081584+0000","last_peered":"2023-07-13T14:20:18.081584+0000","last_clean":"2023-07-13T14:20:18.081584+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T14:20:18.081584+0000","last_undegraded":"2023-07-13T14:20:18.081584+0000","last_fullsized":"2023-07-13T14:20:18.081584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:24:48.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'37","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.044987+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T14:20:29.044987+0000","last_peered":"2023-07-13T14:20:29.044987+0000","last_clean":"2023-07-13T14:20:29.044987+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T14:20:29.044987+0000","last_undegraded":"2023-07-13T14:20:29.044987+0000","last_fullsized":"2023-07-13T14:20:29.044987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:11.485106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"31'43","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.109653+0000","last_change":"2023-07-13T13:52:17.933894+0000","last_active":"2023-07-13T14:20:29.109653+0000","last_peered":"2023-07-13T14:20:29.109653+0000","last_clean":"2023-07-13T14:20:29.109653+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T14:20:29.109653+0000","last_undegraded":"2023-07-13T14:20:29.109653+0000","last_fullsized":"2023-07-13T14:20:29.109653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:44:32.655763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.061494+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T14:20:29.061494+0000","last_peered":"2023-07-13T14:20:29.061494+0000","last_clean":"2023-07-13T14:20:29.061494+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T14:20:29.061494+0000","last_undegraded":"2023-07-13T14:20:29.061494+0000","last_fullsized":"2023-07-13T14:20:29.061494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:20:42.938534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"31'42","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.033130+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T14:20:29.033130+0000","last_peered":"2023-07-13T14:20:29.033130+0000","last_clean":"2023-07-13T14:20:29.033130+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T14:20:29.033130+0000","last_undegraded":"2023-07-13T14:20:29.033130+0000","last_fullsized":"2023-07-13T14:20:29.033130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:36:22.078595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"31'28","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.054230+0000","last_change":"2023-07-13T13:52:17.838377+0000","last_active":"2023-07-13T14:20:29.054230+0000","last_peered":"2023-07-13T14:20:29.054230+0000","last_clean":"2023-07-13T14:20:29.054230+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T14:20:29.054230+0000","last_undegraded":"2023-07-13T14:20:29.054230+0000","last_fullsized":"2023-07-13T14:20:29.054230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'22","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227758+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T14:20:29.227758+0000","last_peered":"2023-07-13T14:20:29.227758+0000","last_clean":"2023-07-13T14:20:29.227758+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T14:20:29.227758+0000","last_undegraded":"2023-07-13T14:20:29.227758+0000","last_fullsized":"2023-07-13T14:20:29.227758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:33.131082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3402,"num_write_kb":282366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3765,"ondisk_log_size":3765,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":35165063,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":7922,"num_write_kb":39030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49258496,"data_stored":70330126,"data_compressed":6207514,"data_compressed_allocated":9723904,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":0},"log_size":7484,"ondisk_log_size":7484,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509785,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34704,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337136,"statfs":{"total":96636764160,"available":96601227264,"internally_reserved":0,"allocated":3678208,"data_stored":4927655,"data_compressed":341063,"data_compressed_allocated":569344,"data_compressed_original":2035712,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.625,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.56100000000000005,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.315,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.442},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.28399999999999997,"15min":0.28199999999999997},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":3.2789999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67400000000000004,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.435},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.59499999999999997,"5min":1.0700000000000001,"15min":1.4630000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.35799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61099999999999999,"5min":0.93300000000000005,"15min":1.4650000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67900000000000005,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.626,"5min":0.67600000000000005,"15min":0.83399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.65500000000000003,"15min":0.83299999999999996},"last":0.33200000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.50800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66700000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.79700000000000004},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.86699999999999999},"last":0.5},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.53500000000000003},"min":{"1min":0.34100000000000003,"5min":0.33100000000000002,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.81399999999999995},"last":0.371}]}]},{"osd":6,"up_from":15,"seq":64424509785,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30324,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341516,"statfs":{"total":96636764160,"available":96605712384,"internally_reserved":0,"allocated":3387392,"data_stored":4336399,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.217},"max":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":1.2549999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.67100000000000004,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.56699999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.48599999999999999,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.23400000000000001},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.92500000000000004,"15min":2.1789999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45900000000000002,"15min":0.47799999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":3.4060000000000001},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.28599999999999998},"max":{"1min":2.9500000000000002,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.25900000000000001},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":5.3810000000000002},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.23799999999999999},"max":{"1min":0.59299999999999997,"5min":0.72099999999999997,"15min":0.749},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.80100000000000005},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47599999999999998,"15min":0.46200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63400000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.89500000000000002},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":0.745,"15min":0.75800000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63700000000000001,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575193,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39120,"kb_used_data":3912,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94332720,"statfs":{"total":96636764160,"available":96596705280,"internally_reserved":0,"allocated":4005888,"data_stored":5770865,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":3.7240000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.33800000000000002,"15min":0.34100000000000003},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":0.442,"5min":0.71099999999999997,"15min":0.76200000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.313,"15min":0.33300000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":1.49},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20300000000000001},"max":{"1min":0.57899999999999996,"5min":0.79700000000000004,"15min":0.996},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.60099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.51100000000000001,"5min":1.548,"15min":1.548},"last":0.375}]},{"osd":4,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.30099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.76200000000000001,"5min":0.80100000000000005,"15min":1.266},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.36899999999999999,"15min":0.309},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":1.2869999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.89300000000000002,"15min":0.92800000000000005},"last":0.439}]},{"osd":6,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.34799999999999998,"15min":0.33700000000000002},"max":{"1min":0.75,"5min":1.625,"15min":1.625},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.38,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":1.242},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.95299999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":1.657,"15min":1.657},"last":0.47999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542489,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66744,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94305096,"statfs":{"total":96636764160,"available":96568418304,"internally_reserved":0,"allocated":9617408,"data_stored":13490652,"data_compressed":1179065,"data_compressed_allocated":1941504,"data_compressed_original":6012928,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30399999999999999,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.185},"max":{"1min":0.40999999999999998,"5min":0.53600000000000003,"15min":0.64800000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.19},"max":{"1min":0.48799999999999999,"5min":0.64400000000000002,"15min":1.6879999999999999},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23000000000000001},"max":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.77200000000000002},"last":0.37},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":3.4940000000000002,"15min":3.4940000000000002},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22},"max":{"1min":0.69599999999999995,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":0.56699999999999995,"5min":1.2230000000000001,"15min":2.5379999999999998},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.85099999999999998,"15min":0.91400000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.753}]},{"osd":5,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.26100000000000001},"max":{"1min":0.74099999999999999,"5min":0.80700000000000005,"15min":0.94299999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.748,"5min":0.76900000000000002,"15min":1.0529999999999999},"last":0.629}]},{"osd":6,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.33900000000000002},"max":{"1min":0.753,"5min":0.83699999999999997,"15min":0.96599999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":0.83699999999999997,"15min":0.98299999999999998},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.81499999999999995,"15min":0.997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.86599999999999999,"15min":1.03},"last":0.71899999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509785,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1228800,"data_stored":1576561,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.308},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.46000000000000002,"5min":0.65200000000000002,"15min":0.751},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.34000000000000002,"15min":0.35899999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.42699999999999999,"5min":0.57099999999999995,"15min":3.0939999999999999},"last":0.379}]},{"osd":1,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.24299999999999999,"15min":0.19},"max":{"1min":0.56799999999999995,"5min":0.749,"15min":1.248},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.372,"15min":0.38500000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53300000000000003,"5min":1.081,"15min":2.9529999999999998},"last":0.313}]},{"osd":3,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.21299999999999999},"max":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":2.2490000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.51800000000000002,"5min":1.167,"15min":1.167},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":0.68500000000000005,"5min":0.79300000000000004,"15min":0.82999999999999996},"last":0.435},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.31900000000000001,"15min":0.26700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":2.3220000000000001},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.86899999999999999,"15min":2.3660000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.681},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.73699999999999999,"15min":1.6970000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78200000000000003,"5min":0.94699999999999995,"15min":0.98999999999999999},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.79300000000000004,"5min":0.83899999999999997,"15min":2.4020000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.32600000000000001},"max":{"1min":0.69299999999999995,"5min":0.73799999999999999,"15min":1.6619999999999999},"last":0.44500000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509785,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":6184960,"data_stored":8530793,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.31900000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.17899999999999999},"max":{"1min":0.37,"5min":0.65500000000000003,"15min":0.78300000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.313,"5min":0.316,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.19600000000000001,"15min":0.193},"max":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":2.972},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.374,"15min":0.35499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19900000000000001},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.377},"min":{"1min":0.221,"5min":0.221,"15min":0.218},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":2.173},"last":0.442}]},{"osd":2,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38100000000000001,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23200000000000001},"max":{"1min":0.48299999999999998,"5min":1.6759999999999999,"15min":2.335},"last":0.373},{"interface":"front","average":{"1min":0.379,"5min":0.41099999999999998,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.22800000000000001,"15min":0.214},"max":{"1min":0.501,"5min":0.71399999999999997,"15min":2.2000000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.26000000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.33200000000000002},"max":{"1min":0.82899999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.34300000000000003},"max":{"1min":0.68000000000000005,"5min":0.84299999999999997,"15min":0.84999999999999998},"last":0.626}]},{"osd":7,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.82299999999999995},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.747,"5min":0.91100000000000003,"15min":0.97599999999999998},"last":0.58699999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509785,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77928,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94293912,"statfs":{"total":96636764160,"available":96556965888,"internally_reserved":0,"allocated":15171584,"data_stored":21289038,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":1781,"internal_metadata":64616715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.23400000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.72399999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.441,"15min":0.432},"min":{"1min":0.35199999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68500000000000005},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.436,"15min":0.44},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.25},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.72599999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.33700000000000002,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.73499999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.72899999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":2.266,"15min":2.266},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64100000000000001,"5min":1.2849999999999999,"15min":1.5620000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":1.4259999999999999,"15min":2.6960000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.66200000000000003,"5min":0.73299999999999998,"15min":0.74199999999999999},"last":0.309},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.58799999999999997,"5min":0.65900000000000003,"15min":0.754},"last":0.38}]},{"osd":6,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.46899999999999997,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.25600000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.78900000000000003},"last":0.434}]},{"osd":7,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.41999999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.79000000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.48399999999999999,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.82799999999999996},"last":0.5}]}]},{"osd":5,"up_from":15,"seq":64424509785,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61820,"kb_used_data":8564,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94310020,"statfs":{"total":96636764160,"available":96573460480,"internally_reserved":0,"allocated":8769536,"data_stored":12725659,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.248,"15min":0.23899999999999999},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":0.72399999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.35399999999999998,"5min":0.29099999999999998,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.77700000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.57099999999999995,"5min":1.2729999999999999,"15min":1.7430000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.312,"5min":0.30299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58299999999999996,"5min":0.66800000000000004,"15min":1.284},"last":0.438}]},{"osd":3,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.056},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":0.63300000000000001,"5min":1.3879999999999999,"15min":1.78},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.438,"15min":0.439},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.77400000000000002},"last":0.40200000000000002}]},{"osd":7,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73499999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.496},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68300000000000005,"5min":1.351,"15min":1.351},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":12758189,"data_compressed":1146678,"data_compressed_allocated":1896448,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3674112,"data_stored":5628770,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897024,"data_stored":1434466,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5853184,"data_stored":8388698,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":21146943,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":12583564,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3055616,"data_stored":4194304,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":4195192,"data_compressed":308676,"data_compressed_allocated":524288,"data_compressed_original":1462272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T14:20:36.443 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-13T14:20:36.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T14:20:36.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.606+0000 7f576112a700 1 Processor -- start 2023-07-13T14:20:36.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.606+0000 7f576112a700 1 -- start start 2023-07-13T14:20:36.599 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.607+0000 7f576112a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:36.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.607+0000 7f576112a700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c150b80 con 0x7f575c0c8560 2023-07-13T14:20:36.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.607+0000 7f576112a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c1564e0 con 0x7f575c0cb840 2023-07-13T14:20:36.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.607+0000 7f576112a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c156e60 con 0x7f575c0cbc10 2023-07-13T14:20:36.600 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.608+0000 7f575b59e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f575c0c8560 0x7f575c160e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47704/0 (socket says 172.21.15.118:47704) 2023-07-13T14:20:36.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.608+0000 7f575b59e700 1 -- 172.21.15.118:0/457201325 learned_addr learned my addr 172.21.15.118:0/457201325 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:36.601 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.608+0000 7f575a59c700 1 --2- 172.21.15.118:0/457201325 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:36.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.611+0000 7f5759d9b700 1 -- 172.21.15.118:0/457201325 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492235242 0 0) 0x7f575c150b80 con 0x7f575c0c8560 2023-07-13T14:20:36.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.611+0000 7f5759d9b700 1 -- 172.21.15.118:0/457201325 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57440035b0 con 0x7f575c0c8560 2023-07-13T14:20:36.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.611+0000 7f575a59c700 1 -- 172.21.15.118:0/457201325 >> v1:172.21.15.123:6789/0 conn(0x7f575c0cb840 legacy=0x7f575c159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:36.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.611+0000 7f575a59c700 1 -- 172.21.15.118:0/457201325 >> v1:172.21.15.118:6789/0 conn(0x7f575c0c8560 legacy=0x7f575c160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:36.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.611+0000 7f575a59c700 1 -- 172.21.15.118:0/457201325 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c06f0e0 con 0x7f575c0cbc10 2023-07-13T14:20:36.605 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.613+0000 7f575a59c700 1 --2- 172.21.15.118:0/457201325 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c0c8020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5750009870 tx=0x7f5750009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c86b9776fd9f0b78 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:36.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f5759d9b700 1 -- 172.21.15.118:0/457201325 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750011830 con 0x7f575c0cbc10 2023-07-13T14:20:36.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f5759d9b700 1 -- 172.21.15.118:0/457201325 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750011990 con 0x7f575c0cbc10 2023-07-13T14:20:36.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f5759d9b700 1 -- 172.21.15.118:0/457201325 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750011d20 con 0x7f575c0cbc10 2023-07-13T14:20:36.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f576112a700 1 -- 172.21.15.118:0/457201325 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 msgr2=0x7f575c0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:36.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f576112a700 1 --2- 172.21.15.118:0/457201325 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c0c8020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5750009870 tx=0x7f5750009b80 comp rx=0 tx=0).stop 2023-07-13T14:20:36.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f576112a700 1 -- 172.21.15.118:0/457201325 shutdown_connections 2023-07-13T14:20:36.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f576112a700 1 --2- 172.21.15.118:0/457201325 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c0c8020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:36.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f576112a700 1 -- 172.21.15.118:0/457201325 >> 172.21.15.118:0/457201325 conn(0x7f575c06cf10 msgr2=0x7f575c06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:36.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f576112a700 1 -- 172.21.15.118:0/457201325 shutdown_connections 2023-07-13T14:20:36.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.617+0000 7f576112a700 1 -- 172.21.15.118:0/457201325 wait complete. 2023-07-13T14:20:36.611 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.619+0000 7f576112a700 1 Processor -- start 2023-07-13T14:20:36.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.619+0000 7f576112a700 1 -- start start 2023-07-13T14:20:36.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f576112a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f575c0c8560 0x7f575c1f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f576112a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0cb840 0x7f575c148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f576112a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c1494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f576112a700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c1e1210 con 0x7f575c0cb840 2023-07-13T14:20:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f576112a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0c3d60 con 0x7f575c0c8560 2023-07-13T14:20:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f576112a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c1f2300 con 0x7f575c0cbc10 2023-07-13T14:20:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f575a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0cb840 0x7f575c148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f575ad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f575c0c8560 0x7f575c1f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:36.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.620+0000 7f575b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c1494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:36.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.621+0000 7f575b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c1494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:49678/0 (socket says 172.21.15.118:49678) 2023-07-13T14:20:36.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.621+0000 7f575b59e700 1 -- 172.21.15.118:0/2090383041 learned_addr learned my addr 172.21.15.118:0/2090383041 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:36.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.624+0000 7f575b59e700 1 -- 172.21.15.118:0/2090383041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f575c0c8560 msgr2=0x7f575c1f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:36.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.624+0000 7f575b59e700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f575c0c8560 0x7f575c1f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:36.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.624+0000 7f575b59e700 1 -- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0cb840 msgr2=0x7f575c148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:36.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.624+0000 7f575b59e700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0cb840 0x7f575c148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:36.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.624+0000 7f575b59e700 1 -- 172.21.15.118:0/2090383041 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500094a0 con 0x7f575c0cbc10 2023-07-13T14:20:36.619 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.627+0000 7f575b59e700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c1494f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f575400cb40 tx=0x7f575400ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:36.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.631+0000 7f57437fe700 1 -- 172.21.15.118:0/2090383041 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400a9e0 con 0x7f575c0cbc10 2023-07-13T14:20:36.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.631+0000 7f57437fe700 1 -- 172.21.15.118:0/2090383041 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400ab40 con 0x7f575c0cbc10 2023-07-13T14:20:36.623 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.631+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c0c4810 con 0x7f575c0cbc10 2023-07-13T14:20:36.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.631+0000 7f57437fe700 1 -- 172.21.15.118:0/2090383041 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754012400 con 0x7f575c0cbc10 2023-07-13T14:20:36.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.631+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c0c37a0 con 0x7f575c0cbc10 2023-07-13T14:20:36.624 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.632+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c1dfa80 con 0x7f575c0cbc10 2023-07-13T14:20:36.868 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.876+0000 7f57437fe700 1 -- 172.21.15.118:0/2090383041 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f575401b3b0 con 0x7f575c0cbc10 2023-07-13T14:20:36.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.876+0000 7f57437fe700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f574806ad10 0x7f574806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:36.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.876+0000 7f575ad9d700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f574806ad10 0x7f574806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:36.869 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.877+0000 7f575ad9d700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f574806ad10 0x7f574806d1c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f574c000f60 tx=0x7f574c009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:36.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.881+0000 7f57437fe700 1 -- 172.21.15.118:0/2090383041 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5754007b40 con 0x7f575c0cbc10 2023-07-13T14:20:36.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:36.892+0000 7f57437fe700 1 -- 172.21.15.118:0/2090383041 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5754054440 con 0x7f575c0cbc10 2023-07-13T14:20:37.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.079+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f575c06f3c0 con 0x7f574806ad10 2023-07-13T14:20:37.081 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.089+0000 7f57437fe700 1 -- 172.21.15.118:0/2090383041 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393319 (secure 0 0 0) 0x7f574c0015a0 con 0x7f574806ad10 2023-07-13T14:20:37.085 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:20:37.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f574806ad10 msgr2=0x7f574806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:37.087 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f574806ad10 0x7f574806d1c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f574c000f60 tx=0x7f574c009040 comp rx=0 tx=0).stop 2023-07-13T14:20:37.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 msgr2=0x7f575c1494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:37.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c1494f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f575400cb40 tx=0x7f575400ce50 comp rx=0 tx=0).stop 2023-07-13T14:20:37.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 shutdown_connections 2023-07-13T14:20:37.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f574806ad10 0x7f574806d1c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f575c0c8560 0x7f575c1f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f575c0cbc10 0x7f575c1494f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.088 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 --2- 172.21.15.118:0/2090383041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f575c0cb840 0x7f575c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 >> 172.21.15.118:0/2090383041 conn(0x7f575c06cf10 msgr2=0x7f575c155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:37.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 shutdown_connections 2023-07-13T14:20:37.089 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.093+0000 7f576112a700 1 -- 172.21.15.118:0/2090383041 wait complete. 2023-07-13T14:20:37.089 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T14:20:37.097 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":879,"stamp":"2023-07-13T14:20:35.298035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35755431,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":925,"num_read_kb":952,"num_write":11483,"num_write_kb":323812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13364,"ondisk_log_size":13364,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406344,"kb_used_data":50824,"kb_used_omap":13,"kb_used_meta":355442,"kb_avail":754568376,"statfs":{"total":773094113280,"available":772678017024,"internally_reserved":0,"allocated":52043776,"data_stored":72647622,"data_compressed":6272288,"data_compressed_allocated":9814016,"data_compressed_original":32006144,"omap_allocated":14248,"internal_metadata":363972696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11527,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003155"},"pg_stats":[{"pgid":"4.3f","version":"31'26","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.070994+0000","last_change":"2023-07-13T13:52:17.926057+0000","last_active":"2023-07-13T14:20:29.070994+0000","last_peered":"2023-07-13T14:20:29.070994+0000","last_clean":"2023-07-13T14:20:29.070994+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T14:20:29.070994+0000","last_undegraded":"2023-07-13T14:20:29.070994+0000","last_fullsized":"2023-07-13T14:20:29.070994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:01:09.969490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"31'31","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.030541+0000","last_change":"2023-07-13T13:52:17.952706+0000","last_active":"2023-07-13T14:20:29.030541+0000","last_peered":"2023-07-13T14:20:29.030541+0000","last_clean":"2023-07-13T14:20:29.030541+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T14:20:29.030541+0000","last_undegraded":"2023-07-13T14:20:29.030541+0000","last_fullsized":"2023-07-13T14:20:29.030541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:47.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052353+0000","last_change":"2023-07-13T13:52:17.943505+0000","last_active":"2023-07-13T14:20:29.052353+0000","last_peered":"2023-07-13T14:20:29.052353+0000","last_clean":"2023-07-13T14:20:29.052353+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T14:20:29.052353+0000","last_undegraded":"2023-07-13T14:20:29.052353+0000","last_fullsized":"2023-07-13T14:20:29.052353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:57:33.638855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"31'25","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.116236+0000","last_change":"2023-07-13T13:52:17.933893+0000","last_active":"2023-07-13T14:20:29.116236+0000","last_peered":"2023-07-13T14:20:29.116236+0000","last_clean":"2023-07-13T14:20:29.116236+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T14:20:29.116236+0000","last_undegraded":"2023-07-13T14:20:29.116236+0000","last_fullsized":"2023-07-13T14:20:29.116236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:37:29.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"31'23","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218387+0000","last_change":"2023-07-13T13:52:17.886730+0000","last_active":"2023-07-13T14:20:29.218387+0000","last_peered":"2023-07-13T14:20:29.218387+0000","last_clean":"2023-07-13T14:20:29.218387+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T14:20:29.218387+0000","last_undegraded":"2023-07-13T14:20:29.218387+0000","last_fullsized":"2023-07-13T14:20:29.218387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:46:11.415041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.042967+0000","last_change":"2023-07-13T13:52:17.942599+0000","last_active":"2023-07-13T14:20:29.042967+0000","last_peered":"2023-07-13T14:20:29.042967+0000","last_clean":"2023-07-13T14:20:29.042967+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T14:20:29.042967+0000","last_undegraded":"2023-07-13T14:20:29.042967+0000","last_fullsized":"2023-07-13T14:20:29.042967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:15:36.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071363+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T14:20:29.071363+0000","last_peered":"2023-07-13T14:20:29.071363+0000","last_clean":"2023-07-13T14:20:29.071363+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T14:20:29.071363+0000","last_undegraded":"2023-07-13T14:20:29.071363+0000","last_fullsized":"2023-07-13T14:20:29.071363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:29.831587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"31'22","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037767+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T14:20:29.037767+0000","last_peered":"2023-07-13T14:20:29.037767+0000","last_clean":"2023-07-13T14:20:29.037767+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T14:20:29.037767+0000","last_undegraded":"2023-07-13T14:20:29.037767+0000","last_fullsized":"2023-07-13T14:20:29.037767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:05:01.082348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"31'35","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219321+0000","last_change":"2023-07-13T13:52:58.032563+0000","last_active":"2023-07-13T14:20:29.219321+0000","last_peered":"2023-07-13T14:20:29.219321+0000","last_clean":"2023-07-13T14:20:29.219321+0000","last_became_active":"2023-07-13T13:52:58.032221+0000","last_became_peered":"2023-07-13T13:52:58.032221+0000","last_unstale":"2023-07-13T14:20:29.219321+0000","last_undegraded":"2023-07-13T14:20:29.219321+0000","last_fullsized":"2023-07-13T14:20:29.219321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:17:32.249199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'37","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.040091+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T14:20:29.040091+0000","last_peered":"2023-07-13T14:20:29.040091+0000","last_clean":"2023-07-13T14:20:29.040091+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T14:20:29.040091+0000","last_undegraded":"2023-07-13T14:20:29.040091+0000","last_fullsized":"2023-07-13T14:20:29.040091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"31'30","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.045065+0000","last_change":"2023-07-13T13:52:58.431745+0000","last_active":"2023-07-13T14:20:29.045065+0000","last_peered":"2023-07-13T14:20:29.045065+0000","last_clean":"2023-07-13T14:20:29.045065+0000","last_became_active":"2023-07-13T13:52:58.431466+0000","last_became_peered":"2023-07-13T13:52:58.431466+0000","last_unstale":"2023-07-13T14:20:29.045065+0000","last_undegraded":"2023-07-13T14:20:29.045065+0000","last_fullsized":"2023-07-13T14:20:29.045065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:27:08.861062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"31'22","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.069318+0000","last_change":"2023-07-13T13:52:17.943253+0000","last_active":"2023-07-13T14:20:29.069318+0000","last_peered":"2023-07-13T14:20:29.069318+0000","last_clean":"2023-07-13T14:20:29.069318+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T14:20:29.069318+0000","last_undegraded":"2023-07-13T14:20:29.069318+0000","last_fullsized":"2023-07-13T14:20:29.069318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:41:19.844182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"31'35","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071128+0000","last_change":"2023-07-13T13:52:17.925230+0000","last_active":"2023-07-13T14:20:29.071128+0000","last_peered":"2023-07-13T14:20:29.071128+0000","last_clean":"2023-07-13T14:20:29.071128+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T14:20:29.071128+0000","last_undegraded":"2023-07-13T14:20:29.071128+0000","last_fullsized":"2023-07-13T14:20:29.071128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:37:35.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'35","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037770+0000","last_change":"2023-07-13T13:52:17.925445+0000","last_active":"2023-07-13T14:20:29.037770+0000","last_peered":"2023-07-13T14:20:29.037770+0000","last_clean":"2023-07-13T14:20:29.037770+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T14:20:29.037770+0000","last_undegraded":"2023-07-13T14:20:29.037770+0000","last_fullsized":"2023-07-13T14:20:29.037770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:38:34.228527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"31'35","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071487+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T14:20:29.071487+0000","last_peered":"2023-07-13T14:20:29.071487+0000","last_clean":"2023-07-13T14:20:29.071487+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T14:20:29.071487+0000","last_undegraded":"2023-07-13T14:20:29.071487+0000","last_fullsized":"2023-07-13T14:20:29.071487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:33.058046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"31'33","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052262+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T14:20:29.052262+0000","last_peered":"2023-07-13T14:20:29.052262+0000","last_clean":"2023-07-13T14:20:29.052262+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T14:20:29.052262+0000","last_undegraded":"2023-07-13T14:20:29.052262+0000","last_fullsized":"2023-07-13T14:20:29.052262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:58:13.171516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"31'32","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219090+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T14:20:29.219090+0000","last_peered":"2023-07-13T14:20:29.219090+0000","last_clean":"2023-07-13T14:20:29.219090+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T14:20:29.219090+0000","last_undegraded":"2023-07-13T14:20:29.219090+0000","last_fullsized":"2023-07-13T14:20:29.219090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:00:48.553687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"31'42","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.053186+0000","last_change":"2023-07-13T13:52:17.942704+0000","last_active":"2023-07-13T14:20:29.053186+0000","last_peered":"2023-07-13T14:20:29.053186+0000","last_clean":"2023-07-13T14:20:29.053186+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T14:20:29.053186+0000","last_undegraded":"2023-07-13T14:20:29.053186+0000","last_fullsized":"2023-07-13T14:20:29.053186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:55:37.936044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"31'31","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.066190+0000","last_change":"2023-07-13T13:52:17.934990+0000","last_active":"2023-07-13T14:20:29.066190+0000","last_peered":"2023-07-13T14:20:29.066190+0000","last_clean":"2023-07-13T14:20:29.066190+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T14:20:29.066190+0000","last_undegraded":"2023-07-13T14:20:29.066190+0000","last_fullsized":"2023-07-13T14:20:29.066190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:02.191186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"31'36","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052769+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T14:20:29.052769+0000","last_peered":"2023-07-13T14:20:29.052769+0000","last_clean":"2023-07-13T14:20:29.052769+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T14:20:29.052769+0000","last_undegraded":"2023-07-13T14:20:29.052769+0000","last_fullsized":"2023-07-13T14:20:29.052769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:06:12.632230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"31'46","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071286+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T14:20:29.071286+0000","last_peered":"2023-07-13T14:20:29.071286+0000","last_clean":"2023-07-13T14:20:29.071286+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T14:20:29.071286+0000","last_undegraded":"2023-07-13T14:20:29.071286+0000","last_fullsized":"2023-07-13T14:20:29.071286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:34.535336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"31'34","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218021+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T14:20:29.218021+0000","last_peered":"2023-07-13T14:20:29.218021+0000","last_clean":"2023-07-13T14:20:29.218021+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T14:20:29.218021+0000","last_undegraded":"2023-07-13T14:20:29.218021+0000","last_fullsized":"2023-07-13T14:20:29.218021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:35.504227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"31'37","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.060231+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T14:20:29.060231+0000","last_peered":"2023-07-13T14:20:29.060231+0000","last_clean":"2023-07-13T14:20:29.060231+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T14:20:29.060231+0000","last_undegraded":"2023-07-13T14:20:29.060231+0000","last_fullsized":"2023-07-13T14:20:29.060231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:47.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071246+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T14:20:29.071246+0000","last_peered":"2023-07-13T14:20:29.071246+0000","last_clean":"2023-07-13T14:20:29.071246+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T14:20:29.071246+0000","last_undegraded":"2023-07-13T14:20:29.071246+0000","last_fullsized":"2023-07-13T14:20:29.071246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"31'27","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.228712+0000","last_change":"2023-07-13T13:52:17.951443+0000","last_active":"2023-07-13T14:20:29.228712+0000","last_peered":"2023-07-13T14:20:29.228712+0000","last_clean":"2023-07-13T14:20:29.228712+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T14:20:29.228712+0000","last_undegraded":"2023-07-13T14:20:29.228712+0000","last_fullsized":"2023-07-13T14:20:29.228712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:38:59.029829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"31'39","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230308+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T14:20:29.230308+0000","last_peered":"2023-07-13T14:20:29.230308+0000","last_clean":"2023-07-13T14:20:29.230308+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T14:20:29.230308+0000","last_undegraded":"2023-07-13T14:20:29.230308+0000","last_fullsized":"2023-07-13T14:20:29.230308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:50:40.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"31'23","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035220+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T14:20:29.035220+0000","last_peered":"2023-07-13T14:20:29.035220+0000","last_clean":"2023-07-13T14:20:29.035220+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T14:20:29.035220+0000","last_undegraded":"2023-07-13T14:20:29.035220+0000","last_fullsized":"2023-07-13T14:20:29.035220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:12.557056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573994+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T14:19:53.573994+0000","last_peered":"2023-07-13T14:19:53.573994+0000","last_clean":"2023-07-13T14:19:53.573994+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T14:19:53.573994+0000","last_undegraded":"2023-07-13T14:19:53.573994+0000","last_fullsized":"2023-07-13T14:19:53.573994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:29:36.180810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"31'645","reported_seq":683,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.802282+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T14:19:57.802282+0000","last_peered":"2023-07-13T14:19:57.802282+0000","last_clean":"2023-07-13T14:19:57.802282+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T14:19:57.802282+0000","last_undegraded":"2023-07-13T14:19:57.802282+0000","last_fullsized":"2023-07-13T14:19:57.802282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:50:15.899141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'42","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055906+0000","last_change":"2023-07-13T13:52:17.948432+0000","last_active":"2023-07-13T14:20:29.055906+0000","last_peered":"2023-07-13T14:20:29.055906+0000","last_clean":"2023-07-13T14:20:29.055906+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T14:20:29.055906+0000","last_undegraded":"2023-07-13T14:20:29.055906+0000","last_fullsized":"2023-07-13T14:20:29.055906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:45:09.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'125","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:48.633658+0000","last_change":"2023-07-13T13:52:23.984769+0000","last_active":"2023-07-13T14:19:48.633658+0000","last_peered":"2023-07-13T14:19:48.633658+0000","last_clean":"2023-07-13T14:19:48.633658+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T14:19:48.633658+0000","last_undegraded":"2023-07-13T14:19:48.633658+0000","last_fullsized":"2023-07-13T14:19:48.633658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:01:10.403090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":11569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.881932+0000","last_change":"2023-07-13T13:52:16.667863+0000","last_active":"2023-07-13T14:20:06.881932+0000","last_peered":"2023-07-13T14:20:06.881932+0000","last_clean":"2023-07-13T14:20:06.881932+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T14:20:06.881932+0000","last_undegraded":"2023-07-13T14:20:06.881932+0000","last_fullsized":"2023-07-13T14:20:06.881932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:32:47.027923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'20","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217062+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T14:20:29.217062+0000","last_peered":"2023-07-13T14:20:29.217062+0000","last_clean":"2023-07-13T14:20:29.217062+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T14:20:29.217062+0000","last_undegraded":"2023-07-13T14:20:29.217062+0000","last_fullsized":"2023-07-13T14:20:29.217062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:30:22.976473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"31'103","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.770450+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T14:19:51.770450+0000","last_peered":"2023-07-13T14:19:51.770450+0000","last_clean":"2023-07-13T14:19:51.770450+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T14:19:51.770450+0000","last_undegraded":"2023-07-13T14:19:51.770450+0000","last_fullsized":"2023-07-13T14:19:51.770450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:59:03.195341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:10.959724+0000","last_change":"2023-07-13T13:52:16.607515+0000","last_active":"2023-07-13T14:20:10.959724+0000","last_peered":"2023-07-13T14:20:10.959724+0000","last_clean":"2023-07-13T14:20:10.959724+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T14:20:10.959724+0000","last_undegraded":"2023-07-13T14:20:10.959724+0000","last_fullsized":"2023-07-13T14:20:10.959724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:31.911995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'33","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.115258+0000","last_change":"2023-07-13T13:52:17.934538+0000","last_active":"2023-07-13T14:20:29.115258+0000","last_peered":"2023-07-13T14:20:29.115258+0000","last_clean":"2023-07-13T14:20:29.115258+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T14:20:29.115258+0000","last_undegraded":"2023-07-13T14:20:29.115258+0000","last_fullsized":"2023-07-13T14:20:29.115258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:01.447721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"31'138","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.568510+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T14:19:53.568510+0000","last_peered":"2023-07-13T14:19:53.568510+0000","last_clean":"2023-07-13T14:19:53.568510+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T14:19:53.568510+0000","last_undegraded":"2023-07-13T14:19:53.568510+0000","last_fullsized":"2023-07-13T14:19:53.568510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:13:08.564646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.193691+0000","last_change":"2023-07-13T13:52:16.668908+0000","last_active":"2023-07-13T14:20:17.193691+0000","last_peered":"2023-07-13T14:20:17.193691+0000","last_clean":"2023-07-13T14:20:17.193691+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T14:20:17.193691+0000","last_undegraded":"2023-07-13T14:20:17.193691+0000","last_fullsized":"2023-07-13T14:20:17.193691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:30:26.894929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'25","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056582+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T14:20:29.056582+0000","last_peered":"2023-07-13T14:20:29.056582+0000","last_clean":"2023-07-13T14:20:29.056582+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T14:20:29.056582+0000","last_undegraded":"2023-07-13T14:20:29.056582+0000","last_fullsized":"2023-07-13T14:20:29.056582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:48.380599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.577512+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T14:19:53.577512+0000","last_peered":"2023-07-13T14:19:53.577512+0000","last_clean":"2023-07-13T14:19:53.577512+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T14:19:53.577512+0000","last_undegraded":"2023-07-13T14:19:53.577512+0000","last_fullsized":"2023-07-13T14:19:53.577512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:34:34.679685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":9189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:08.889486+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T14:20:08.889486+0000","last_peered":"2023-07-13T14:20:08.889486+0000","last_clean":"2023-07-13T14:20:08.889486+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T14:20:08.889486+0000","last_undegraded":"2023-07-13T14:20:08.889486+0000","last_fullsized":"2023-07-13T14:20:08.889486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:02.471208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"31'28","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.060805+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T14:20:29.060805+0000","last_peered":"2023-07-13T14:20:29.060805+0000","last_clean":"2023-07-13T14:20:29.060805+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T14:20:29.060805+0000","last_undegraded":"2023-07-13T14:20:29.060805+0000","last_fullsized":"2023-07-13T14:20:29.060805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:23.423317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"31'148","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:54.594249+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T14:19:54.594249+0000","last_peered":"2023-07-13T14:19:54.594249+0000","last_clean":"2023-07-13T14:19:54.594249+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T14:19:54.594249+0000","last_undegraded":"2023-07-13T14:19:54.594249+0000","last_fullsized":"2023-07-13T14:19:54.594249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:18.763893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":18843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'535","reported_seq":573,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.083140+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T14:20:21.083140+0000","last_peered":"2023-07-13T14:20:21.083140+0000","last_clean":"2023-07-13T14:20:21.083140+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T14:20:21.083140+0000","last_undegraded":"2023-07-13T14:20:21.083140+0000","last_fullsized":"2023-07-13T14:20:21.083140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:47.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"31'35","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230975+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T14:20:29.230975+0000","last_peered":"2023-07-13T14:20:29.230975+0000","last_clean":"2023-07-13T14:20:29.230975+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T14:20:29.230975+0000","last_undegraded":"2023-07-13T14:20:29.230975+0000","last_fullsized":"2023-07-13T14:20:29.230975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:50:42.203743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'132","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.469982+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T14:19:52.469982+0000","last_peered":"2023-07-13T14:19:52.469982+0000","last_clean":"2023-07-13T14:19:52.469982+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T14:19:52.469982+0000","last_undegraded":"2023-07-13T14:19:52.469982+0000","last_fullsized":"2023-07-13T14:19:52.469982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:27:28.126700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":15927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'845","reported_seq":884,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:16.964985+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T14:20:16.964985+0000","last_peered":"2023-07-13T14:20:16.964985+0000","last_clean":"2023-07-13T14:20:16.964985+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T14:20:16.964985+0000","last_undegraded":"2023-07-13T14:20:16.964985+0000","last_fullsized":"2023-07-13T14:20:16.964985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:28:31.879491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"31'43","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055462+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T14:20:29.055462+0000","last_peered":"2023-07-13T14:20:29.055462+0000","last_clean":"2023-07-13T14:20:29.055462+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T14:20:29.055462+0000","last_undegraded":"2023-07-13T14:20:29.055462+0000","last_fullsized":"2023-07-13T14:20:29.055462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:20:57.526559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"31'113","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.764052+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T14:19:51.764052+0000","last_peered":"2023-07-13T14:19:51.764052+0000","last_clean":"2023-07-13T14:19:51.764052+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T14:19:51.764052+0000","last_undegraded":"2023-07-13T14:19:51.764052+0000","last_fullsized":"2023-07-13T14:19:51.764052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:54.587437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":11208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'8","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.097250+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T14:20:17.097250+0000","last_peered":"2023-07-13T14:20:17.097250+0000","last_clean":"2023-07-13T14:20:17.097250+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T14:20:17.097250+0000","last_undegraded":"2023-07-13T14:20:17.097250+0000","last_fullsized":"2023-07-13T14:20:17.097250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'27","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055907+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T14:20:29.055907+0000","last_peered":"2023-07-13T14:20:29.055907+0000","last_clean":"2023-07-13T14:20:29.055907+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T14:20:29.055907+0000","last_undegraded":"2023-07-13T14:20:29.055907+0000","last_fullsized":"2023-07-13T14:20:29.055907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:21:54.287499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'88","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576577+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T14:19:53.576577+0000","last_peered":"2023-07-13T14:19:53.576577+0000","last_clean":"2023-07-13T14:19:53.576577+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T14:19:53.576577+0000","last_undegraded":"2023-07-13T14:19:53.576577+0000","last_fullsized":"2023-07-13T14:19:53.576577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:39:40.932985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:16.902628+0000","last_change":"2023-07-13T13:52:16.663350+0000","last_active":"2023-07-13T14:20:16.902628+0000","last_peered":"2023-07-13T14:20:16.902628+0000","last_clean":"2023-07-13T14:20:16.902628+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T14:20:16.902628+0000","last_undegraded":"2023-07-13T14:20:16.902628+0000","last_fullsized":"2023-07-13T14:20:16.902628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:42:33.767450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.032664+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T14:20:29.032664+0000","last_peered":"2023-07-13T14:20:29.032664+0000","last_clean":"2023-07-13T14:20:29.032664+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T14:20:29.032664+0000","last_undegraded":"2023-07-13T14:20:29.032664+0000","last_fullsized":"2023-07-13T14:20:29.032664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:20:42.938534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"31'107","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.773562+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T14:19:51.773562+0000","last_peered":"2023-07-13T14:19:51.773562+0000","last_clean":"2023-07-13T14:19:51.773562+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T14:19:51.773562+0000","last_undegraded":"2023-07-13T14:19:51.773562+0000","last_fullsized":"2023-07-13T14:19:51.773562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:14:55.793442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:20.085088+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T14:20:20.085088+0000","last_peered":"2023-07-13T14:20:20.085088+0000","last_clean":"2023-07-13T14:20:20.085088+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T14:20:20.085088+0000","last_undegraded":"2023-07-13T14:20:20.085088+0000","last_fullsized":"2023-07-13T14:20:20.085088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:04.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"31'37","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217508+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T14:20:29.217508+0000","last_peered":"2023-07-13T14:20:29.217508+0000","last_clean":"2023-07-13T14:20:29.217508+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T14:20:29.217508+0000","last_undegraded":"2023-07-13T14:20:29.217508+0000","last_fullsized":"2023-07-13T14:20:29.217508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:18:20.394545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'128","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.462763+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T14:19:52.462763+0000","last_peered":"2023-07-13T14:19:52.462763+0000","last_clean":"2023-07-13T14:19:52.462763+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T14:19:52.462763+0000","last_undegraded":"2023-07-13T14:19:52.462763+0000","last_fullsized":"2023-07-13T14:19:52.462763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:36.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'14","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.005215+0000","last_change":"2023-07-13T13:52:16.692808+0000","last_active":"2023-07-13T14:20:17.005215+0000","last_peered":"2023-07-13T14:20:17.005215+0000","last_clean":"2023-07-13T14:20:17.005215+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T14:20:17.005215+0000","last_undegraded":"2023-07-13T14:20:17.005215+0000","last_fullsized":"2023-07-13T14:20:17.005215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:10.067515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'32","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055961+0000","last_change":"2023-07-13T13:52:17.838408+0000","last_active":"2023-07-13T14:20:29.055961+0000","last_peered":"2023-07-13T14:20:29.055961+0000","last_clean":"2023-07-13T14:20:29.055961+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T14:20:29.055961+0000","last_undegraded":"2023-07-13T14:20:29.055961+0000","last_fullsized":"2023-07-13T14:20:29.055961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:57:58.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"31'122","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.418083+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T14:19:52.418083+0000","last_peered":"2023-07-13T14:19:52.418083+0000","last_clean":"2023-07-13T14:19:52.418083+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T14:19:52.418083+0000","last_undegraded":"2023-07-13T14:19:52.418083+0000","last_fullsized":"2023-07-13T14:19:52.418083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:53.223544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.158417+0000","last_change":"2023-07-13T13:52:16.666097+0000","last_active":"2023-07-13T14:20:17.158417+0000","last_peered":"2023-07-13T14:20:17.158417+0000","last_clean":"2023-07-13T14:20:17.158417+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T14:20:17.158417+0000","last_undegraded":"2023-07-13T14:20:17.158417+0000","last_fullsized":"2023-07-13T14:20:17.158417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"31'31","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035188+0000","last_change":"2023-07-13T13:52:17.838908+0000","last_active":"2023-07-13T14:20:29.035188+0000","last_peered":"2023-07-13T14:20:29.035188+0000","last_clean":"2023-07-13T14:20:29.035188+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T14:20:29.035188+0000","last_undegraded":"2023-07-13T14:20:29.035188+0000","last_fullsized":"2023-07-13T14:20:29.035188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:34:28.472848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'99","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.254376+0000","last_change":"2023-07-13T13:52:23.993113+0000","last_active":"2023-07-13T14:19:51.254376+0000","last_peered":"2023-07-13T14:19:51.254376+0000","last_clean":"2023-07-13T14:19:51.254376+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T14:19:51.254376+0000","last_undegraded":"2023-07-13T14:19:51.254376+0000","last_fullsized":"2023-07-13T14:19:51.254376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:50:50.731203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:09.919165+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T14:20:09.919165+0000","last_peered":"2023-07-13T14:20:09.919165+0000","last_clean":"2023-07-13T14:20:09.919165+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T14:20:09.919165+0000","last_undegraded":"2023-07-13T14:20:09.919165+0000","last_fullsized":"2023-07-13T14:20:09.919165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:22.277267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035068+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T14:20:29.035068+0000","last_peered":"2023-07-13T14:20:29.035068+0000","last_clean":"2023-07-13T14:20:29.035068+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T14:20:29.035068+0000","last_undegraded":"2023-07-13T14:20:29.035068+0000","last_fullsized":"2023-07-13T14:20:29.035068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:29:43.401303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"31'154","reported_seq":183,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:50.928044+0000","last_change":"2023-07-13T13:52:23.992085+0000","last_active":"2023-07-13T14:19:50.928044+0000","last_peered":"2023-07-13T14:19:50.928044+0000","last_clean":"2023-07-13T14:19:50.928044+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T14:19:50.928044+0000","last_undegraded":"2023-07-13T14:19:50.928044+0000","last_fullsized":"2023-07-13T14:19:50.928044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:09:11.710768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.792804+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T14:19:57.792804+0000","last_peered":"2023-07-13T14:19:57.792804+0000","last_clean":"2023-07-13T14:19:57.792804+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T14:19:57.792804+0000","last_undegraded":"2023-07-13T14:19:57.792804+0000","last_fullsized":"2023-07-13T14:19:57.792804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:18.416220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"31'24","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.116356+0000","last_change":"2023-07-13T13:52:17.952164+0000","last_active":"2023-07-13T14:20:29.116356+0000","last_peered":"2023-07-13T14:20:29.116356+0000","last_clean":"2023-07-13T14:20:29.116356+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T14:20:29.116356+0000","last_undegraded":"2023-07-13T14:20:29.116356+0000","last_fullsized":"2023-07-13T14:20:29.116356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:58:56.106442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'113","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.024082+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T14:19:51.024082+0000","last_peered":"2023-07-13T14:19:51.024082+0000","last_clean":"2023-07-13T14:19:51.024082+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T14:19:51.024082+0000","last_undegraded":"2023-07-13T14:19:51.024082+0000","last_fullsized":"2023-07-13T14:19:51.024082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:04:18.127640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:04.797820+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T14:20:04.797820+0000","last_peered":"2023-07-13T14:20:04.797820+0000","last_clean":"2023-07-13T14:20:04.797820+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T14:20:04.797820+0000","last_undegraded":"2023-07-13T14:20:04.797820+0000","last_fullsized":"2023-07-13T14:20:04.797820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:18.013759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'32","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218708+0000","last_change":"2023-07-13T13:52:17.952349+0000","last_active":"2023-07-13T14:20:29.218708+0000","last_peered":"2023-07-13T14:20:29.218708+0000","last_clean":"2023-07-13T14:20:29.218708+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T14:20:29.218708+0000","last_undegraded":"2023-07-13T14:20:29.218708+0000","last_fullsized":"2023-07-13T14:20:29.218708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:33.131082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'94","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:49.447041+0000","last_change":"2023-07-13T13:52:23.987269+0000","last_active":"2023-07-13T14:19:49.447041+0000","last_peered":"2023-07-13T14:19:49.447041+0000","last_clean":"2023-07-13T14:19:49.447041+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T14:19:49.447041+0000","last_undegraded":"2023-07-13T14:19:49.447041+0000","last_fullsized":"2023-07-13T14:19:49.447041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:04:05.152920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'580","reported_seq":619,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.881428+0000","last_change":"2023-07-13T13:52:16.607455+0000","last_active":"2023-07-13T14:20:06.881428+0000","last_peered":"2023-07-13T14:20:06.881428+0000","last_clean":"2023-07-13T14:20:06.881428+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T14:20:06.881428+0000","last_undegraded":"2023-07-13T14:20:06.881428+0000","last_fullsized":"2023-07-13T14:20:06.881428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:18.416220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"31'30","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.038118+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T14:20:29.038118+0000","last_peered":"2023-07-13T14:20:29.038118+0000","last_clean":"2023-07-13T14:20:29.038118+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T14:20:29.038118+0000","last_undegraded":"2023-07-13T14:20:29.038118+0000","last_fullsized":"2023-07-13T14:20:29.038118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:11.058247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'157","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.263137+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T14:19:51.263137+0000","last_peered":"2023-07-13T14:19:51.263137+0000","last_clean":"2023-07-13T14:19:51.263137+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T14:19:51.263137+0000","last_undegraded":"2023-07-13T14:19:51.263137+0000","last_fullsized":"2023-07-13T14:19:51.263137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:00:18.515871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":13657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:08.889681+0000","last_change":"2023-07-13T13:52:16.692899+0000","last_active":"2023-07-13T14:20:08.889681+0000","last_peered":"2023-07-13T14:20:08.889681+0000","last_clean":"2023-07-13T14:20:08.889681+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T14:20:08.889681+0000","last_undegraded":"2023-07-13T14:20:08.889681+0000","last_fullsized":"2023-07-13T14:20:08.889681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:16:15.151366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"31'28","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052840+0000","last_change":"2023-07-13T13:52:17.942165+0000","last_active":"2023-07-13T14:20:29.052840+0000","last_peered":"2023-07-13T14:20:29.052840+0000","last_clean":"2023-07-13T14:20:29.052840+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T14:20:29.052840+0000","last_undegraded":"2023-07-13T14:20:29.052840+0000","last_fullsized":"2023-07-13T14:20:29.052840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.112967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'108","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576192+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T14:19:53.576192+0000","last_peered":"2023-07-13T14:19:53.576192+0000","last_clean":"2023-07-13T14:19:53.576192+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T14:19:53.576192+0000","last_undegraded":"2023-07-13T14:19:53.576192+0000","last_fullsized":"2023-07-13T14:19:53.576192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:25.769108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":8018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.896456+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T14:20:06.896456+0000","last_peered":"2023-07-13T14:20:06.896456+0000","last_clean":"2023-07-13T14:20:06.896456+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T14:20:06.896456+0000","last_undegraded":"2023-07-13T14:20:06.896456+0000","last_fullsized":"2023-07-13T14:20:06.896456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:48:26.050917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"31'17","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.042824+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T14:20:29.042824+0000","last_peered":"2023-07-13T14:20:29.042824+0000","last_clean":"2023-07-13T14:20:29.042824+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T14:20:29.042824+0000","last_undegraded":"2023-07-13T14:20:29.042824+0000","last_fullsized":"2023-07-13T14:20:29.042824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:57:35.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.776600+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T14:19:51.776600+0000","last_peered":"2023-07-13T14:19:51.776600+0000","last_clean":"2023-07-13T14:19:51.776600+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T14:19:51.776600+0000","last_undegraded":"2023-07-13T14:19:51.776600+0000","last_fullsized":"2023-07-13T14:19:51.776600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:29:10.436681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:18.080416+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T14:20:18.080416+0000","last_peered":"2023-07-13T14:20:18.080416+0000","last_clean":"2023-07-13T14:20:18.080416+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T14:20:18.080416+0000","last_undegraded":"2023-07-13T14:20:18.080416+0000","last_fullsized":"2023-07-13T14:20:18.080416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'31","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227715+0000","last_change":"2023-07-13T13:52:17.949610+0000","last_active":"2023-07-13T14:20:29.227715+0000","last_peered":"2023-07-13T14:20:29.227715+0000","last_clean":"2023-07-13T14:20:29.227715+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T14:20:29.227715+0000","last_undegraded":"2023-07-13T14:20:29.227715+0000","last_fullsized":"2023-07-13T14:20:29.227715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:17:32.249199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"31'114","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.467905+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T14:19:52.467905+0000","last_peered":"2023-07-13T14:19:52.467905+0000","last_clean":"2023-07-13T14:19:52.467905+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T14:19:52.467905+0000","last_undegraded":"2023-07-13T14:19:52.467905+0000","last_fullsized":"2023-07-13T14:19:52.467905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:09:55.119214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:01.898722+0000","last_change":"2023-07-13T13:51:59.916015+0000","last_active":"2023-07-13T14:17:01.898722+0000","last_peered":"2023-07-13T14:17:01.898722+0000","last_clean":"2023-07-13T14:17:01.898722+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T14:17:01.898722+0000","last_undegraded":"2023-07-13T14:17:01.898722+0000","last_fullsized":"2023-07-13T14:17:01.898722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:19:25.211327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.882185+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T14:20:06.882185+0000","last_peered":"2023-07-13T14:20:06.882185+0000","last_clean":"2023-07-13T14:20:06.882185+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T14:20:06.882185+0000","last_undegraded":"2023-07-13T14:20:06.882185+0000","last_fullsized":"2023-07-13T14:20:06.882185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:31.911995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233750+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T14:20:29.233750+0000","last_peered":"2023-07-13T14:20:29.233750+0000","last_clean":"2023-07-13T14:20:29.233750+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T14:20:29.233750+0000","last_undegraded":"2023-07-13T14:20:29.233750+0000","last_fullsized":"2023-07-13T14:20:29.233750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:59:15.006259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'128","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.771202+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T14:19:51.771202+0000","last_peered":"2023-07-13T14:19:51.771202+0000","last_clean":"2023-07-13T14:19:51.771202+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T14:19:51.771202+0000","last_undegraded":"2023-07-13T14:19:51.771202+0000","last_fullsized":"2023-07-13T14:19:51.771202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:48:59.588023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":10905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.024467+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T14:17:02.024467+0000","last_peered":"2023-07-13T14:17:02.024467+0000","last_clean":"2023-07-13T14:17:02.024467+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T14:17:02.024467+0000","last_undegraded":"2023-07-13T14:17:02.024467+0000","last_fullsized":"2023-07-13T14:17:02.024467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:16.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:09.925212+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T14:20:09.925212+0000","last_peered":"2023-07-13T14:20:09.925212+0000","last_clean":"2023-07-13T14:20:09.925212+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T14:20:09.925212+0000","last_undegraded":"2023-07-13T14:20:09.925212+0000","last_fullsized":"2023-07-13T14:20:09.925212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:29:17.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"31'27","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230093+0000","last_change":"2023-07-13T13:52:17.947909+0000","last_active":"2023-07-13T14:20:29.230093+0000","last_peered":"2023-07-13T14:20:29.230093+0000","last_clean":"2023-07-13T14:20:29.230093+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T14:20:29.230093+0000","last_undegraded":"2023-07-13T14:20:29.230093+0000","last_fullsized":"2023-07-13T14:20:29.230093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:46:46.566206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'124","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.463674+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T14:19:51.463674+0000","last_peered":"2023-07-13T14:19:51.463674+0000","last_clean":"2023-07-13T14:19:51.463674+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T14:19:51.463674+0000","last_undegraded":"2023-07-13T14:19:51.463674+0000","last_fullsized":"2023-07-13T14:19:51.463674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:12:06.075843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.045790+0000","last_change":"2023-07-13T13:52:01.224691+0000","last_active":"2023-07-13T14:17:02.045790+0000","last_peered":"2023-07-13T14:17:02.045790+0000","last_clean":"2023-07-13T14:17:02.045790+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T14:17:02.045790+0000","last_undegraded":"2023-07-13T14:17:02.045790+0000","last_fullsized":"2023-07-13T14:17:02.045790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:50:24.194693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'185","reported_seq":224,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:28.835914+0000","last_change":"2023-07-13T13:52:16.668065+0000","last_active":"2023-07-13T14:20:28.835914+0000","last_peered":"2023-07-13T14:20:28.835914+0000","last_clean":"2023-07-13T14:20:28.835914+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T14:20:28.835914+0000","last_undegraded":"2023-07-13T14:20:28.835914+0000","last_fullsized":"2023-07-13T14:20:28.835914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:05:52.448061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1434466,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233347+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T14:20:29.233347+0000","last_peered":"2023-07-13T14:20:29.233347+0000","last_clean":"2023-07-13T14:20:29.233347+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T14:20:29.233347+0000","last_undegraded":"2023-07-13T14:20:29.233347+0000","last_fullsized":"2023-07-13T14:20:29.233347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:48:53.381186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:49.425871+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T14:19:49.425871+0000","last_peered":"2023-07-13T14:19:49.425871+0000","last_clean":"2023-07-13T14:19:49.425871+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T14:19:49.425871+0000","last_undegraded":"2023-07-13T14:19:49.425871+0000","last_fullsized":"2023-07-13T14:19:49.425871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:25.366647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.024504+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T14:17:02.024504+0000","last_peered":"2023-07-13T14:17:02.024504+0000","last_clean":"2023-07-13T14:17:02.024504+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T14:17:02.024504+0000","last_undegraded":"2023-07-13T14:17:02.024504+0000","last_fullsized":"2023-07-13T14:17:02.024504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:51:43.589579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:02.080996+0000","last_change":"2023-07-13T13:51:57.962882+0000","last_active":"2023-07-13T14:18:02.080996+0000","last_peered":"2023-07-13T14:18:02.080996+0000","last_clean":"2023-07-13T14:18:02.080996+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T14:18:02.080996+0000","last_undegraded":"2023-07-13T14:18:02.080996+0000","last_fullsized":"2023-07-13T14:18:02.080996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_clean_scrub_stamp":"2023-07-13T13:51:55.598839+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:04:40.216785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:16.894211+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T14:17:16.894211+0000","last_peered":"2023-07-13T14:17:16.894211+0000","last_clean":"2023-07-13T14:17:16.894211+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T14:17:16.894211+0000","last_undegraded":"2023-07-13T14:17:16.894211+0000","last_fullsized":"2023-07-13T14:17:16.894211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"31'29","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.108922+0000","last_change":"2023-07-13T13:52:17.942525+0000","last_active":"2023-07-13T14:20:29.108922+0000","last_peered":"2023-07-13T14:20:29.108922+0000","last_clean":"2023-07-13T14:20:29.108922+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T14:20:29.108922+0000","last_undegraded":"2023-07-13T14:20:29.108922+0000","last_fullsized":"2023-07-13T14:20:29.108922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:05.040114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"31'125","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.764052+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T14:19:51.764052+0000","last_peered":"2023-07-13T14:19:51.764052+0000","last_clean":"2023-07-13T14:19:51.764052+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T14:19:51.764052+0000","last_undegraded":"2023-07-13T14:19:51.764052+0000","last_fullsized":"2023-07-13T14:19:51.764052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:29.630154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:07.081687+0000","last_change":"2023-07-13T13:52:00.016430+0000","last_active":"2023-07-13T14:18:07.081687+0000","last_peered":"2023-07-13T14:18:07.081687+0000","last_clean":"2023-07-13T14:18:07.081687+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T14:18:07.081687+0000","last_undegraded":"2023-07-13T14:18:07.081687+0000","last_fullsized":"2023-07-13T14:18:07.081687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:38:16.040470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"31'816","reported_seq":1663,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:24.078247+0000","last_change":"2023-07-13T13:52:16.630297+0000","last_active":"2023-07-13T14:20:24.078247+0000","last_peered":"2023-07-13T14:20:24.078247+0000","last_clean":"2023-07-13T14:20:24.078247+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T14:20:24.078247+0000","last_undegraded":"2023-07-13T14:20:24.078247+0000","last_fullsized":"2023-07-13T14:20:24.078247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:50:41.057693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174695,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":810,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"31'38","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217477+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T14:20:29.217477+0000","last_peered":"2023-07-13T14:20:29.217477+0000","last_clean":"2023-07-13T14:20:29.217477+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T14:20:29.217477+0000","last_undegraded":"2023-07-13T14:20:29.217477+0000","last_fullsized":"2023-07-13T14:20:29.217477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:50:40.487356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"31'163","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.699178+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T14:19:51.699178+0000","last_peered":"2023-07-13T14:19:51.699178+0000","last_clean":"2023-07-13T14:19:51.699178+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T14:19:51.699178+0000","last_undegraded":"2023-07-13T14:19:51.699178+0000","last_fullsized":"2023-07-13T14:19:51.699178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:49:00.719154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":7667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:07.073993+0000","last_change":"2023-07-13T13:52:00.019670+0000","last_active":"2023-07-13T14:17:07.073993+0000","last_peered":"2023-07-13T14:17:07.073993+0000","last_clean":"2023-07-13T14:17:07.073993+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T14:17:07.073993+0000","last_undegraded":"2023-07-13T14:17:07.073993+0000","last_fullsized":"2023-07-13T14:17:07.073993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:23:45.429201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:05.809167+0000","last_change":"2023-07-13T13:52:16.668244+0000","last_active":"2023-07-13T14:20:05.809167+0000","last_peered":"2023-07-13T14:20:05.809167+0000","last_clean":"2023-07-13T14:20:05.809167+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T14:20:05.809167+0000","last_undegraded":"2023-07-13T14:20:05.809167+0000","last_fullsized":"2023-07-13T14:20:05.809167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:42:33.767450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219044+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T14:20:29.219044+0000","last_peered":"2023-07-13T14:20:29.219044+0000","last_clean":"2023-07-13T14:20:29.219044+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T14:20:29.219044+0000","last_undegraded":"2023-07-13T14:20:29.219044+0000","last_fullsized":"2023-07-13T14:20:29.219044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:23:56.694084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"31'90","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573245+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T14:19:53.573245+0000","last_peered":"2023-07-13T14:19:53.573245+0000","last_clean":"2023-07-13T14:19:53.573245+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T14:19:53.573245+0000","last_undegraded":"2023-07-13T14:19:53.573245+0000","last_fullsized":"2023-07-13T14:19:53.573245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:46:13.524291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.078016+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T14:20:21.078016+0000","last_peered":"2023-07-13T14:20:21.078016+0000","last_clean":"2023-07-13T14:20:21.078016+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T14:20:21.078016+0000","last_undegraded":"2023-07-13T14:20:21.078016+0000","last_fullsized":"2023-07-13T14:20:21.078016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:33.167123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:01.905109+0000","last_change":"2023-07-13T13:51:59.757569+0000","last_active":"2023-07-13T14:18:01.905109+0000","last_peered":"2023-07-13T14:18:01.905109+0000","last_clean":"2023-07-13T14:18:01.905109+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T14:18:01.905109+0000","last_undegraded":"2023-07-13T14:18:01.905109+0000","last_fullsized":"2023-07-13T14:18:01.905109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:17.316170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'30","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056742+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T14:20:29.056742+0000","last_peered":"2023-07-13T14:20:29.056742+0000","last_clean":"2023-07-13T14:20:29.056742+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T14:20:29.056742+0000","last_undegraded":"2023-07-13T14:20:29.056742+0000","last_fullsized":"2023-07-13T14:20:29.056742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:19.159810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"31'139","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.577318+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T14:19:53.577318+0000","last_peered":"2023-07-13T14:19:53.577318+0000","last_clean":"2023-07-13T14:19:53.577318+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T14:19:53.577318+0000","last_undegraded":"2023-07-13T14:19:53.577318+0000","last_fullsized":"2023-07-13T14:19:53.577318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:36.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":9717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:01.989782+0000","last_change":"2023-07-13T13:52:00.015919+0000","last_active":"2023-07-13T14:18:01.989782+0000","last_peered":"2023-07-13T14:18:01.989782+0000","last_clean":"2023-07-13T14:18:01.989782+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T14:18:01.989782+0000","last_undegraded":"2023-07-13T14:18:01.989782+0000","last_fullsized":"2023-07-13T14:18:01.989782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:04:39.121531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'314","reported_seq":352,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.903663+0000","last_change":"2023-07-13T13:52:16.665545+0000","last_active":"2023-07-13T14:20:26.903663+0000","last_peered":"2023-07-13T14:20:26.903663+0000","last_clean":"2023-07-13T14:20:26.903663+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T14:20:26.903663+0000","last_undegraded":"2023-07-13T14:20:26.903663+0000","last_fullsized":"2023-07-13T14:20:26.903663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:38:57.883779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"31'21","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052825+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T14:20:29.052825+0000","last_peered":"2023-07-13T14:20:29.052825+0000","last_clean":"2023-07-13T14:20:29.052825+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T14:20:29.052825+0000","last_undegraded":"2023-07-13T14:20:29.052825+0000","last_fullsized":"2023-07-13T14:20:29.052825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:18:29.892355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'134","reported_seq":162,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.470366+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T14:19:52.470366+0000","last_peered":"2023-07-13T14:19:52.470366+0000","last_clean":"2023-07-13T14:19:52.470366+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T14:19:52.470366+0000","last_undegraded":"2023-07-13T14:19:52.470366+0000","last_fullsized":"2023-07-13T14:19:52.470366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:09:55.119214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'713","reported_seq":749,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:14.073314+0000","last_change":"2023-07-13T13:52:16.631174+0000","last_active":"2023-07-13T14:20:14.073314+0000","last_peered":"2023-07-13T14:20:14.073314+0000","last_clean":"2023-07-13T14:20:14.073314+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T14:20:14.073314+0000","last_undegraded":"2023-07-13T14:20:14.073314+0000","last_fullsized":"2023-07-13T14:20:14.073314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:20:27.968678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'26","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071759+0000","last_change":"2023-07-13T13:52:17.952450+0000","last_active":"2023-07-13T14:20:29.071759+0000","last_peered":"2023-07-13T14:20:29.071759+0000","last_clean":"2023-07-13T14:20:29.071759+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T14:20:29.071759+0000","last_undegraded":"2023-07-13T14:20:29.071759+0000","last_fullsized":"2023-07-13T14:20:29.071759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:46:37.493180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"31'117","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576845+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T14:19:53.576845+0000","last_peered":"2023-07-13T14:19:53.576845+0000","last_clean":"2023-07-13T14:19:53.576845+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T14:19:53.576845+0000","last_undegraded":"2023-07-13T14:19:53.576845+0000","last_fullsized":"2023-07-13T14:19:53.576845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:52:07.984474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":13476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.735845+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T14:19:57.735845+0000","last_peered":"2023-07-13T14:19:57.735845+0000","last_clean":"2023-07-13T14:19:57.735845+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T14:19:57.735845+0000","last_undegraded":"2023-07-13T14:19:57.735845+0000","last_fullsized":"2023-07-13T14:19:57.735845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'33","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055762+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T14:20:29.055762+0000","last_peered":"2023-07-13T14:20:29.055762+0000","last_clean":"2023-07-13T14:20:29.055762+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T14:20:29.055762+0000","last_undegraded":"2023-07-13T14:20:29.055762+0000","last_fullsized":"2023-07-13T14:20:29.055762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:00.624407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'97","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576096+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T14:19:53.576096+0000","last_peered":"2023-07-13T14:19:53.576096+0000","last_clean":"2023-07-13T14:19:53.576096+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T14:19:53.576096+0000","last_undegraded":"2023-07-13T14:19:53.576096+0000","last_fullsized":"2023-07-13T14:19:53.576096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:12.309060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":9809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"31'1257","reported_seq":1295,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:15.025807+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T14:20:15.025807+0000","last_peered":"2023-07-13T14:20:15.025807+0000","last_clean":"2023-07-13T14:20:15.025807+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T14:20:15.025807+0000","last_undegraded":"2023-07-13T14:20:15.025807+0000","last_fullsized":"2023-07-13T14:20:15.025807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'30","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056304+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T14:20:29.056304+0000","last_peered":"2023-07-13T14:20:29.056304+0000","last_clean":"2023-07-13T14:20:29.056304+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T14:20:29.056304+0000","last_undegraded":"2023-07-13T14:20:29.056304+0000","last_fullsized":"2023-07-13T14:20:29.056304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:21:26.463017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"31'115","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573399+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T14:19:53.573399+0000","last_peered":"2023-07-13T14:19:53.573399+0000","last_clean":"2023-07-13T14:19:53.573399+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T14:19:53.573399+0000","last_undegraded":"2023-07-13T14:19:53.573399+0000","last_fullsized":"2023-07-13T14:19:53.573399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:30:47.139618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'763","reported_seq":804,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:03.781157+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T14:20:03.781157+0000","last_peered":"2023-07-13T14:20:03.781157+0000","last_clean":"2023-07-13T14:20:03.781157+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T14:20:03.781157+0000","last_undegraded":"2023-07-13T14:20:03.781157+0000","last_fullsized":"2023-07-13T14:20:03.781157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:52:00.662042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":4555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'35","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071562+0000","last_change":"2023-07-13T13:52:17.925281+0000","last_active":"2023-07-13T14:20:29.071562+0000","last_peered":"2023-07-13T14:20:29.071562+0000","last_clean":"2023-07-13T14:20:29.071562+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T14:20:29.071562+0000","last_undegraded":"2023-07-13T14:20:29.071562+0000","last_fullsized":"2023-07-13T14:20:29.071562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:03.617258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'135","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:45.194613+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T14:19:45.194613+0000","last_peered":"2023-07-13T14:19:45.194613+0000","last_clean":"2023-07-13T14:19:45.194613+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T14:19:45.194613+0000","last_undegraded":"2023-07-13T14:19:45.194613+0000","last_fullsized":"2023-07-13T14:19:45.194613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:32:12.577338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":6623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"31'733","reported_seq":771,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:18.081584+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T14:20:18.081584+0000","last_peered":"2023-07-13T14:20:18.081584+0000","last_clean":"2023-07-13T14:20:18.081584+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T14:20:18.081584+0000","last_undegraded":"2023-07-13T14:20:18.081584+0000","last_fullsized":"2023-07-13T14:20:18.081584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:24:48.797923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'37","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.044987+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T14:20:29.044987+0000","last_peered":"2023-07-13T14:20:29.044987+0000","last_clean":"2023-07-13T14:20:29.044987+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T14:20:29.044987+0000","last_undegraded":"2023-07-13T14:20:29.044987+0000","last_fullsized":"2023-07-13T14:20:29.044987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:11.485106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"31'43","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.109653+0000","last_change":"2023-07-13T13:52:17.933894+0000","last_active":"2023-07-13T14:20:29.109653+0000","last_peered":"2023-07-13T14:20:29.109653+0000","last_clean":"2023-07-13T14:20:29.109653+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T14:20:29.109653+0000","last_undegraded":"2023-07-13T14:20:29.109653+0000","last_fullsized":"2023-07-13T14:20:29.109653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:44:32.655763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.061494+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T14:20:29.061494+0000","last_peered":"2023-07-13T14:20:29.061494+0000","last_clean":"2023-07-13T14:20:29.061494+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T14:20:29.061494+0000","last_undegraded":"2023-07-13T14:20:29.061494+0000","last_fullsized":"2023-07-13T14:20:29.061494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:20:42.938534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"31'42","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.033130+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T14:20:29.033130+0000","last_peered":"2023-07-13T14:20:29.033130+0000","last_clean":"2023-07-13T14:20:29.033130+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T14:20:29.033130+0000","last_undegraded":"2023-07-13T14:20:29.033130+0000","last_fullsized":"2023-07-13T14:20:29.033130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:36:22.078595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"31'28","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.054230+0000","last_change":"2023-07-13T13:52:17.838377+0000","last_active":"2023-07-13T14:20:29.054230+0000","last_peered":"2023-07-13T14:20:29.054230+0000","last_clean":"2023-07-13T14:20:29.054230+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T14:20:29.054230+0000","last_undegraded":"2023-07-13T14:20:29.054230+0000","last_fullsized":"2023-07-13T14:20:29.054230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'22","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227758+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T14:20:29.227758+0000","last_peered":"2023-07-13T14:20:29.227758+0000","last_clean":"2023-07-13T14:20:29.227758+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T14:20:29.227758+0000","last_undegraded":"2023-07-13T14:20:29.227758+0000","last_fullsized":"2023-07-13T14:20:29.227758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:53:33.131082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3402,"num_write_kb":282366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3765,"ondisk_log_size":3765,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":35165063,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":7922,"num_write_kb":39030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49258496,"data_stored":70330126,"data_compressed":6207514,"data_compressed_allocated":9723904,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":0},"log_size":7484,"ondisk_log_size":7484,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509785,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34704,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337136,"statfs":{"total":96636764160,"available":96601227264,"internally_reserved":0,"allocated":3678208,"data_stored":4927655,"data_compressed":341063,"data_compressed_allocated":569344,"data_compressed_original":2035712,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.625,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.56100000000000005,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.315,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.442},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.28399999999999997,"15min":0.28199999999999997},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":3.2789999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67400000000000004,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.435},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.59499999999999997,"5min":1.0700000000000001,"15min":1.4630000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.35799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61099999999999999,"5min":0.93300000000000005,"15min":1.4650000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67900000000000005,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.626,"5min":0.67600000000000005,"15min":0.83399999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.65500000000000003,"15min":0.83299999999999996},"last":0.33200000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.50800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66700000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.79700000000000004},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.86699999999999999},"last":0.5},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.53500000000000003},"min":{"1min":0.34100000000000003,"5min":0.33100000000000002,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.81399999999999995},"last":0.371}]}]},{"osd":6,"up_from":15,"seq":64424509785,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30324,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341516,"statfs":{"total":96636764160,"available":96605712384,"internally_reserved":0,"allocated":3387392,"data_stored":4336399,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.217},"max":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":1.2549999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.67100000000000004,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.56699999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.48599999999999999,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.23400000000000001},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.92500000000000004,"15min":2.1789999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45900000000000002,"15min":0.47799999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":3.4060000000000001},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.28599999999999998},"max":{"1min":2.9500000000000002,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.25900000000000001},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":5.3810000000000002},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.23799999999999999},"max":{"1min":0.59299999999999997,"5min":0.72099999999999997,"15min":0.749},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.80100000000000005},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47599999999999998,"15min":0.46200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63400000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.89500000000000002},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":0.745,"15min":0.75800000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63700000000000001,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.45500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575193,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39120,"kb_used_data":3912,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94332720,"statfs":{"total":96636764160,"available":96596705280,"internally_reserved":0,"allocated":4005888,"data_stored":5770865,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":3.7240000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.33800000000000002,"15min":0.34100000000000003},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":0.442,"5min":0.71099999999999997,"15min":0.76200000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.313,"15min":0.33300000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":1.49},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20300000000000001},"max":{"1min":0.57899999999999996,"5min":0.79700000000000004,"15min":0.996},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.60099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.51100000000000001,"5min":1.548,"15min":1.548},"last":0.375}]},{"osd":4,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.30099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.76200000000000001,"5min":0.80100000000000005,"15min":1.266},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.36899999999999999,"15min":0.309},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":1.2869999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.89300000000000002,"15min":0.92800000000000005},"last":0.439}]},{"osd":6,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.34799999999999998,"15min":0.33700000000000002},"max":{"1min":0.75,"5min":1.625,"15min":1.625},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.38,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":1.242},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.95299999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":1.657,"15min":1.657},"last":0.47999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542489,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66744,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94305096,"statfs":{"total":96636764160,"available":96568418304,"internally_reserved":0,"allocated":9617408,"data_stored":13490652,"data_compressed":1179065,"data_compressed_allocated":1941504,"data_compressed_original":6012928,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30399999999999999,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.185},"max":{"1min":0.40999999999999998,"5min":0.53600000000000003,"15min":0.64800000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.19},"max":{"1min":0.48799999999999999,"5min":0.64400000000000002,"15min":1.6879999999999999},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23000000000000001},"max":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.77200000000000002},"last":0.37},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":3.4940000000000002,"15min":3.4940000000000002},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22},"max":{"1min":0.69599999999999995,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":0.56699999999999995,"5min":1.2230000000000001,"15min":2.5379999999999998},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.85099999999999998,"15min":0.91400000000000003},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.753}]},{"osd":5,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.26100000000000001},"max":{"1min":0.74099999999999999,"5min":0.80700000000000005,"15min":0.94299999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.748,"5min":0.76900000000000002,"15min":1.0529999999999999},"last":0.629}]},{"osd":6,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.33900000000000002},"max":{"1min":0.753,"5min":0.83699999999999997,"15min":0.96599999999999997},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":0.83699999999999997,"15min":0.98299999999999998},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.81499999999999995,"15min":0.997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.86599999999999999,"15min":1.03},"last":0.71899999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509785,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1228800,"data_stored":1576561,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.308},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.46000000000000002,"5min":0.65200000000000002,"15min":0.751},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.34000000000000002,"15min":0.35899999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.42699999999999999,"5min":0.57099999999999995,"15min":3.0939999999999999},"last":0.379}]},{"osd":1,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.24299999999999999,"15min":0.19},"max":{"1min":0.56799999999999995,"5min":0.749,"15min":1.248},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.372,"15min":0.38500000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53300000000000003,"5min":1.081,"15min":2.9529999999999998},"last":0.313}]},{"osd":3,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.21299999999999999},"max":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":2.2490000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.51800000000000002,"5min":1.167,"15min":1.167},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":0.68500000000000005,"5min":0.79300000000000004,"15min":0.82999999999999996},"last":0.435},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.31900000000000001,"15min":0.26700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":2.3220000000000001},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.86899999999999999,"15min":2.3660000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.681},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.73699999999999999,"15min":1.6970000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78200000000000003,"5min":0.94699999999999995,"15min":0.98999999999999999},"last":0.40400000000000003}]},{"osd":7,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.79300000000000004,"5min":0.83899999999999997,"15min":2.4020000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.32600000000000001},"max":{"1min":0.69299999999999995,"5min":0.73799999999999999,"15min":1.6619999999999999},"last":0.44500000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509785,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":6184960,"data_stored":8530793,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.31900000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.17899999999999999},"max":{"1min":0.37,"5min":0.65500000000000003,"15min":0.78300000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.313,"5min":0.316,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.19600000000000001,"15min":0.193},"max":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":2.972},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.374,"15min":0.35499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19900000000000001},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.377},"min":{"1min":0.221,"5min":0.221,"15min":0.218},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":2.173},"last":0.442}]},{"osd":2,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38100000000000001,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23200000000000001},"max":{"1min":0.48299999999999998,"5min":1.6759999999999999,"15min":2.335},"last":0.373},{"interface":"front","average":{"1min":0.379,"5min":0.41099999999999998,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.22800000000000001,"15min":0.214},"max":{"1min":0.501,"5min":0.71399999999999997,"15min":2.2000000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.26000000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.33200000000000002},"max":{"1min":0.82899999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.34300000000000003},"max":{"1min":0.68000000000000005,"5min":0.84299999999999997,"15min":0.84999999999999998},"last":0.626}]},{"osd":7,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.82299999999999995},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.747,"5min":0.91100000000000003,"15min":0.97599999999999998},"last":0.58699999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509785,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77928,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94293912,"statfs":{"total":96636764160,"available":96556965888,"internally_reserved":0,"allocated":15171584,"data_stored":21289038,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":1781,"internal_metadata":64616715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.23400000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.72399999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.441,"15min":0.432},"min":{"1min":0.35199999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68500000000000005},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.436,"15min":0.44},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.25},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.72599999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.33700000000000002,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.73499999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.72899999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":2.266,"15min":2.266},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64100000000000001,"5min":1.2849999999999999,"15min":1.5620000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":1.4259999999999999,"15min":2.6960000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.66200000000000003,"5min":0.73299999999999998,"15min":0.74199999999999999},"last":0.309},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.58799999999999997,"5min":0.65900000000000003,"15min":0.754},"last":0.38}]},{"osd":6,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.46899999999999997,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.25600000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80900000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.78900000000000003},"last":0.434}]},{"osd":7,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.41999999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.79000000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.48399999999999999,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.82799999999999996},"last":0.5}]}]},{"osd":5,"up_from":15,"seq":64424509785,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61820,"kb_used_data":8564,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94310020,"statfs":{"total":96636764160,"available":96573460480,"internally_reserved":0,"allocated":8769536,"data_stored":12725659,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.248,"15min":0.23899999999999999},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":0.72399999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.35399999999999998,"5min":0.29099999999999998,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.77700000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.57099999999999995,"5min":1.2729999999999999,"15min":1.7430000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.312,"5min":0.30299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58299999999999996,"5min":0.66800000000000004,"15min":1.284},"last":0.438}]},{"osd":3,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.056},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":0.63300000000000001,"5min":1.3879999999999999,"15min":1.78},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.438,"15min":0.439},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.77400000000000002},"last":0.40200000000000002}]},{"osd":7,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73499999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.496},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68300000000000005,"5min":1.351,"15min":1.351},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":12758189,"data_compressed":1146678,"data_compressed_allocated":1896448,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3674112,"data_stored":5628770,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897024,"data_stored":1434466,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5853184,"data_stored":8388698,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":21146943,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":12583564,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3055616,"data_stored":4194304,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":4195192,"data_compressed":308676,"data_compressed_allocated":524288,"data_compressed_original":1462272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T14:20:37.106 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T14:20:37.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.266+0000 7f50b75dd700 1 Processor -- start 2023-07-13T14:20:37.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.266+0000 7f50b75dd700 1 -- start start 2023-07-13T14:20:37.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.267+0000 7f50b75dd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50b00c6f30 0x7f50b00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:37.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.267+0000 7f50b75dd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50b006e040 0x7f50b00c7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:37.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.267+0000 7f50b75dd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b00c9790 con 0x7f50b00c9c20 2023-07-13T14:20:37.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.267+0000 7f50b75dd700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b00c8f50 con 0x7f50b00c6f30 2023-07-13T14:20:37.260 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.267+0000 7f50b75dd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b00c7840 con 0x7f50b006e040 2023-07-13T14:20:37.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.268+0000 7f50b5379700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50b00c6f30 0x7f50b00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:37.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.268+0000 7f50b5b7a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50b006e040 0x7f50b00c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:37.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.268+0000 7f50b5379700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f50b00c6f30 0x7f50b00cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43956/0 (socket says 172.21.15.118:43956) 2023-07-13T14:20:37.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.268+0000 7f50b5379700 1 -- 172.21.15.118:0/3669558040 learned_addr learned my addr 172.21.15.118:0/3669558040 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:37.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.271+0000 7f50b5b7a700 1 -- 172.21.15.118:0/3669558040 >> v2:172.21.15.118:3300/0 conn(0x7f50b00c6f30 msgr2=0x7f50b00cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:37.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.271+0000 7f50b5b7a700 1 --2- 172.21.15.118:0/3669558040 >> v2:172.21.15.118:3300/0 conn(0x7f50b00c6f30 0x7f50b00cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.271+0000 7f50b5b7a700 1 -- 172.21.15.118:0/3669558040 >> v1:172.21.15.118:6789/0 conn(0x7f50b00c9c20 legacy=0x7f50b01583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:37.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.271+0000 7f50b5b7a700 1 -- 172.21.15.118:0/3669558040 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b006ec80 con 0x7f50b006e040 2023-07-13T14:20:37.265 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.273+0000 7f50b5b7a700 1 --2- 172.21.15.118:0/3669558040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b006e040 0x7f50b00c7300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50b0159510 tx=0x7f50a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcc04ebd37e52e34 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:37.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.276+0000 7f50a7fff700 1 -- 172.21.15.118:0/3669558040 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800e070 con 0x7f50b006e040 2023-07-13T14:20:37.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.277+0000 7f50a7fff700 1 -- 172.21.15.118:0/3669558040 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800bb20 con 0x7f50b006e040 2023-07-13T14:20:37.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.277+0000 7f50a7fff700 1 -- 172.21.15.118:0/3669558040 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8012430 con 0x7f50b006e040 2023-07-13T14:20:37.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.278+0000 7f50b75dd700 1 -- 172.21.15.118:0/3669558040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b006e040 msgr2=0x7f50b00c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:37.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.278+0000 7f50b75dd700 1 --2- 172.21.15.118:0/3669558040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b006e040 0x7f50b00c7300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50b0159510 tx=0x7f50a800b330 comp rx=0 tx=0).stop 2023-07-13T14:20:37.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.278+0000 7f50b75dd700 1 -- 172.21.15.118:0/3669558040 shutdown_connections 2023-07-13T14:20:37.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.278+0000 7f50b75dd700 1 --2- 172.21.15.118:0/3669558040 >> v2:172.21.15.118:3300/0 conn(0x7f50b00c6f30 0x7f50b00cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.278+0000 7f50b75dd700 1 --2- 172.21.15.118:0/3669558040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b006e040 0x7f50b00c7300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.278+0000 7f50b75dd700 1 -- 172.21.15.118:0/3669558040 >> 172.21.15.118:0/3669558040 conn(0x7f50b0069f30 msgr2=0x7f50b006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:37.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.278+0000 7f50b75dd700 1 -- 172.21.15.118:0/3669558040 shutdown_connections 2023-07-13T14:20:37.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.278+0000 7f50b75dd700 1 -- 172.21.15.118:0/3669558040 wait complete. 2023-07-13T14:20:37.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.279+0000 7f50b75dd700 1 Processor -- start 2023-07-13T14:20:37.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.279+0000 7f50b75dd700 1 -- start start 2023-07-13T14:20:37.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b75dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b006e040 0x7f50b0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:37.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b75dd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b00c6f30 0x7f50b01f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:37.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b75dd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50b00c9c20 0x7f50b00c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:37.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b75dd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0159540 con 0x7f50b006e040 2023-07-13T14:20:37.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b75dd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b014f230 con 0x7f50b00c6f30 2023-07-13T14:20:37.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b75dd700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b01f21c0 con 0x7f50b00c9c20 2023-07-13T14:20:37.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b5b7a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50b00c9c20 0x7f50b00c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:37.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b4b78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b00c6f30 0x7f50b01f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:37.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.280+0000 7f50b5379700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b006e040 0x7f50b0150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:37.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.281+0000 7f50b4b78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b00c6f30 0x7f50b01f12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:57102/0 (socket says 172.21.15.118:57102) 2023-07-13T14:20:37.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.281+0000 7f50b4b78700 1 -- 172.21.15.118:0/1704017095 learned_addr learned my addr 172.21.15.118:0/1704017095 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:37.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.284+0000 7f50b4b78700 1 -- 172.21.15.118:0/1704017095 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50b00c9c20 msgr2=0x7f50b00c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:37.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.284+0000 7f50b4b78700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50b00c9c20 0x7f50b00c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.284+0000 7f50b4b78700 1 -- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b006e040 msgr2=0x7f50b0150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:37.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.284+0000 7f50b4b78700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b006e040 0x7f50b0150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.284+0000 7f50b4b78700 1 -- 172.21.15.118:0/1704017095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8009a70 con 0x7f50b00c6f30 2023-07-13T14:20:37.279 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.287+0000 7f50b4b78700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b00c6f30 0x7f50b01f12e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00c390 tx=0x7f50ac00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:37.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.291+0000 7f50a5ffb700 1 -- 172.21.15.118:0/1704017095 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0052d0 con 0x7f50b00c6f30 2023-07-13T14:20:37.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.291+0000 7f50a5ffb700 1 -- 172.21.15.118:0/1704017095 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac005430 con 0x7f50b00c6f30 2023-07-13T14:20:37.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.291+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b015baa0 con 0x7f50b00c6f30 2023-07-13T14:20:37.283 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.291+0000 7f50a5ffb700 1 -- 172.21.15.118:0/1704017095 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac006a80 con 0x7f50b00c6f30 2023-07-13T14:20:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.291+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b01f1c00 con 0x7f50b00c6f30 2023-07-13T14:20:37.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.292+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b00743c0 con 0x7f50b00c6f30 2023-07-13T14:20:37.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.540+0000 7f50a5ffb700 1 -- 172.21.15.118:0/1704017095 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f50ac003680 con 0x7f50b00c6f30 2023-07-13T14:20:37.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.540+0000 7f50a5ffb700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f509406ace0 0x7f509406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:37.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.540+0000 7f50b5379700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f509406ace0 0x7f509406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:37.533 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.541+0000 7f50b5379700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f509406ace0 0x7f509406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009bd0 tx=0x7f50a00092c0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:37.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.545+0000 7f50a5ffb700 1 -- 172.21.15.118:0/1704017095 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f50ac05b790 con 0x7f50b00c6f30 2023-07-13T14:20:37.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.555+0000 7f50a5ffb700 1 -- 172.21.15.118:0/1704017095 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f50ac053b10 con 0x7f50b00c6f30 2023-07-13T14:20:37.737 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.745+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50b006de20 con 0x7f50b00c6f30 2023-07-13T14:20:37.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.792+0000 7f50a5ffb700 1 -- 172.21.15.118:0/1704017095 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f50ac020090 con 0x7f50b00c6f30 2023-07-13T14:20:37.785 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:20:37.786 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:57.795549+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.35","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T14:20:37.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f509406ace0 msgr2=0x7f509406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:37.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f509406ace0 0x7f509406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009bd0 tx=0x7f50a00092c0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b00c6f30 msgr2=0x7f50b01f12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:37.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b00c6f30 0x7f50b01f12e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00c390 tx=0x7f50ac00c6a0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 shutdown_connections 2023-07-13T14:20:37.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f509406ace0 0x7f509406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f50b00c9c20 0x7f50b00c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f50b006e040 0x7f50b0150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 --2- 172.21.15.118:0/1704017095 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b00c6f30 0x7f50b01f12e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:37.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 >> 172.21.15.118:0/1704017095 conn(0x7f50b0069f30 msgr2=0x7f50b0157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:37.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 shutdown_connections 2023-07-13T14:20:37.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:37.795+0000 7f50b75dd700 1 -- 172.21.15.118:0/1704017095 wait complete. 2023-07-13T14:20:38.801 INFO:tasks.ceph:Scrubbing osd.0 2023-07-13T14:20:38.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-13T14:20:38.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.939+0000 7f8866e08700 1 Processor -- start 2023-07-13T14:20:38.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.939+0000 7f8866e08700 1 -- start start 2023-07-13T14:20:38.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.940+0000 7f8866e08700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88600c7d40 0x7f88600c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:38.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.940+0000 7f8866e08700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88600c2970 0x7f88600c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:38.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.940+0000 7f8866e08700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8860156e40 con 0x7f88601502c0 2023-07-13T14:20:38.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.940+0000 7f8866e08700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886006b950 con 0x7f88600c2970 2023-07-13T14:20:38.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.940+0000 7f8866e08700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8860156250 con 0x7f88600c7d40 2023-07-13T14:20:38.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.941+0000 7f885ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88600c7d40 0x7f88600c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:38.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.941+0000 7f88653a5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f88600c2970 0x7f88600c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:38.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.941+0000 7f885ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88600c7d40 0x7f88600c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:57118/0 (socket says 172.21.15.118:57118) 2023-07-13T14:20:38.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.941+0000 7f885ffff700 1 -- 172.21.15.118:0/2473468969 learned_addr learned my addr 172.21.15.118:0/2473468969 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.944+0000 7f885ffff700 1 -- 172.21.15.118:0/2473468969 >> v2:172.21.15.118:3300/0 conn(0x7f88600c2970 msgr2=0x7f88600c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.944+0000 7f885ffff700 1 --2- 172.21.15.118:0/2473468969 >> v2:172.21.15.118:3300/0 conn(0x7f88600c2970 0x7f88600c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.944+0000 7f885ffff700 1 -- 172.21.15.118:0/2473468969 >> v1:172.21.15.118:6789/0 conn(0x7f88601502c0 legacy=0x7f88600c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:38.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.944+0000 7f885ffff700 1 -- 172.21.15.118:0/2473468969 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886006c8f0 con 0x7f88600c7d40 2023-07-13T14:20:38.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.946+0000 7f885ffff700 1 --2- 172.21.15.118:0/2473468969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88600c7d40 0x7f88600c42b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88600700f0 tx=0x7f884c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2b93be993372639 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:38.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.950+0000 7f885f7fe700 1 -- 172.21.15.118:0/2473468969 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c011830 con 0x7f88600c7d40 2023-07-13T14:20:38.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.950+0000 7f885f7fe700 1 -- 172.21.15.118:0/2473468969 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c011990 con 0x7f88600c7d40 2023-07-13T14:20:38.943 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.950+0000 7f885f7fe700 1 -- 172.21.15.118:0/2473468969 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c011d20 con 0x7f88600c7d40 2023-07-13T14:20:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.951+0000 7f8866e08700 1 -- 172.21.15.118:0/2473468969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88600c7d40 msgr2=0x7f88600c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.951+0000 7f8866e08700 1 --2- 172.21.15.118:0/2473468969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88600c7d40 0x7f88600c42b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88600700f0 tx=0x7f884c009bd0 comp rx=0 tx=0).stop 2023-07-13T14:20:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.951+0000 7f8866e08700 1 -- 172.21.15.118:0/2473468969 shutdown_connections 2023-07-13T14:20:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.951+0000 7f8866e08700 1 --2- 172.21.15.118:0/2473468969 >> v2:172.21.15.118:3300/0 conn(0x7f88600c2970 0x7f88600c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.951+0000 7f8866e08700 1 --2- 172.21.15.118:0/2473468969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88600c7d40 0x7f88600c42b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:38.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.951+0000 7f8866e08700 1 -- 172.21.15.118:0/2473468969 >> 172.21.15.118:0/2473468969 conn(0x7f88600cb800 msgr2=0x7f88600c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:38.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.951+0000 7f8866e08700 1 -- 172.21.15.118:0/2473468969 shutdown_connections 2023-07-13T14:20:38.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.951+0000 7f8866e08700 1 -- 172.21.15.118:0/2473468969 wait complete. 2023-07-13T14:20:38.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.953+0000 7f8866e08700 1 Processor -- start 2023-07-13T14:20:38.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.953+0000 7f8866e08700 1 -- start start 2023-07-13T14:20:38.946 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f8866e08700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88600c2970 0x7f88601ef320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:38.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f8866e08700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88600c7d40 0x7f886014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:38.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f8866e08700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88601502c0 0x7f8860152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:38.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f8866e08700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886014d5a0 con 0x7f88601502c0 2023-07-13T14:20:38.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f8866e08700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88601e1710 con 0x7f88600c7d40 2023-07-13T14:20:38.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f8866e08700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88601e19f0 con 0x7f88600c2970 2023-07-13T14:20:38.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f88653a5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88601502c0 0x7f8860152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f885ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88600c7d40 0x7f886014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.954+0000 7f8864ba4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88600c2970 0x7f88601ef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.955+0000 7f88653a5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88601502c0 0x7f8860152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:43982/0 (socket says 172.21.15.118:43982) 2023-07-13T14:20:38.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.955+0000 7f88653a5700 1 -- 172.21.15.118:0/3660618738 learned_addr learned my addr 172.21.15.118:0/3660618738 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.958+0000 7f88653a5700 1 -- 172.21.15.118:0/3660618738 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88600c2970 msgr2=0x7f88601ef320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.958+0000 7f88653a5700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f88600c2970 0x7f88601ef320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.958+0000 7f88653a5700 1 -- 172.21.15.118:0/3660618738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88600c7d40 msgr2=0x7f886014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.958+0000 7f88653a5700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88600c7d40 0x7f886014dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:38.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.959+0000 7f88653a5700 1 -- 172.21.15.118:0/3660618738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c009550 con 0x7f88601502c0 2023-07-13T14:20:38.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.961+0000 7f88653a5700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88601502c0 0x7f8860152ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f885800efc0 tx=0x7f885800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:38.957 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.965+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858009ea0 con 0x7f88601502c0 2023-07-13T14:20:38.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.965+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800f040 con 0x7f88601502c0 2023-07-13T14:20:38.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.965+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800ced0 con 0x7f88601502c0 2023-07-13T14:20:38.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.965+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88601e1cd0 con 0x7f88601502c0 2023-07-13T14:20:38.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.965+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886014dad0 con 0x7f88601502c0 2023-07-13T14:20:38.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.966+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8860156510 con 0x7f88601502c0 2023-07-13T14:20:38.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.992+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8858014480 con 0x7f88601502c0 2023-07-13T14:20:38.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f885d7fa700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f884406ad30 0x7f884406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:38.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f885808a810 con 0x7f88601502c0 2023-07-13T14:20:38.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f8864ba4700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f884406ad30 0x7f884406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:38.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f885d7fa700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7f8844074950 0x7f8844076dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:38.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 --> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8844077490 con 0x7f8844074950 2023-07-13T14:20:38.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f885808ab80 con 0x7f88601502c0 2023-07-13T14:20:38.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f885ffff700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7f8844074950 0x7f8844076dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:38.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f8864ba4700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f884406ad30 0x7f884406d1e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8854001800 tx=0x7f8854009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:38.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.993+0000 7f885ffff700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7f8844074950 0x7f8844076dc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:38.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:38.994+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 <== osd.0 v2:172.21.15.118:6816/724794801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8844077490 con 0x7f8844074950 2023-07-13T14:20:39.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.008+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 --> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f88600c8280 con 0x7f8844074950 2023-07-13T14:20:39.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.008+0000 7f885d7fa700 1 -- 172.21.15.118:0/3660618738 <== osd.0 v2:172.21.15.118:6816/724794801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f884c011b00 con 0x7f8844074950 2023-07-13T14:20:39.001 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T14:20:39.001 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-13T14:20:39.001 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T14:20:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7f8844074950 msgr2=0x7f8844076dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6816/724794801,v1:172.21.15.118:6819/724794801] conn(0x7f8844074950 0x7f8844076dc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f884406ad30 msgr2=0x7f884406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f884406ad30 0x7f884406d1e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8854001800 tx=0x7f8854009040 comp rx=0 tx=0).stop 2023-07-13T14:20:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88601502c0 msgr2=0x7f8860152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 --2- 172.21.15.118:0/3660618738 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88601502c0 0x7f8860152ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f885800efc0 tx=0x7f885800c3a0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f88653a5700 1 -- 172.21.15.118:0/3660618738 reap_dead start 2023-07-13T14:20:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 shutdown_connections 2023-07-13T14:20:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 >> 172.21.15.118:0/3660618738 conn(0x7f88600cb800 msgr2=0x7f88600c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:39.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 shutdown_connections 2023-07-13T14:20:39.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.009+0000 7f8866e08700 1 -- 172.21.15.118:0/3660618738 wait complete. 2023-07-13T14:20:39.013 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-13T14:20:39.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.142+0000 7fa8907e4700 1 Processor -- start 2023-07-13T14:20:39.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.142+0000 7fa8907e4700 1 -- start start 2023-07-13T14:20:39.135 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.143+0000 7fa8907e4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa88814f750 0x7fa888155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.143+0000 7fa8907e4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880c4720 con 0x7fa88806e4c0 2023-07-13T14:20:39.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.143+0000 7fa8907e4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880c2900 con 0x7fa888155960 2023-07-13T14:20:39.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.143+0000 7fa8907e4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa888155e60 con 0x7fa88814f750 2023-07-13T14:20:39.136 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.144+0000 7fa88e580700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa88814f750 0x7fa888155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.144+0000 7fa88dd7f700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa888155960 0x7fa88806b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43842/0 (socket says 172.21.15.118:43842) 2023-07-13T14:20:39.137 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.144+0000 7fa88dd7f700 1 -- 172.21.15.118:0/3114407644 learned_addr learned my addr 172.21.15.118:0/3114407644 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:39.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.147+0000 7fa88d57e700 1 -- 172.21.15.118:0/3114407644 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28320019 0 0) 0x7fa8880c2900 con 0x7fa888155960 2023-07-13T14:20:39.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.147+0000 7fa88d57e700 1 -- 172.21.15.118:0/3114407644 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8740057c0 con 0x7fa888155960 2023-07-13T14:20:39.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.149+0000 7fa88e580700 1 -- 172.21.15.118:0/3114407644 >> v1:172.21.15.123:6789/0 conn(0x7fa888155960 legacy=0x7fa88806b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.149+0000 7fa88e580700 1 -- 172.21.15.118:0/3114407644 >> v1:172.21.15.118:6789/0 conn(0x7fa88806e4c0 legacy=0x7fa8880c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.149+0000 7fa88e580700 1 -- 172.21.15.118:0/3114407644 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888156140 con 0x7fa88814f750 2023-07-13T14:20:39.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.152+0000 7fa88e580700 1 --2- 172.21.15.118:0/3114407644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88814f750 0x7fa888155420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa878009840 tx=0x7fa878009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272f673b9587f531 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:39.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.158+0000 7fa88d57e700 1 -- 172.21.15.118:0/3114407644 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878011830 con 0x7fa88814f750 2023-07-13T14:20:39.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.158+0000 7fa88d57e700 1 -- 172.21.15.118:0/3114407644 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878011990 con 0x7fa88814f750 2023-07-13T14:20:39.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.158+0000 7fa88d57e700 1 -- 172.21.15.118:0/3114407644 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878011d20 con 0x7fa88814f750 2023-07-13T14:20:39.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.159+0000 7fa8907e4700 1 -- 172.21.15.118:0/3114407644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88814f750 msgr2=0x7fa888155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.159+0000 7fa8907e4700 1 --2- 172.21.15.118:0/3114407644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88814f750 0x7fa888155420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa878009840 tx=0x7fa878009b50 comp rx=0 tx=0).stop 2023-07-13T14:20:39.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.159+0000 7fa8907e4700 1 -- 172.21.15.118:0/3114407644 shutdown_connections 2023-07-13T14:20:39.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.159+0000 7fa8907e4700 1 --2- 172.21.15.118:0/3114407644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88814f750 0x7fa888155420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.159+0000 7fa8907e4700 1 -- 172.21.15.118:0/3114407644 >> 172.21.15.118:0/3114407644 conn(0x7fa888070d40 msgr2=0x7fa888071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:39.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.159+0000 7fa8907e4700 1 -- 172.21.15.118:0/3114407644 shutdown_connections 2023-07-13T14:20:39.152 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.159+0000 7fa8907e4700 1 -- 172.21.15.118:0/3114407644 wait complete. 2023-07-13T14:20:39.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.160+0000 7fa8907e4700 1 Processor -- start 2023-07-13T14:20:39.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.161+0000 7fa8907e4700 1 -- start start 2023-07-13T14:20:39.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.161+0000 7fa8907e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88806e4c0 0x7fa8881f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.161+0000 7fa8907e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88814f750 0x7fa8880c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.161+0000 7fa8907e4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa888155960 0x7fa88814cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.161+0000 7fa8907e4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881f2030 con 0x7fa88806e4c0 2023-07-13T14:20:39.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.161+0000 7fa8907e4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88814bed0 con 0x7fa88814f750 2023-07-13T14:20:39.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.161+0000 7fa8907e4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880c1de0 con 0x7fa888155960 2023-07-13T14:20:39.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.162+0000 7fa88e580700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88806e4c0 0x7fa8881f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.162+0000 7fa88dd7f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88814f750 0x7fa8880c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.162+0000 7fa88ed81700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa888155960 0x7fa88814cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.162+0000 7fa88e580700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88806e4c0 0x7fa8881f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44004/0 (socket says 172.21.15.118:44004) 2023-07-13T14:20:39.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.162+0000 7fa88e580700 1 -- 172.21.15.118:0/1530768944 learned_addr learned my addr 172.21.15.118:0/1530768944 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:39.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.166+0000 7fa88dd7f700 1 -- 172.21.15.118:0/1530768944 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa888155960 msgr2=0x7fa88814cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.166+0000 7fa88dd7f700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa888155960 0x7fa88814cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.166+0000 7fa88dd7f700 1 -- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88806e4c0 msgr2=0x7fa8881f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.166+0000 7fa88dd7f700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88806e4c0 0x7fa8881f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.166+0000 7fa88dd7f700 1 -- 172.21.15.118:0/1530768944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094a0 con 0x7fa88814f750 2023-07-13T14:20:39.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.166+0000 7fa88e580700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88806e4c0 0x7fa8881f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T14:20:39.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.166+0000 7fa88ed81700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa888155960 0x7fa88814cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T14:20:39.161 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.169+0000 7fa88dd7f700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88814f750 0x7fa8880c18a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa88400c400 tx=0x7fa88400c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:39.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.173+0000 7fa87effd700 1 -- 172.21.15.118:0/1530768944 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884005d70 con 0x7fa88814f750 2023-07-13T14:20:39.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.173+0000 7fa87effd700 1 -- 172.21.15.118:0/1530768944 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88400ce90 con 0x7fa88814f750 2023-07-13T14:20:39.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.173+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88814fea0 con 0x7fa88814f750 2023-07-13T14:20:39.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.173+0000 7fa87effd700 1 -- 172.21.15.118:0/1530768944 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840072f0 con 0x7fa88814f750 2023-07-13T14:20:39.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.173+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88814bb60 con 0x7fa88814f750 2023-07-13T14:20:39.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.174+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8881503c0 con 0x7fa88814f750 2023-07-13T14:20:39.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.299+0000 7fa87effd700 1 -- 172.21.15.118:0/1530768944 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa884007450 con 0x7fa88814f750 2023-07-13T14:20:39.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.299+0000 7fa87effd700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa86c06ad10 0x7fa86c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.299+0000 7fa88e580700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa86c06ad10 0x7fa86c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.299+0000 7fa88e580700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa86c06ad10 0x7fa86c06d1c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa878000c00 tx=0x7fa878008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:39.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.332+0000 7fa87effd700 1 -- 172.21.15.118:0/1530768944 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa884001110 con 0x7fa88814f750 2023-07-13T14:20:39.432 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.439+0000 7fa87effd700 1 -- 172.21.15.118:0/1530768944 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa8840536e0 con 0x7fa88814f750 2023-07-13T14:20:39.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.640+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8880c1730 con 0x7fa86c06ad10 2023-07-13T14:20:39.633 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.640+0000 7fa87effd700 1 -- 172.21.15.118:0/1530768944 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa8880c1730 con 0x7fa86c06ad10 2023-07-13T14:20:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa86c06ad10 msgr2=0x7fa86c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa86c06ad10 0x7fa86c06d1c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa878000c00 tx=0x7fa878008030 comp rx=0 tx=0).stop 2023-07-13T14:20:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88814f750 msgr2=0x7fa8880c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88814f750 0x7fa8880c18a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa88400c400 tx=0x7fa88400c710 comp rx=0 tx=0).stop 2023-07-13T14:20:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 shutdown_connections 2023-07-13T14:20:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa86c06ad10 0x7fa86c06d1c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa888155960 0x7fa88814cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa88806e4c0 0x7fa8881f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 --2- 172.21.15.118:0/1530768944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88814f750 0x7fa8880c18a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 >> 172.21.15.118:0/1530768944 conn(0x7fa888070d40 msgr2=0x7fa88814e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:39.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 shutdown_connections 2023-07-13T14:20:39.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.643+0000 7fa8907e4700 1 -- 172.21.15.118:0/1530768944 wait complete. 2023-07-13T14:20:39.637 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 0 to deep-scrub 2023-07-13T14:20:39.647 INFO:tasks.ceph:Scrubbing osd.1 2023-07-13T14:20:39.648 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-13T14:20:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.782+0000 7ff6bbd81700 1 Processor -- start 2023-07-13T14:20:39.774 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.782+0000 7ff6bbd81700 1 -- start start 2023-07-13T14:20:39.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.783+0000 7ff6bbd81700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4070dd0 0x7ff6b4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.783+0000 7ff6bbd81700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff6b4158640 0x7ff6b406a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.783+0000 7ff6bbd81700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b4158b80 con 0x7ff6b4152970 2023-07-13T14:20:39.775 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.783+0000 7ff6bbd81700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b4158e60 con 0x7ff6b4158640 2023-07-13T14:20:39.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.783+0000 7ff6bbd81700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4159140 con 0x7ff6b4070dd0 2023-07-13T14:20:39.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.783+0000 7ff6ba31e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff6b4158640 0x7ff6b406a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.776 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.784+0000 7ff6b9b1d700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff6b4152970 0x7ff6b4071c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43850/0 (socket says 172.21.15.118:43850) 2023-07-13T14:20:39.777 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.784+0000 7ff6b9b1d700 1 -- 172.21.15.118:0/577074430 learned_addr learned my addr 172.21.15.118:0/577074430 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:39.777 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.784+0000 7ff6b931c700 1 --2- 172.21.15.118:0/577074430 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4070dd0 0x7ff6b4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.778 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.786+0000 7ff6b8b1b700 1 -- 172.21.15.118:0/577074430 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214013566 0 0) 0x7ff6b4158b80 con 0x7ff6b4152970 2023-07-13T14:20:39.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.786+0000 7ff6b8b1b700 1 -- 172.21.15.118:0/577074430 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a00035b0 con 0x7ff6b4152970 2023-07-13T14:20:39.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.787+0000 7ff6b931c700 1 -- 172.21.15.118:0/577074430 >> v2:172.21.15.118:3300/0 conn(0x7ff6b4158640 msgr2=0x7ff6b406a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:39.779 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.787+0000 7ff6b931c700 1 --2- 172.21.15.118:0/577074430 >> v2:172.21.15.118:3300/0 conn(0x7ff6b4158640 0x7ff6b406a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.787+0000 7ff6b931c700 1 -- 172.21.15.118:0/577074430 >> v1:172.21.15.123:6789/0 conn(0x7ff6b4152970 legacy=0x7ff6b4071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.780 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.787+0000 7ff6b931c700 1 -- 172.21.15.118:0/577074430 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4159420 con 0x7ff6b4070dd0 2023-07-13T14:20:39.781 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.788+0000 7ff6b931c700 1 --2- 172.21.15.118:0/577074430 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4070dd0 0x7ff6b4069f30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009840 tx=0x7ff6b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27afe086f8bca808 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:39.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.792+0000 7ff6b8b1b700 1 -- 172.21.15.118:0/577074430 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0011830 con 0x7ff6b4070dd0 2023-07-13T14:20:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.792+0000 7ff6b8b1b700 1 -- 172.21.15.118:0/577074430 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b0011990 con 0x7ff6b4070dd0 2023-07-13T14:20:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.792+0000 7ff6b8b1b700 1 -- 172.21.15.118:0/577074430 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0011d20 con 0x7ff6b4070dd0 2023-07-13T14:20:39.785 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.793+0000 7ff6bbd81700 1 -- 172.21.15.118:0/577074430 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4070dd0 msgr2=0x7ff6b4069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.793+0000 7ff6bbd81700 1 --2- 172.21.15.118:0/577074430 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4070dd0 0x7ff6b4069f30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009840 tx=0x7ff6b0009b50 comp rx=0 tx=0).stop 2023-07-13T14:20:39.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.793+0000 7ff6bbd81700 1 -- 172.21.15.118:0/577074430 shutdown_connections 2023-07-13T14:20:39.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.793+0000 7ff6bbd81700 1 --2- 172.21.15.118:0/577074430 >> v2:172.21.15.118:3300/0 conn(0x7ff6b4158640 0x7ff6b406a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.793+0000 7ff6bbd81700 1 --2- 172.21.15.118:0/577074430 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4070dd0 0x7ff6b4069f30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.793+0000 7ff6bbd81700 1 -- 172.21.15.118:0/577074430 >> 172.21.15.118:0/577074430 conn(0x7ff6b406cf60 msgr2=0x7ff6b406b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:39.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.793+0000 7ff6bbd81700 1 -- 172.21.15.118:0/577074430 shutdown_connections 2023-07-13T14:20:39.786 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.793+0000 7ff6bbd81700 1 -- 172.21.15.118:0/577074430 wait complete. 2023-07-13T14:20:39.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.794+0000 7ff6bbd81700 1 Processor -- start 2023-07-13T14:20:39.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.794+0000 7ff6bbd81700 1 -- start start 2023-07-13T14:20:39.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.795+0000 7ff6bbd81700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b4070dd0 0x7ff6b414e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.795+0000 7ff6bbd81700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4152970 0x7ff6b41ee830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.795+0000 7ff6bbd81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b4158640 0x7ff6b41f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.795+0000 7ff6bbd81700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b414d260 con 0x7ff6b4070dd0 2023-07-13T14:20:39.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.795+0000 7ff6bbd81700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41f2230 con 0x7ff6b4158640 2023-07-13T14:20:39.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.795+0000 7ff6bbd81700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b414bea0 con 0x7ff6b4152970 2023-07-13T14:20:39.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.796+0000 7ff6b9b1d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b4070dd0 0x7ff6b414e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.796+0000 7ff6b9b1d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b4070dd0 0x7ff6b414e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44034/0 (socket says 172.21.15.118:44034) 2023-07-13T14:20:39.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.796+0000 7ff6b931c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4152970 0x7ff6b41ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.796+0000 7ff6b9b1d700 1 -- 172.21.15.118:0/3837054542 learned_addr learned my addr 172.21.15.118:0/3837054542 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:39.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.796+0000 7ff6ba31e700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b4158640 0x7ff6b41f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.800+0000 7ff6b9b1d700 1 -- 172.21.15.118:0/3837054542 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4152970 msgr2=0x7ff6b41ee830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.800+0000 7ff6b9b1d700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff6b4152970 0x7ff6b41ee830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.800+0000 7ff6b9b1d700 1 -- 172.21.15.118:0/3837054542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b4158640 msgr2=0x7ff6b41f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.800+0000 7ff6b9b1d700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b4158640 0x7ff6b41f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.800+0000 7ff6b9b1d700 1 -- 172.21.15.118:0/3837054542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00094a0 con 0x7ff6b4070dd0 2023-07-13T14:20:39.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.802+0000 7ff6b9b1d700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b4070dd0 0x7ff6b414e0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400c4d0 tx=0x7ff6a400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:39.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.804+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4005dc0 con 0x7ff6b4070dd0 2023-07-13T14:20:39.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.804+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b41edd70 con 0x7ff6b4070dd0 2023-07-13T14:20:39.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.805+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b414b480 con 0x7ff6b4070dd0 2023-07-13T14:20:39.797 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.805+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6b4152d40 con 0x7ff6b4070dd0 2023-07-13T14:20:39.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.806+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a400ce80 con 0x7ff6b4070dd0 2023-07-13T14:20:39.799 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.806+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4007270 con 0x7ff6b4070dd0 2023-07-13T14:20:39.825 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.833+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6a40073d0 con 0x7ff6b4070dd0 2023-07-13T14:20:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.833+0000 7ff6aa7fc700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff69806ace0 0x7ff69806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.833+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff6a4089730 con 0x7ff6b4070dd0 2023-07-13T14:20:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.833+0000 7ff6b931c700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff69806ace0 0x7ff69806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.826 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.833+0000 7ff6aa7fc700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7ff6980749f0 0x7ff698076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.833+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 --> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff698077530 con 0x7ff6980749f0 2023-07-13T14:20:39.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.833+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6a4089aa0 con 0x7ff6b4070dd0 2023-07-13T14:20:39.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.834+0000 7ff6ba31e700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7ff6980749f0 0x7ff698076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.834+0000 7ff6b931c700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff69806ace0 0x7ff69806d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0000c00 tx=0x7ff6b0008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:39.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.834+0000 7ff6ba31e700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7ff6980749f0 0x7ff698076e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:39.827 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.834+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 <== osd.1 v2:172.21.15.118:6800/1775143218 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff698077530 con 0x7ff6980749f0 2023-07-13T14:20:39.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.848+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 --> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff6b40c7f50 con 0x7ff6980749f0 2023-07-13T14:20:39.841 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.848+0000 7ff6aa7fc700 1 -- 172.21.15.118:0/3837054542 <== osd.1 v2:172.21.15.118:6800/1775143218 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff6ac00f040 con 0x7ff6980749f0 2023-07-13T14:20:39.841 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T14:20:39.841 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-13T14:20:39.842 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T14:20:39.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7ff6980749f0 msgr2=0x7ff698076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6800/1775143218,v1:172.21.15.118:6801/1775143218] conn(0x7ff6980749f0 0x7ff698076e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff69806ace0 msgr2=0x7ff69806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff69806ace0 0x7ff69806d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0000c00 tx=0x7ff6b0008030 comp rx=0 tx=0).stop 2023-07-13T14:20:39.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b4070dd0 msgr2=0x7ff6b414e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 --2- 172.21.15.118:0/3837054542 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff6b4070dd0 0x7ff6b414e0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400c4d0 tx=0x7ff6a400c7e0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6ba31e700 1 -- 172.21.15.118:0/3837054542 reap_dead start 2023-07-13T14:20:39.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 shutdown_connections 2023-07-13T14:20:39.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 >> 172.21.15.118:0/3837054542 conn(0x7ff6b406cf60 msgr2=0x7ff6b4156ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:39.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 shutdown_connections 2023-07-13T14:20:39.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.849+0000 7ff6bbd81700 1 -- 172.21.15.118:0/3837054542 wait complete. 2023-07-13T14:20:39.853 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-13T14:20:39.975 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.983+0000 7f2802472700 1 Processor -- start 2023-07-13T14:20:39.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.983+0000 7f2802472700 1 -- start start 2023-07-13T14:20:39.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.984+0000 7f2802472700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f27fc14f1d0 0x7f27fc070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.984+0000 7f2802472700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27fc0c5b10 0x7f27fc0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.984+0000 7f2802472700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27fc0c4cf0 con 0x7f27fc158310 2023-07-13T14:20:39.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.984+0000 7f2802472700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc14f5a0 con 0x7f27fc0c5b10 2023-07-13T14:20:39.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.984+0000 7f2802472700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc0c7db0 con 0x7f27fc14f1d0 2023-07-13T14:20:39.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.985+0000 7f27fb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27fc0c5b10 0x7f27fc0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.985+0000 7f27fbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f27fc14f1d0 0x7f27fc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.985+0000 7f27fb7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27fc0c5b10 0x7f27fc0c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44050/0 (socket says 172.21.15.118:44050) 2023-07-13T14:20:39.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.985+0000 7f27fb7fe700 1 -- 172.21.15.118:0/4110664766 learned_addr learned my addr 172.21.15.118:0/4110664766 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:39.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.988+0000 7f27fb7fe700 1 -- 172.21.15.118:0/4110664766 >> v2:172.21.15.123:3300/0 conn(0x7f27fc14f1d0 msgr2=0x7f27fc070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:39.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.988+0000 7f27fb7fe700 1 --2- 172.21.15.118:0/4110664766 >> v2:172.21.15.123:3300/0 conn(0x7f27fc14f1d0 0x7f27fc070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.988+0000 7f27fb7fe700 1 -- 172.21.15.118:0/4110664766 >> v1:172.21.15.123:6789/0 conn(0x7f27fc158310 legacy=0x7f27fc158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.988+0000 7f27fb7fe700 1 -- 172.21.15.118:0/4110664766 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc071300 con 0x7f27fc0c5b10 2023-07-13T14:20:39.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.989+0000 7f27fb7fe700 1 --2- 172.21.15.118:0/4110664766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc0c5f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0720f0 tx=0x7f27ec00ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119112cf508ff227 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:39.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.993+0000 7f27faffd700 1 -- 172.21.15.118:0/4110664766 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec00cb70 con 0x7f27fc0c5b10 2023-07-13T14:20:39.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f27faffd700 1 -- 172.21.15.118:0/4110664766 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec00ccd0 con 0x7f27fc0c5b10 2023-07-13T14:20:39.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f27faffd700 1 -- 172.21.15.118:0/4110664766 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec018620 con 0x7f27fc0c5b10 2023-07-13T14:20:39.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f2802472700 1 -- 172.21.15.118:0/4110664766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 msgr2=0x7f27fc0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f2802472700 1 --2- 172.21.15.118:0/4110664766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc0c5f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0720f0 tx=0x7f27ec00ad70 comp rx=0 tx=0).stop 2023-07-13T14:20:39.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f2802472700 1 -- 172.21.15.118:0/4110664766 shutdown_connections 2023-07-13T14:20:39.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f2802472700 1 --2- 172.21.15.118:0/4110664766 >> v2:172.21.15.123:3300/0 conn(0x7f27fc14f1d0 0x7f27fc070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f2802472700 1 --2- 172.21.15.118:0/4110664766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc0c5f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f2802472700 1 -- 172.21.15.118:0/4110664766 >> 172.21.15.118:0/4110664766 conn(0x7f27fc069f30 msgr2=0x7f27fc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:39.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f2802472700 1 -- 172.21.15.118:0/4110664766 shutdown_connections 2023-07-13T14:20:39.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.994+0000 7f2802472700 1 -- 172.21.15.118:0/4110664766 wait complete. 2023-07-13T14:20:39.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.996+0000 7f2802472700 1 Processor -- start 2023-07-13T14:20:39.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.996+0000 7f2802472700 1 -- start start 2023-07-13T14:20:39.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.997+0000 7f2802472700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc1ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.997+0000 7f2802472700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc14f1d0 0x7f27fc155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.997+0000 7f2802472700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc158310 0x7f27fc156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:39.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.997+0000 7f2802472700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0ca340 con 0x7f27fc0c5b10 2023-07-13T14:20:39.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.997+0000 7f2802472700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0c9510 con 0x7f27fc14f1d0 2023-07-13T14:20:39.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.997+0000 7f2802472700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0c9770 con 0x7f27fc158310 2023-07-13T14:20:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.997+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc1ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.997+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc14f1d0 0x7f27fc155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.998+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc1ea6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44062/0 (socket says 172.21.15.118:44062) 2023-07-13T14:20:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.998+0000 7f27fbfff700 1 -- 172.21.15.118:0/1465410421 learned_addr learned my addr 172.21.15.118:0/1465410421 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:39.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:39.998+0000 7f2800a0f700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc158310 0x7f27fc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.001+0000 7f27fb7fe700 1 -- 172.21.15.118:0/1465410421 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc158310 msgr2=0x7f27fc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.001+0000 7f27fb7fe700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc158310 0x7f27fc156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.001+0000 7f27fb7fe700 1 -- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 msgr2=0x7f27fc1ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.001+0000 7f27fb7fe700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc1ea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.001+0000 7f27fb7fe700 1 -- 172.21.15.118:0/1465410421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec00a6f0 con 0x7f27fc14f1d0 2023-07-13T14:20:39.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.001+0000 7f27fbfff700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc1ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T14:20:39.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.004+0000 7f27fb7fe700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc14f1d0 0x7f27fc155f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27ec017000 tx=0x7f27ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:40.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.008+0000 7f27f8ff9700 1 -- 172.21.15.118:0/1465410421 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec01c040 con 0x7f27fc14f1d0 2023-07-13T14:20:40.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.008+0000 7f27f8ff9700 1 -- 172.21.15.118:0/1465410421 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec003ab0 con 0x7f27fc14f1d0 2023-07-13T14:20:40.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.008+0000 7f27f8ff9700 1 -- 172.21.15.118:0/1465410421 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec003e60 con 0x7f27fc14f1d0 2023-07-13T14:20:40.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.008+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27fc0c9d80 con 0x7f27fc14f1d0 2023-07-13T14:20:40.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.008+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc1ed320 con 0x7f27fc14f1d0 2023-07-13T14:20:40.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.009+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc1ed510 con 0x7f27fc14f1d0 2023-07-13T14:20:40.248 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.256+0000 7f27f8ff9700 1 -- 172.21.15.118:0/1465410421 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27ec02a460 con 0x7f27fc14f1d0 2023-07-13T14:20:40.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.257+0000 7f27f8ff9700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f27e806ad30 0x7f27e806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.249 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.257+0000 7f27fbfff700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f27e806ad30 0x7f27e806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.250 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.257+0000 7f27fbfff700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f27e806ad30 0x7f27e806d1e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f27f00113d0 tx=0x7f27f0009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:40.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.262+0000 7f27f8ff9700 1 -- 172.21.15.118:0/1465410421 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f27ec05e730 con 0x7f27fc14f1d0 2023-07-13T14:20:40.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.272+0000 7f27f8ff9700 1 -- 172.21.15.118:0/1465410421 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f27ec056ab0 con 0x7f27fc14f1d0 2023-07-13T14:20:40.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.458+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f27fc0c4fb0 con 0x7f27e806ad30 2023-07-13T14:20:40.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.458+0000 7f27f8ff9700 1 -- 172.21.15.118:0/1465410421 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27f0011d10 con 0x7f27e806ad30 2023-07-13T14:20:40.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.460+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f27e806ad30 msgr2=0x7f27e806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.460+0000 7f2802472700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f27e806ad30 0x7f27e806d1e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f27f00113d0 tx=0x7f27f0009210 comp rx=0 tx=0).stop 2023-07-13T14:20:40.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.460+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc14f1d0 msgr2=0x7f27fc155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.460+0000 7f2802472700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc14f1d0 0x7f27fc155f00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27ec017000 tx=0x7f27ec004750 comp rx=0 tx=0).stop 2023-07-13T14:20:40.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.461+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 shutdown_connections 2023-07-13T14:20:40.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.461+0000 7f2802472700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f27e806ad30 0x7f27e806d1e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.461+0000 7f2802472700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc158310 0x7f27fc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.461+0000 7f2802472700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27fc0c5b10 0x7f27fc1ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.461+0000 7f2802472700 1 --2- 172.21.15.118:0/1465410421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc14f1d0 0x7f27fc155f00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.461+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 >> 172.21.15.118:0/1465410421 conn(0x7f27fc069f30 msgr2=0x7f27fc0c1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:40.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.461+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 shutdown_connections 2023-07-13T14:20:40.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.461+0000 7f2802472700 1 -- 172.21.15.118:0/1465410421 wait complete. 2023-07-13T14:20:40.455 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 1 to deep-scrub 2023-07-13T14:20:40.465 INFO:tasks.ceph:Scrubbing osd.2 2023-07-13T14:20:40.465 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-13T14:20:40.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.614+0000 7f060fe8f700 1 Processor -- start 2023-07-13T14:20:40.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.614+0000 7f060fe8f700 1 -- start start 2023-07-13T14:20:40.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.615+0000 7f060fe8f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f06081507d0 0x7f060815a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.615+0000 7f060fe8f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06080c6fc0 0x7f06080c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.615+0000 7f060fe8f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06080c1820 con 0x7f06081565e0 2023-07-13T14:20:40.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.615+0000 7f060fe8f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06080c7940 con 0x7f06081507d0 2023-07-13T14:20:40.608 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.615+0000 7f060fe8f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06080c1b00 con 0x7f06080c6fc0 2023-07-13T14:20:40.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.635+0000 7f060e42c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06080c6fc0 0x7f06080c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.635+0000 7f060d42a700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f06081565e0 0x7f060806fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:46394/0 (socket says 172.21.15.118:46394) 2023-07-13T14:20:40.627 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.635+0000 7f060d42a700 1 -- 172.21.15.118:0/1745071973 learned_addr learned my addr 172.21.15.118:0/1745071973 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:40.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.638+0000 7f060e42c700 1 -- 172.21.15.118:0/1745071973 >> v2:172.21.15.118:3300/0 conn(0x7f06081507d0 msgr2=0x7f060815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:40.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.638+0000 7f060e42c700 1 --2- 172.21.15.118:0/1745071973 >> v2:172.21.15.118:3300/0 conn(0x7f06081507d0 0x7f060815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.638+0000 7f060e42c700 1 -- 172.21.15.118:0/1745071973 >> v1:172.21.15.123:6789/0 conn(0x7f06081565e0 legacy=0x7f060806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.630 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.638+0000 7f060e42c700 1 -- 172.21.15.118:0/1745071973 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080c1de0 con 0x7f06080c6fc0 2023-07-13T14:20:40.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.640+0000 7f060e42c700 1 --2- 172.21.15.118:0/1745071973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06080c6fc0 0x7f06080c7400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0600009d90 tx=0x7f060000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bdeae5e21993178 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:40.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.644+0000 7f060cc29700 1 -- 172.21.15.118:0/1745071973 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000e070 con 0x7f06080c6fc0 2023-07-13T14:20:40.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.644+0000 7f060cc29700 1 -- 172.21.15.118:0/1745071973 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060000bbd0 con 0x7f06080c6fc0 2023-07-13T14:20:40.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.644+0000 7f060cc29700 1 -- 172.21.15.118:0/1745071973 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600012430 con 0x7f06080c6fc0 2023-07-13T14:20:40.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.645+0000 7f060fe8f700 1 -- 172.21.15.118:0/1745071973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06080c6fc0 msgr2=0x7f06080c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.637 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.645+0000 7f060fe8f700 1 --2- 172.21.15.118:0/1745071973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06080c6fc0 0x7f06080c7400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0600009d90 tx=0x7f060000b330 comp rx=0 tx=0).stop 2023-07-13T14:20:40.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.645+0000 7f060fe8f700 1 -- 172.21.15.118:0/1745071973 shutdown_connections 2023-07-13T14:20:40.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.645+0000 7f060fe8f700 1 --2- 172.21.15.118:0/1745071973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06080c6fc0 0x7f06080c7400 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.645+0000 7f060fe8f700 1 --2- 172.21.15.118:0/1745071973 >> v2:172.21.15.118:3300/0 conn(0x7f06081507d0 0x7f060815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.645+0000 7f060fe8f700 1 -- 172.21.15.118:0/1745071973 >> 172.21.15.118:0/1745071973 conn(0x7f060806e060 msgr2=0x7f060806eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:40.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.645+0000 7f060fe8f700 1 -- 172.21.15.118:0/1745071973 shutdown_connections 2023-07-13T14:20:40.638 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.645+0000 7f060fe8f700 1 -- 172.21.15.118:0/1745071973 wait complete. 2023-07-13T14:20:40.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.646+0000 7f060fe8f700 1 Processor -- start 2023-07-13T14:20:40.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.646+0000 7f060fe8f700 1 -- start start 2023-07-13T14:20:40.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.647+0000 7f060fe8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06080c6fc0 0x7f060814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.647+0000 7f060fe8f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06081507d0 0x7f06081e0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.647+0000 7f060fe8f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06081565e0 0x7f06080b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.647+0000 7f060fe8f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080b05c0 con 0x7f06080c6fc0 2023-07-13T14:20:40.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.647+0000 7f060fe8f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06081efc50 con 0x7f06081507d0 2023-07-13T14:20:40.640 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.647+0000 7f060fe8f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0608142e70 con 0x7f06081565e0 2023-07-13T14:20:40.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.648+0000 7f060d42a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06081507d0 0x7f06081e0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.648+0000 7f060d42a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06081507d0 0x7f06081e0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:59478/0 (socket says 172.21.15.118:59478) 2023-07-13T14:20:40.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.648+0000 7f060d42a700 1 -- 172.21.15.118:0/2315218214 learned_addr learned my addr 172.21.15.118:0/2315218214 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:40.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.648+0000 7f060e42c700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06081565e0 0x7f06080b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.653+0000 7f060d42a700 1 -- 172.21.15.118:0/2315218214 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06081565e0 msgr2=0x7f06080b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.653+0000 7f060d42a700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06081565e0 0x7f06080b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.653+0000 7f060d42a700 1 -- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06080c6fc0 msgr2=0x7f060814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.653+0000 7f060d42a700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06080c6fc0 0x7f060814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.653+0000 7f060d42a700 1 -- 172.21.15.118:0/2315218214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009a70 con 0x7f06081507d0 2023-07-13T14:20:40.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.656+0000 7f060d42a700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06081507d0 0x7f06081e0fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f05f800c480 tx=0x7f05f800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:40.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.660+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8005d70 con 0x7f06081507d0 2023-07-13T14:20:40.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.660+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f80070d0 con 0x7f06081507d0 2023-07-13T14:20:40.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.660+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0608140c20 con 0x7f06081507d0 2023-07-13T14:20:40.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.660+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8007440 con 0x7f06081507d0 2023-07-13T14:20:40.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.660+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06081f0070 con 0x7f06081507d0 2023-07-13T14:20:40.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.661+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0608159fe0 con 0x7f06081507d0 2023-07-13T14:20:40.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.682+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05f80075a0 con 0x7f06081507d0 2023-07-13T14:20:40.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.683+0000 7f05fe7fc700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05ec06ad30 0x7f05ec06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.683+0000 7f060dc2b700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05ec06ad30 0x7f05ec06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.676 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.683+0000 7f060dc2b700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05ec06ad30 0x7f05ec06d1e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f06040097b0 tx=0x7f0604006d20 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.687+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f05f805bd80 con 0x7f06081507d0 2023-07-13T14:20:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.687+0000 7f05fe7fc700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f05ec0749c0 0x7f05ec076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.687+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 --> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05ec077500 con 0x7f05ec0749c0 2023-07-13T14:20:40.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.687+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05f80011e0 con 0x7f06081507d0 2023-07-13T14:20:40.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.687+0000 7f060e42c700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f05ec0749c0 0x7f05ec076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.687+0000 7f060e42c700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f05ec0749c0 0x7f05ec076e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:40.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.688+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 <== osd.2 v2:172.21.15.118:6808/3477414536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f05ec077500 con 0x7f05ec0749c0 2023-07-13T14:20:40.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 --> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0608159d00 con 0x7f05ec0749c0 2023-07-13T14:20:40.694 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f05fe7fc700 1 -- 172.21.15.118:0/2315218214 <== osd.2 v2:172.21.15.118:6808/3477414536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0600003d60 con 0x7f05ec0749c0 2023-07-13T14:20:40.695 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T14:20:40.695 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-13T14:20:40.695 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T14:20:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f05ec0749c0 msgr2=0x7f05ec076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f060fe8f700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6808/3477414536,v1:172.21.15.118:6810/3477414536] conn(0x7f05ec0749c0 0x7f05ec076e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05ec06ad30 msgr2=0x7f05ec06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f060fe8f700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f05ec06ad30 0x7f05ec06d1e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f06040097b0 tx=0x7f0604006d20 comp rx=0 tx=0).stop 2023-07-13T14:20:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06081507d0 msgr2=0x7f06081e0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f060fe8f700 1 --2- 172.21.15.118:0/2315218214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06081507d0 0x7f06081e0fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f05f800c480 tx=0x7f05f800c790 comp rx=0 tx=0).stop 2023-07-13T14:20:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.702+0000 7f060e42c700 1 -- 172.21.15.118:0/2315218214 reap_dead start 2023-07-13T14:20:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.703+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 shutdown_connections 2023-07-13T14:20:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.703+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 >> 172.21.15.118:0/2315218214 conn(0x7f060806e060 msgr2=0x7f0608155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.703+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 shutdown_connections 2023-07-13T14:20:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.703+0000 7f060fe8f700 1 -- 172.21.15.118:0/2315218214 wait complete. 2023-07-13T14:20:40.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-13T14:20:40.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.837+0000 7f03c5ddc700 1 Processor -- start 2023-07-13T14:20:40.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.838+0000 7f03c5ddc700 1 -- start start 2023-07-13T14:20:40.830 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.838+0000 7f03c5ddc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f03c0152850 0x7f03c006f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.838+0000 7f03c5ddc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03c01590f0 0x7f03c00c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.838+0000 7f03c5ddc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00c6c60 con 0x7f03c00c5d90 2023-07-13T14:20:40.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.838+0000 7f03c5ddc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c006f1b0 con 0x7f03c01590f0 2023-07-13T14:20:40.831 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.838+0000 7f03c5ddc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c01594f0 con 0x7f03c0152850 2023-07-13T14:20:40.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.839+0000 7f03bf7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f03c0152850 0x7f03c006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.839+0000 7f03bffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03c01590f0 0x7f03c00c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.839+0000 7f03bf7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f03c0152850 0x7f03c006f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:59484/0 (socket says 172.21.15.118:59484) 2023-07-13T14:20:40.832 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.840+0000 7f03bf7fe700 1 -- 172.21.15.118:0/1765302932 learned_addr learned my addr 172.21.15.118:0/1765302932 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:40.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.843+0000 7f03bf7fe700 1 -- 172.21.15.118:0/1765302932 >> v2:172.21.15.118:3300/0 conn(0x7f03c01590f0 msgr2=0x7f03c00c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:40.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.843+0000 7f03bf7fe700 1 --2- 172.21.15.118:0/1765302932 >> v2:172.21.15.118:3300/0 conn(0x7f03c01590f0 0x7f03c00c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.843+0000 7f03bf7fe700 1 -- 172.21.15.118:0/1765302932 >> v1:172.21.15.123:6789/0 conn(0x7f03c00c5d90 legacy=0x7f03c006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.843+0000 7f03bf7fe700 1 -- 172.21.15.118:0/1765302932 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00c66a0 con 0x7f03c0152850 2023-07-13T14:20:40.837 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.845+0000 7f03bf7fe700 1 --2- 172.21.15.118:0/1765302932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c0152850 0x7f03c006f380 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f03c00c8f50 tx=0x7f03b0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb9427cb093435df server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:40.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.850+0000 7f03be7fc700 1 -- 172.21.15.118:0/1765302932 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011830 con 0x7f03c0152850 2023-07-13T14:20:40.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.850+0000 7f03be7fc700 1 -- 172.21.15.118:0/1765302932 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0011990 con 0x7f03c0152850 2023-07-13T14:20:40.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.850+0000 7f03be7fc700 1 -- 172.21.15.118:0/1765302932 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011d20 con 0x7f03c0152850 2023-07-13T14:20:40.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.850+0000 7f03c5ddc700 1 -- 172.21.15.118:0/1765302932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c0152850 msgr2=0x7f03c006f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.850+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/1765302932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c0152850 0x7f03c006f380 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f03c00c8f50 tx=0x7f03b0009bd0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.851+0000 7f03c5ddc700 1 -- 172.21.15.118:0/1765302932 shutdown_connections 2023-07-13T14:20:40.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.851+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/1765302932 >> v2:172.21.15.118:3300/0 conn(0x7f03c01590f0 0x7f03c00c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.851+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/1765302932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c0152850 0x7f03c006f380 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.851+0000 7f03c5ddc700 1 -- 172.21.15.118:0/1765302932 >> 172.21.15.118:0/1765302932 conn(0x7f03c0070d40 msgr2=0x7f03c0071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:40.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.851+0000 7f03c5ddc700 1 -- 172.21.15.118:0/1765302932 shutdown_connections 2023-07-13T14:20:40.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.851+0000 7f03c5ddc700 1 -- 172.21.15.118:0/1765302932 wait complete. 2023-07-13T14:20:40.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.852+0000 7f03c5ddc700 1 Processor -- start 2023-07-13T14:20:40.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.852+0000 7f03c5ddc700 1 -- start start 2023-07-13T14:20:40.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.853+0000 7f03c5ddc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03c00c5d90 0x7f03c014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.853+0000 7f03c5ddc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0152850 0x7f03c014c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.853+0000 7f03c5ddc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c01590f0 0x7f03c0147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:40.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.853+0000 7f03c5ddc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01583e0 con 0x7f03c0152850 2023-07-13T14:20:40.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.853+0000 7f03c5ddc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00c33b0 con 0x7f03c01590f0 2023-07-13T14:20:40.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.853+0000 7f03c5ddc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c014ec00 con 0x7f03c00c5d90 2023-07-13T14:20:40.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.853+0000 7f03beffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0152850 0x7f03c014c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.854+0000 7f03bf7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03c00c5d90 0x7f03c014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.854+0000 7f03bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c01590f0 0x7f03c0147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:40.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.854+0000 7f03beffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0152850 0x7f03c014c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49234/0 (socket says 172.21.15.118:49234) 2023-07-13T14:20:40.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.854+0000 7f03beffd700 1 -- 172.21.15.118:0/369506565 learned_addr learned my addr 172.21.15.118:0/369506565 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:40.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.857+0000 7f03beffd700 1 -- 172.21.15.118:0/369506565 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03c00c5d90 msgr2=0x7f03c014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.857+0000 7f03beffd700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03c00c5d90 0x7f03c014fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.857+0000 7f03beffd700 1 -- 172.21.15.118:0/369506565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c01590f0 msgr2=0x7f03c0147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:40.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.857+0000 7f03beffd700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c01590f0 0x7f03c0147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:40.850 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.857+0000 7f03beffd700 1 -- 172.21.15.118:0/369506565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0009550 con 0x7f03c0152850 2023-07-13T14:20:40.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.858+0000 7f03bffff700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c01590f0 0x7f03c0147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T14:20:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.860+0000 7f03beffd700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0152850 0x7f03c014c970 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03a800c450 tx=0x7f03a800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.864+0000 7f03b7fff700 1 -- 172.21.15.118:0/369506565 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a80052d0 con 0x7f03c0152850 2023-07-13T14:20:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.864+0000 7f03b7fff700 1 -- 172.21.15.118:0/369506565 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a8005430 con 0x7f03c0152850 2023-07-13T14:20:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.864+0000 7f03b7fff700 1 -- 172.21.15.118:0/369506565 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a80038c0 con 0x7f03c0152850 2023-07-13T14:20:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.864+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c014eee0 con 0x7f03c0152850 2023-07-13T14:20:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.864+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c014f4a0 con 0x7f03c0152850 2023-07-13T14:20:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:40.865+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c006b9c0 con 0x7f03c0152850 2023-07-13T14:20:41.118 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.126+0000 7f03b7fff700 1 -- 172.21.15.118:0/369506565 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03a8003a20 con 0x7f03c0152850 2023-07-13T14:20:41.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.126+0000 7f03b7fff700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f03a006ace0 0x7f03a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.126+0000 7f03b7fff700 1 -- 172.21.15.118:0/369506565 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f03a8088e90 con 0x7f03c0152850 2023-07-13T14:20:41.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.127+0000 7f03bf7fe700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f03a006ace0 0x7f03a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.119 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.127+0000 7f03b7fff700 1 -- 172.21.15.118:0/369506565 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03a8089390 con 0x7f03c0152850 2023-07-13T14:20:41.120 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.127+0000 7f03bf7fe700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f03a006ace0 0x7f03a006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03b0000c00 tx=0x7f03b0008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:41.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.312+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f03c006e2a0 con 0x7f03a006ace0 2023-07-13T14:20:41.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.313+0000 7f03b7fff700 1 -- 172.21.15.118:0/369506565 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f03b0011b00 con 0x7f03a006ace0 2023-07-13T14:20:41.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f03a006ace0 msgr2=0x7f03a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f03a006ace0 0x7f03a006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03b0000c00 tx=0x7f03b0008030 comp rx=0 tx=0).stop 2023-07-13T14:20:41.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0152850 msgr2=0x7f03c014c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0152850 0x7f03c014c970 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03a800c450 tx=0x7f03a800c760 comp rx=0 tx=0).stop 2023-07-13T14:20:41.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 shutdown_connections 2023-07-13T14:20:41.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f03a006ace0 0x7f03a006d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03c01590f0 0x7f03c0147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03c00c5d90 0x7f03c014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 --2- 172.21.15.118:0/369506565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03c0152850 0x7f03c014c970 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 >> 172.21.15.118:0/369506565 conn(0x7f03c0070d40 msgr2=0x7f03c0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:41.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 shutdown_connections 2023-07-13T14:20:41.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.315+0000 7f03c5ddc700 1 -- 172.21.15.118:0/369506565 wait complete. 2023-07-13T14:20:41.309 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 2 to deep-scrub 2023-07-13T14:20:41.320 INFO:tasks.ceph:Scrubbing osd.3 2023-07-13T14:20:41.321 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-13T14:20:41.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.455+0000 7fe23c328700 1 Processor -- start 2023-07-13T14:20:41.448 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.456+0000 7fe23c328700 1 -- start start 2023-07-13T14:20:41.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.456+0000 7fe23c328700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe234070570 0x7fe2340710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.456+0000 7fe23c328700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe23414ecc0 0x7fe234070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.456+0000 7fe23c328700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe23406abc0 0x7fe234154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.456+0000 7fe23c328700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe234070e80 con 0x7fe23414ecc0 2023-07-13T14:20:41.449 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.457+0000 7fe23c328700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2340c7040 con 0x7fe234070570 2023-07-13T14:20:41.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.457+0000 7fe23c328700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340c7320 con 0x7fe23406abc0 2023-07-13T14:20:41.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.457+0000 7fe2398c3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe23414ecc0 0x7fe234070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.457+0000 7fe2398c3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe23414ecc0 0x7fe234070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49238/0 (socket says 172.21.15.118:49238) 2023-07-13T14:20:41.450 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.457+0000 7fe2398c3700 1 -- 172.21.15.118:0/2870077184 learned_addr learned my addr 172.21.15.118:0/2870077184 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:41.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.458+0000 7fe23a0c4700 1 --2- 172.21.15.118:0/2870077184 >> v2:172.21.15.123:3300/0 conn(0x7fe234070570 0x7fe2340710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.451 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.458+0000 7fe23a8c5700 1 --2- 172.21.15.118:0/2870077184 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe23406abc0 0x7fe234154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.460+0000 7fe2398c3700 1 -- 172.21.15.118:0/2870077184 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe23406abc0 msgr2=0x7fe234154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:41.452 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.460+0000 7fe2398c3700 1 --2- 172.21.15.118:0/2870077184 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe23406abc0 0x7fe234154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.460+0000 7fe2398c3700 1 -- 172.21.15.118:0/2870077184 >> v2:172.21.15.123:3300/0 conn(0x7fe234070570 msgr2=0x7fe2340710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:41.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.460+0000 7fe2398c3700 1 --2- 172.21.15.118:0/2870077184 >> v2:172.21.15.123:3300/0 conn(0x7fe234070570 0x7fe2340710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.453 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.460+0000 7fe2398c3700 1 -- 172.21.15.118:0/2870077184 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340c7600 con 0x7fe23414ecc0 2023-07-13T14:20:41.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.462+0000 7fe2398c3700 1 --2- 172.21.15.118:0/2870077184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 0x7fe234070940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe23406fd90 tx=0x7fe230009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9265067f83898110 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:41.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.466+0000 7fe2390c2700 1 -- 172.21.15.118:0/2870077184 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230011830 con 0x7fe23414ecc0 2023-07-13T14:20:41.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.466+0000 7fe2390c2700 1 -- 172.21.15.118:0/2870077184 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe230011990 con 0x7fe23414ecc0 2023-07-13T14:20:41.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.466+0000 7fe2390c2700 1 -- 172.21.15.118:0/2870077184 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230011d20 con 0x7fe23414ecc0 2023-07-13T14:20:41.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 -- 172.21.15.118:0/2870077184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 msgr2=0x7fe234070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 --2- 172.21.15.118:0/2870077184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 0x7fe234070940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe23406fd90 tx=0x7fe230009bd0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 -- 172.21.15.118:0/2870077184 shutdown_connections 2023-07-13T14:20:41.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 --2- 172.21.15.118:0/2870077184 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe23406abc0 0x7fe234154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 --2- 172.21.15.118:0/2870077184 >> v2:172.21.15.123:3300/0 conn(0x7fe234070570 0x7fe2340710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 --2- 172.21.15.118:0/2870077184 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 0x7fe234070940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 -- 172.21.15.118:0/2870077184 >> 172.21.15.118:0/2870077184 conn(0x7fe23406bac0 msgr2=0x7fe23406bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:41.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 -- 172.21.15.118:0/2870077184 shutdown_connections 2023-07-13T14:20:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.467+0000 7fe23c328700 1 -- 172.21.15.118:0/2870077184 wait complete. 2023-07-13T14:20:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.468+0000 7fe23c328700 1 Processor -- start 2023-07-13T14:20:41.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.468+0000 7fe23c328700 1 -- start start 2023-07-13T14:20:41.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.469+0000 7fe23c328700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe23406abc0 0x7fe2340c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.469+0000 7fe23c328700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe234070570 0x7fe234153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.469+0000 7fe23c328700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 0x7fe234141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.469+0000 7fe23c328700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23415ff90 con 0x7fe23414ecc0 2023-07-13T14:20:41.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.469+0000 7fe23c328700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23414a7f0 con 0x7fe23406abc0 2023-07-13T14:20:41.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.469+0000 7fe23c328700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340c9630 con 0x7fe234070570 2023-07-13T14:20:41.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.470+0000 7fe23a8c5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 0x7fe234141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.470+0000 7fe23a0c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe23406abc0 0x7fe2340c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.470+0000 7fe23a8c5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 0x7fe234141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49242/0 (socket says 172.21.15.118:49242) 2023-07-13T14:20:41.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.470+0000 7fe23a8c5700 1 -- 172.21.15.118:0/2162202146 learned_addr learned my addr 172.21.15.118:0/2162202146 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:41.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.470+0000 7fe2398c3700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe234070570 0x7fe234153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.474+0000 7fe23a8c5700 1 -- 172.21.15.118:0/2162202146 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe234070570 msgr2=0x7fe234153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.474+0000 7fe23a8c5700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe234070570 0x7fe234153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.474+0000 7fe23a8c5700 1 -- 172.21.15.118:0/2162202146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe23406abc0 msgr2=0x7fe2340c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.474+0000 7fe23a8c5700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe23406abc0 0x7fe2340c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.474+0000 7fe23a8c5700 1 -- 172.21.15.118:0/2162202146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe230009550 con 0x7fe23414ecc0 2023-07-13T14:20:41.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.476+0000 7fe23a8c5700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 0x7fe234141180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00eea0 tx=0x7fe22c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:41.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.480+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c010040 con 0x7fe23414ecc0 2023-07-13T14:20:41.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.480+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c00ba70 con 0x7fe23414ecc0 2023-07-13T14:20:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.480+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00be20 con 0x7fe23414ecc0 2023-07-13T14:20:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.480+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe234140cc0 con 0x7fe23414ecc0 2023-07-13T14:20:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.480+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe234143bf0 con 0x7fe23414ecc0 2023-07-13T14:20:41.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.481+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2340c7bc0 con 0x7fe23414ecc0 2023-07-13T14:20:41.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.507+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe22c01d400 con 0x7fe23414ecc0 2023-07-13T14:20:41.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.507+0000 7fe22affd700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe21806ade0 0x7fe21806d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.500 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.508+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe22c08a8d0 con 0x7fe23414ecc0 2023-07-13T14:20:41.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.508+0000 7fe23a0c4700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe21806ade0 0x7fe21806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.508+0000 7fe22affd700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7fe218074b70 0x7fe218076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.508+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 --> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2180776b0 con 0x7fe218074b70 2023-07-13T14:20:41.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.508+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe22c08ac80 con 0x7fe23414ecc0 2023-07-13T14:20:41.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.508+0000 7fe2398c3700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7fe218074b70 0x7fe218076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.508+0000 7fe23a0c4700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe21806ade0 0x7fe21806d290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe224009be0 tx=0x7fe224009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:41.501 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.508+0000 7fe2398c3700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7fe218074b70 0x7fe218076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:41.502 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.509+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 <== osd.3 v2:172.21.15.118:6809/3059213709 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe2180776b0 con 0x7fe218074b70 2023-07-13T14:20:41.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 --> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe2340c78e0 con 0x7fe218074b70 2023-07-13T14:20:41.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe22affd700 1 -- 172.21.15.118:0/2162202146 <== osd.3 v2:172.21.15.118:6809/3059213709 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe230022040 con 0x7fe218074b70 2023-07-13T14:20:41.515 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T14:20:41.516 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-13T14:20:41.516 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T14:20:41.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7fe218074b70 msgr2=0x7fe218076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6809/3059213709,v1:172.21.15.118:6811/3059213709] conn(0x7fe218074b70 0x7fe218076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe21806ade0 msgr2=0x7fe21806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe21806ade0 0x7fe21806d290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe224009be0 tx=0x7fe224009210 comp rx=0 tx=0).stop 2023-07-13T14:20:41.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 msgr2=0x7fe234141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 --2- 172.21.15.118:0/2162202146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe23414ecc0 0x7fe234141180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00eea0 tx=0x7fe22c00b390 comp rx=0 tx=0).stop 2023-07-13T14:20:41.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23a8c5700 1 -- 172.21.15.118:0/2162202146 reap_dead start 2023-07-13T14:20:41.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 shutdown_connections 2023-07-13T14:20:41.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 >> 172.21.15.118:0/2162202146 conn(0x7fe23406bac0 msgr2=0x7fe234069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:41.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 shutdown_connections 2023-07-13T14:20:41.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.523+0000 7fe23c328700 1 -- 172.21.15.118:0/2162202146 wait complete. 2023-07-13T14:20:41.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-13T14:20:41.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.662+0000 7f447199d700 1 Processor -- start 2023-07-13T14:20:41.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.662+0000 7f447199d700 1 -- start start 2023-07-13T14:20:41.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.663+0000 7f447199d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f446c14f230 0x7f446c0c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.655 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.663+0000 7f447199d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f446c06e0e0 0x7f446c0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.663+0000 7f447199d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0c5530 con 0x7f446c0c6510 2023-07-13T14:20:41.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.663+0000 7f447199d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0c5ab0 con 0x7f446c06e0e0 2023-07-13T14:20:41.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.663+0000 7f447199d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0bf2c0 con 0x7f446c14f230 2023-07-13T14:20:41.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.664+0000 7f447119c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f446c06e0e0 0x7f446c0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.664+0000 7f447119c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f446c06e0e0 0x7f446c0c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49248/0 (socket says 172.21.15.118:49248) 2023-07-13T14:20:41.657 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.664+0000 7f447119c700 1 -- 172.21.15.118:0/1931483903 learned_addr learned my addr 172.21.15.118:0/1931483903 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:41.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.667+0000 7f447119c700 1 -- 172.21.15.118:0/1931483903 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f446c14f230 msgr2=0x7f446c0c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:41.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.667+0000 7f447119c700 1 --2- 172.21.15.118:0/1931483903 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f446c14f230 0x7f446c0c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.667+0000 7f447119c700 1 -- 172.21.15.118:0/1931483903 >> v1:172.21.15.123:6789/0 conn(0x7f446c0c6510 legacy=0x7f446c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:41.659 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.667+0000 7f447119c700 1 -- 172.21.15.118:0/1931483903 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0c5fb0 con 0x7f446c06e0e0 2023-07-13T14:20:41.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.669+0000 7f447119c700 1 --2- 172.21.15.118:0/1931483903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0c7430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f445c00bb90 tx=0x7f445c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0708664754eb6aa server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f446b7fe700 1 -- 172.21.15.118:0/1931483903 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c00dd10 con 0x7f446c06e0e0 2023-07-13T14:20:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f446b7fe700 1 -- 172.21.15.118:0/1931483903 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c00de70 con 0x7f446c06e0e0 2023-07-13T14:20:41.665 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f446b7fe700 1 -- 172.21.15.118:0/1931483903 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c004230 con 0x7f446c06e0e0 2023-07-13T14:20:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f447199d700 1 -- 172.21.15.118:0/1931483903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 msgr2=0x7f446c0c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f447199d700 1 --2- 172.21.15.118:0/1931483903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0c7430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f445c00bb90 tx=0x7f445c00bea0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f447199d700 1 -- 172.21.15.118:0/1931483903 shutdown_connections 2023-07-13T14:20:41.666 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f447199d700 1 --2- 172.21.15.118:0/1931483903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0c7430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f447199d700 1 --2- 172.21.15.118:0/1931483903 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f446c14f230 0x7f446c0c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f447199d700 1 -- 172.21.15.118:0/1931483903 >> 172.21.15.118:0/1931483903 conn(0x7f446c06d5d0 msgr2=0x7f446c06d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f447199d700 1 -- 172.21.15.118:0/1931483903 shutdown_connections 2023-07-13T14:20:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.673+0000 7f447199d700 1 -- 172.21.15.118:0/1931483903 wait complete. 2023-07-13T14:20:41.667 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.675+0000 7f447199d700 1 Processor -- start 2023-07-13T14:20:41.668 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.675+0000 7f447199d700 1 -- start start 2023-07-13T14:20:41.668 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.676+0000 7f447199d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.668 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.676+0000 7f447199d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f446c0c6510 0x7f446c1e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.676+0000 7f447199d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f446c14f230 0x7f446c1e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.676+0000 7f447199d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1dcf80 con 0x7f446c06e0e0 2023-07-13T14:20:41.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.676+0000 7f447199d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c14e530 con 0x7f446c14f230 2023-07-13T14:20:41.669 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.676+0000 7f447199d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c14e7d0 con 0x7f446c0c6510 2023-07-13T14:20:41.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.678+0000 7f447099b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.678+0000 7f447099b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0bff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49264/0 (socket says 172.21.15.118:49264) 2023-07-13T14:20:41.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.678+0000 7f447099b700 1 -- 172.21.15.118:0/3332031441 learned_addr learned my addr 172.21.15.118:0/3332031441 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:41.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.683+0000 7f447099b700 1 -- 172.21.15.118:0/3332031441 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f446c0c6510 msgr2=0x7f446c1e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.683+0000 7f447099b700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f446c0c6510 0x7f446c1e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.683+0000 7f447099b700 1 -- 172.21.15.118:0/3332031441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f446c14f230 msgr2=0x7f446c1e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:41.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.683+0000 7f447099b700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f446c14f230 0x7f446c1e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:41.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.683+0000 7f447099b700 1 -- 172.21.15.118:0/3332031441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c00b7f0 con 0x7f446c06e0e0 2023-07-13T14:20:41.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.685+0000 7f447099b700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0bff00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f446400ba50 tx=0x7f446400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.688+0000 7f44697fa700 1 -- 172.21.15.118:0/3332031441 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400cab0 con 0x7f446c06e0e0 2023-07-13T14:20:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.688+0000 7f44697fa700 1 -- 172.21.15.118:0/3332031441 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446400cc30 con 0x7f446c06e0e0 2023-07-13T14:20:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.689+0000 7f44697fa700 1 -- 172.21.15.118:0/3332031441 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464014440 con 0x7f446c06e0e0 2023-07-13T14:20:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.689+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c1dc1c0 con 0x7f446c06e0e0 2023-07-13T14:20:41.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.689+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c1dc780 con 0x7f446c06e0e0 2023-07-13T14:20:41.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.690+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c071fa0 con 0x7f446c06e0e0 2023-07-13T14:20:41.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.903+0000 7f44697fa700 1 -- 172.21.15.118:0/3332031441 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f446401d3b0 con 0x7f446c06e0e0 2023-07-13T14:20:41.896 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.904+0000 7f44697fa700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f444c06ad30 0x7f444c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:41.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.904+0000 7f44697fa700 1 -- 172.21.15.118:0/3332031441 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4464006e40 con 0x7f446c06e0e0 2023-07-13T14:20:41.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.904+0000 7f446bfff700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f444c06ad30 0x7f444c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:41.897 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.904+0000 7f446bfff700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f444c06ad30 0x7f444c06d1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f446c0c08f0 tx=0x7f4454007a20 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:41.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:41.960+0000 7f44697fa700 1 -- 172.21.15.118:0/3332031441 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f44640547a0 con 0x7f446c06e0e0 2023-07-13T14:20:42.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.158+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f446c0c6290 con 0x7f444c06ad30 2023-07-13T14:20:42.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.158+0000 7f44697fa700 1 -- 172.21.15.118:0/3332031441 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f44540050d0 con 0x7f444c06ad30 2023-07-13T14:20:42.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.160+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f444c06ad30 msgr2=0x7f444c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.160+0000 7f447199d700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f444c06ad30 0x7f444c06d1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f446c0c08f0 tx=0x7f4454007a20 comp rx=0 tx=0).stop 2023-07-13T14:20:42.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.160+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 msgr2=0x7f446c0bff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.160+0000 7f447199d700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0bff00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f446400ba50 tx=0x7f446400be10 comp rx=0 tx=0).stop 2023-07-13T14:20:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.161+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 shutdown_connections 2023-07-13T14:20:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.161+0000 7f447199d700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f444c06ad30 0x7f444c06d1e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.161+0000 7f447199d700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f446c14f230 0x7f446c1e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.161+0000 7f447199d700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f446c06e0e0 0x7f446c0bff00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.161+0000 7f447199d700 1 --2- 172.21.15.118:0/3332031441 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f446c0c6510 0x7f446c1e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.161+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 >> 172.21.15.118:0/3332031441 conn(0x7f446c06d5d0 msgr2=0x7f446c0c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:42.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.161+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 shutdown_connections 2023-07-13T14:20:42.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.161+0000 7f447199d700 1 -- 172.21.15.118:0/3332031441 wait complete. 2023-07-13T14:20:42.155 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 3 to deep-scrub 2023-07-13T14:20:42.167 INFO:tasks.ceph:Scrubbing osd.4 2023-07-13T14:20:42.167 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-13T14:20:42.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.300+0000 7f220b0b6700 1 Processor -- start 2023-07-13T14:20:42.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.300+0000 7f220b0b6700 1 -- start start 2023-07-13T14:20:42.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.301+0000 7f220b0b6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22040c6ae0 0x7f2204070b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.301+0000 7f220b0b6700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22040c5820 con 0x7f220406a640 2023-07-13T14:20:42.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.301+0000 7f220b0b6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22040c7450 con 0x7f2204152c60 2023-07-13T14:20:42.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.301+0000 7f220b0b6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22040c8380 con 0x7f22040c6ae0 2023-07-13T14:20:42.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.301+0000 7f2203fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f220406a640 0x7f2204070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45080/0 (socket says 172.21.15.118:45080) 2023-07-13T14:20:42.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.301+0000 7f2203fff700 1 -- 172.21.15.118:0/3236661502 learned_addr learned my addr 172.21.15.118:0/3236661502 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:42.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.301+0000 7f2209653700 1 --2- 172.21.15.118:0/3236661502 >> v2:172.21.15.123:3300/0 conn(0x7f22040c6ae0 0x7f2204070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.304+0000 7f22037fe700 1 -- 172.21.15.118:0/3236661502 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093473817 0 0) 0x7f22040c5820 con 0x7f220406a640 2023-07-13T14:20:42.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.304+0000 7f22037fe700 1 -- 172.21.15.118:0/3236661502 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f40035b0 con 0x7f220406a640 2023-07-13T14:20:42.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.305+0000 7f2209653700 1 -- 172.21.15.118:0/3236661502 >> v1:172.21.15.123:6789/0 conn(0x7f2204152c60 legacy=0x7f2204069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:42.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.305+0000 7f2209653700 1 -- 172.21.15.118:0/3236661502 >> v1:172.21.15.118:6789/0 conn(0x7f220406a640 legacy=0x7f2204070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.297 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.305+0000 7f2209653700 1 -- 172.21.15.118:0/3236661502 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040c6f40 con 0x7f22040c6ae0 2023-07-13T14:20:42.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.308+0000 7f2209653700 1 --2- 172.21.15.118:0/3236661502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 0x7f2204070b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22040c87e0 tx=0x7f21fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c8911014353c264 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:42.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.312+0000 7f22037fe700 1 -- 172.21.15.118:0/3236661502 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00e070 con 0x7f22040c6ae0 2023-07-13T14:20:42.304 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.312+0000 7f22037fe700 1 -- 172.21.15.118:0/3236661502 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc00bae0 con 0x7f22040c6ae0 2023-07-13T14:20:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.312+0000 7f22037fe700 1 -- 172.21.15.118:0/3236661502 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00be90 con 0x7f22040c6ae0 2023-07-13T14:20:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.313+0000 7f220b0b6700 1 -- 172.21.15.118:0/3236661502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 msgr2=0x7f2204070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.313+0000 7f220b0b6700 1 --2- 172.21.15.118:0/3236661502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 0x7f2204070b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22040c87e0 tx=0x7f21fc00b330 comp rx=0 tx=0).stop 2023-07-13T14:20:42.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.313+0000 7f220b0b6700 1 -- 172.21.15.118:0/3236661502 shutdown_connections 2023-07-13T14:20:42.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.313+0000 7f220b0b6700 1 --2- 172.21.15.118:0/3236661502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 0x7f2204070b60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.313+0000 7f220b0b6700 1 -- 172.21.15.118:0/3236661502 >> 172.21.15.118:0/3236661502 conn(0x7f220406ebf0 msgr2=0x7f22040c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:42.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.313+0000 7f220b0b6700 1 -- 172.21.15.118:0/3236661502 shutdown_connections 2023-07-13T14:20:42.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.313+0000 7f220b0b6700 1 -- 172.21.15.118:0/3236661502 wait complete. 2023-07-13T14:20:42.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.314+0000 7f220b0b6700 1 Processor -- start 2023-07-13T14:20:42.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.314+0000 7f220b0b6700 1 -- start start 2023-07-13T14:20:42.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.315+0000 7f220b0b6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f220406a640 0x7f2204143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.315+0000 7f220b0b6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 0x7f2204143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.315+0000 7f220b0b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2204152c60 0x7f220414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.315+0000 7f220b0b6700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22041433e0 con 0x7f2204152c60 2023-07-13T14:20:42.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.315+0000 7f220b0b6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2204144ef0 con 0x7f22040c6ae0 2023-07-13T14:20:42.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.315+0000 7f220b0b6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2204145190 con 0x7f220406a640 2023-07-13T14:20:42.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.316+0000 7f2209653700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2204152c60 0x7f220414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.316+0000 7f2203fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 0x7f2204143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.316+0000 7f2208e52700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f220406a640 0x7f2204143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.316+0000 7f2209653700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2204152c60 0x7f220414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49276/0 (socket says 172.21.15.118:49276) 2023-07-13T14:20:42.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.316+0000 7f2209653700 1 -- 172.21.15.118:0/1692548299 learned_addr learned my addr 172.21.15.118:0/1692548299 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:42.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.320+0000 7f2203fff700 1 -- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f220406a640 msgr2=0x7f2204143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.320+0000 7f2203fff700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f220406a640 0x7f2204143830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.320+0000 7f2203fff700 1 -- 172.21.15.118:0/1692548299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2204152c60 msgr2=0x7f220414ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.312 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.320+0000 7f2203fff700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2204152c60 0x7f220414ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.320+0000 7f2203fff700 1 -- 172.21.15.118:0/1692548299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009a70 con 0x7f22040c6ae0 2023-07-13T14:20:42.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.322+0000 7f2203fff700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 0x7f2204143d70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f220406aa30 tx=0x7f21f000c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:42.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.326+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0005b40 con 0x7f22040c6ae0 2023-07-13T14:20:42.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.326+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f0005ca0 con 0x7f22040c6ae0 2023-07-13T14:20:42.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.326+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0007310 con 0x7f22040c6ae0 2023-07-13T14:20:42.318 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.326+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2204145470 con 0x7f22040c6ae0 2023-07-13T14:20:42.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.326+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2204145a30 con 0x7f22040c6ae0 2023-07-13T14:20:42.319 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.326+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f220415cc80 con 0x7f22040c6ae0 2023-07-13T14:20:42.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.346+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21f0007470 con 0x7f22040c6ae0 2023-07-13T14:20:42.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.347+0000 7f22017fa700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f21e806ace0 0x7f21e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.347+0000 7f2208e52700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f21e806ace0 0x7f21e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.347+0000 7f2208e52700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f21e806ace0 0x7f21e806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f21f8007fd0 tx=0x7f21f8007ec0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:42.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.351+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f21f005bb20 con 0x7f22040c6ae0 2023-07-13T14:20:42.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.351+0000 7f22017fa700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7f21e80748f0 0x7f21e8076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.351+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 --> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21e8077430 con 0x7f21e80748f0 2023-07-13T14:20:42.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.351+0000 7f2209653700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7f21e80748f0 0x7f21e8076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.351+0000 7f2209653700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7f21e80748f0 0x7f21e8076d60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:42.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.352+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21f0053ea0 con 0x7f22040c6ae0 2023-07-13T14:20:42.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.352+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 <== osd.4 v2:172.21.15.123:6808/1567879638 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f21e8077430 con 0x7f21e80748f0 2023-07-13T14:20:42.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.366+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 --> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2204153030 con 0x7f21e80748f0 2023-07-13T14:20:42.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.366+0000 7f22017fa700 1 -- 172.21.15.118:0/1692548299 <== osd.4 v2:172.21.15.123:6808/1567879638 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f21fc003c00 con 0x7f21e80748f0 2023-07-13T14:20:42.359 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T14:20:42.359 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-13T14:20:42.359 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T14:20:42.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.366+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7f21e80748f0 msgr2=0x7f21e8076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.366+0000 7f220b0b6700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:6808/1567879638,v1:172.21.15.123:6809/1567879638] conn(0x7f21e80748f0 0x7f21e8076d60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f21e806ace0 msgr2=0x7f21e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f220b0b6700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f21e806ace0 0x7f21e806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f21f8007fd0 tx=0x7f21f8007ec0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.360 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 msgr2=0x7f2204143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f220b0b6700 1 --2- 172.21.15.118:0/1692548299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22040c6ae0 0x7f2204143d70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f220406aa30 tx=0x7f21f000c670 comp rx=0 tx=0).stop 2023-07-13T14:20:42.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f2209653700 1 -- 172.21.15.118:0/1692548299 reap_dead start 2023-07-13T14:20:42.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 shutdown_connections 2023-07-13T14:20:42.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 >> 172.21.15.118:0/1692548299 conn(0x7f220406ebf0 msgr2=0x7f220415b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:42.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 shutdown_connections 2023-07-13T14:20:42.361 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.367+0000 7f220b0b6700 1 -- 172.21.15.118:0/1692548299 wait complete. 2023-07-13T14:20:42.370 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-13T14:20:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.501+0000 7fe53ab2b700 1 Processor -- start 2023-07-13T14:20:42.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.501+0000 7fe53ab2b700 1 -- start start 2023-07-13T14:20:42.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.502+0000 7fe53ab2b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe53406f380 0x7fe5340c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.502+0000 7fe53ab2b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe5341590f0 0x7fe5340c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.502+0000 7fe53ab2b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5340c6c60 con 0x7fe534152850 2023-07-13T14:20:42.494 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.502+0000 7fe53ab2b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53406f1b0 con 0x7fe5341590f0 2023-07-13T14:20:42.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.502+0000 7fe53ab2b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340c66a0 con 0x7fe53406f380 2023-07-13T14:20:42.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.502+0000 7fe533fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe53406f380 0x7fe5340c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.502+0000 7fe5390c8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe5341590f0 0x7fe5340c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.495 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.503+0000 7fe533fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe53406f380 0x7fe5340c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40270/0 (socket says 172.21.15.118:40270) 2023-07-13T14:20:42.496 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.503+0000 7fe533fff700 1 -- 172.21.15.118:0/357948511 learned_addr learned my addr 172.21.15.118:0/357948511 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.505+0000 7fe533fff700 1 -- 172.21.15.118:0/357948511 >> v2:172.21.15.118:3300/0 conn(0x7fe5341590f0 msgr2=0x7fe5340c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:42.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.505+0000 7fe533fff700 1 --2- 172.21.15.118:0/357948511 >> v2:172.21.15.118:3300/0 conn(0x7fe5341590f0 0x7fe5340c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.505+0000 7fe533fff700 1 -- 172.21.15.118:0/357948511 >> v1:172.21.15.118:6789/0 conn(0x7fe534152850 legacy=0x7fe53406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.505+0000 7fe533fff700 1 -- 172.21.15.118:0/357948511 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340c6980 con 0x7fe53406f380 2023-07-13T14:20:42.499 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.507+0000 7fe533fff700 1 --2- 172.21.15.118:0/357948511 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe53406f380 0x7fe5340c5d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5200098f0 tx=0x7fe520009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656c2790a984118c server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:42.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe5337fe700 1 -- 172.21.15.118:0/357948511 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520011830 con 0x7fe53406f380 2023-07-13T14:20:42.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe5337fe700 1 -- 172.21.15.118:0/357948511 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe520011990 con 0x7fe53406f380 2023-07-13T14:20:42.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe5337fe700 1 -- 172.21.15.118:0/357948511 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520011d20 con 0x7fe53406f380 2023-07-13T14:20:42.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe53ab2b700 1 -- 172.21.15.118:0/357948511 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe53406f380 msgr2=0x7fe5340c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/357948511 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe53406f380 0x7fe5340c5d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5200098f0 tx=0x7fe520009c00 comp rx=0 tx=0).stop 2023-07-13T14:20:42.504 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe53ab2b700 1 -- 172.21.15.118:0/357948511 shutdown_connections 2023-07-13T14:20:42.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/357948511 >> v2:172.21.15.118:3300/0 conn(0x7fe5341590f0 0x7fe5340c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/357948511 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe53406f380 0x7fe5340c5d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.511+0000 7fe53ab2b700 1 -- 172.21.15.118:0/357948511 >> 172.21.15.118:0/357948511 conn(0x7fe534070d40 msgr2=0x7fe534071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:42.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.512+0000 7fe53ab2b700 1 -- 172.21.15.118:0/357948511 shutdown_connections 2023-07-13T14:20:42.505 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.512+0000 7fe53ab2b700 1 -- 172.21.15.118:0/357948511 wait complete. 2023-07-13T14:20:42.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.513+0000 7fe53ab2b700 1 Processor -- start 2023-07-13T14:20:42.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.513+0000 7fe53ab2b700 1 -- start start 2023-07-13T14:20:42.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe53ab2b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe53406f380 0x7fe534158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe53ab2b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe534152850 0x7fe5341e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.506 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe53ab2b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe5341590f0 0x7fe53415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe53ab2b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe534158ca0 con 0x7fe534152850 2023-07-13T14:20:42.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe53ab2b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53414de30 con 0x7fe53406f380 2023-07-13T14:20:42.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe53ab2b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5341ee240 con 0x7fe5341590f0 2023-07-13T14:20:42.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe533fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe534152850 0x7fe5341e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe5390c8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe5341590f0 0x7fe53415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe5388c7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe53406f380 0x7fe534158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe533fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe534152850 0x7fe5341e4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49284/0 (socket says 172.21.15.118:49284) 2023-07-13T14:20:42.508 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.514+0000 7fe533fff700 1 -- 172.21.15.118:0/1454776898 learned_addr learned my addr 172.21.15.118:0/1454776898 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:42.510 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.518+0000 7fe5390c8700 1 -- 172.21.15.118:0/1454776898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe53406f380 msgr2=0x7fe534158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.518+0000 7fe5390c8700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe53406f380 0x7fe534158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.518+0000 7fe5390c8700 1 -- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe534152850 msgr2=0x7fe5341e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:42.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.518+0000 7fe5390c8700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe534152850 0x7fe5341e4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:42.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.518+0000 7fe5390c8700 1 -- 172.21.15.118:0/1454776898 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520009550 con 0x7fe5341590f0 2023-07-13T14:20:42.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.521+0000 7fe5390c8700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe5341590f0 0x7fe53415bfc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00eba0 tx=0x7fe52c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:42.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.524+0000 7fe5317fa700 1 -- 172.21.15.118:0/1454776898 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c009a80 con 0x7fe5341590f0 2023-07-13T14:20:42.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.524+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5341f2260 con 0x7fe5341590f0 2023-07-13T14:20:42.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.524+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5341ee500 con 0x7fe5341590f0 2023-07-13T14:20:42.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.524+0000 7fe5317fa700 1 -- 172.21.15.118:0/1454776898 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c00f040 con 0x7fe5341590f0 2023-07-13T14:20:42.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.524+0000 7fe5317fa700 1 -- 172.21.15.118:0/1454776898 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c00cc00 con 0x7fe5341590f0 2023-07-13T14:20:42.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.525+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5340c5750 con 0x7fe5341590f0 2023-07-13T14:20:42.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.545+0000 7fe5317fa700 1 -- 172.21.15.118:0/1454776898 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe52c014480 con 0x7fe5341590f0 2023-07-13T14:20:42.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.545+0000 7fe5317fa700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe51806ace0 0x7fe51806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:42.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.545+0000 7fe5388c7700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe51806ace0 0x7fe51806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:42.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.546+0000 7fe5388c7700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe51806ace0 0x7fe51806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe528007fd0 tx=0x7fe528009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:42.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.551+0000 7fe5317fa700 1 -- 172.21.15.118:0/1454776898 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe52c05d150 con 0x7fe5341590f0 2023-07-13T14:20:42.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:42.811+0000 7fe5317fa700 1 -- 172.21.15.118:0/1454776898 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe52c058f60 con 0x7fe5341590f0 2023-07-13T14:20:43.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.020+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe53406e580 con 0x7fe51806ace0 2023-07-13T14:20:43.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.021+0000 7fe5317fa700 1 -- 172.21.15.118:0/1454776898 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe528001560 con 0x7fe51806ace0 2023-07-13T14:20:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe51806ace0 msgr2=0x7fe51806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe51806ace0 0x7fe51806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe528007fd0 tx=0x7fe528009040 comp rx=0 tx=0).stop 2023-07-13T14:20:43.015 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe5341590f0 msgr2=0x7fe53415bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe5341590f0 0x7fe53415bfc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00eba0 tx=0x7fe52c00eeb0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 shutdown_connections 2023-07-13T14:20:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe51806ace0 0x7fe51806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe53406f380 0x7fe534158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe5341590f0 0x7fe53415bfc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 --2- 172.21.15.118:0/1454776898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe534152850 0x7fe5341e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.016 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 >> 172.21.15.118:0/1454776898 conn(0x7fe534070d40 msgr2=0x7fe53406e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 shutdown_connections 2023-07-13T14:20:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.023+0000 7fe53ab2b700 1 -- 172.21.15.118:0/1454776898 wait complete. 2023-07-13T14:20:43.017 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 4 to deep-scrub 2023-07-13T14:20:43.027 INFO:tasks.ceph:Scrubbing osd.5 2023-07-13T14:20:43.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-13T14:20:43.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.160+0000 7f8ef907d700 1 Processor -- start 2023-07-13T14:20:43.153 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.160+0000 7f8ef907d700 1 -- start start 2023-07-13T14:20:43.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.161+0000 7f8ef907d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41507d0 0x7f8ef415a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.162+0000 7f8ef907d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ef41565e0 0x7f8ef406fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.154 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.162+0000 7f8ef907d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ef4070000 0x7f8ef40c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.162+0000 7f8ef907d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40c1820 con 0x7f8ef4070000 2023-07-13T14:20:43.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.162+0000 7f8ef907d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40c1b00 con 0x7f8ef41565e0 2023-07-13T14:20:43.155 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.162+0000 7f8ef907d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40c1de0 con 0x7f8ef41507d0 2023-07-13T14:20:43.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.162+0000 7f8ef359e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ef4070000 0x7f8ef40c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.162+0000 7f8ef259c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ef41565e0 0x7f8ef406fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.162+0000 7f8ef2d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41507d0 0x7f8ef415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.163+0000 7f8ef359e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8ef4070000 0x7f8ef40c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49290/0 (socket says 172.21.15.118:49290) 2023-07-13T14:20:43.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.163+0000 7f8ef359e700 1 -- 172.21.15.118:0/1655665790 learned_addr learned my addr 172.21.15.118:0/1655665790 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:43.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.165+0000 7f8ef259c700 1 -- 172.21.15.118:0/1655665790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41507d0 msgr2=0x7f8ef415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:43.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.165+0000 7f8ef259c700 1 --2- 172.21.15.118:0/1655665790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41507d0 0x7f8ef415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.165+0000 7f8ef259c700 1 -- 172.21.15.118:0/1655665790 >> v2:172.21.15.118:3300/0 conn(0x7f8ef4070000 msgr2=0x7f8ef40c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:43.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.165+0000 7f8ef259c700 1 --2- 172.21.15.118:0/1655665790 >> v2:172.21.15.118:3300/0 conn(0x7f8ef4070000 0x7f8ef40c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.158 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.165+0000 7f8ef259c700 1 -- 172.21.15.118:0/1655665790 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef4159d00 con 0x7f8ef41565e0 2023-07-13T14:20:43.159 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.167+0000 7f8ef259c700 1 --2- 172.21.15.118:0/1655665790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef41565e0 0x7f8ef406fac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ef406f300 tx=0x7f8edc009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37d767975e72083 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:43.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef1d9b700 1 -- 172.21.15.118:0/1655665790 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc011830 con 0x7f8ef41565e0 2023-07-13T14:20:43.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef1d9b700 1 -- 172.21.15.118:0/1655665790 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc011990 con 0x7f8ef41565e0 2023-07-13T14:20:43.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef1d9b700 1 -- 172.21.15.118:0/1655665790 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc011d20 con 0x7f8ef41565e0 2023-07-13T14:20:43.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 -- 172.21.15.118:0/1655665790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef41565e0 msgr2=0x7f8ef406fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 --2- 172.21.15.118:0/1655665790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef41565e0 0x7f8ef406fac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ef406f300 tx=0x7f8edc009b20 comp rx=0 tx=0).stop 2023-07-13T14:20:43.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 -- 172.21.15.118:0/1655665790 shutdown_connections 2023-07-13T14:20:43.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 --2- 172.21.15.118:0/1655665790 >> v2:172.21.15.118:3300/0 conn(0x7f8ef4070000 0x7f8ef40c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 --2- 172.21.15.118:0/1655665790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41507d0 0x7f8ef415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.165 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 --2- 172.21.15.118:0/1655665790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef41565e0 0x7f8ef406fac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 -- 172.21.15.118:0/1655665790 >> 172.21.15.118:0/1655665790 conn(0x7f8ef406e060 msgr2=0x7f8ef406eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:43.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 -- 172.21.15.118:0/1655665790 shutdown_connections 2023-07-13T14:20:43.166 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.172+0000 7f8ef907d700 1 -- 172.21.15.118:0/1655665790 wait complete. 2023-07-13T14:20:43.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.174+0000 7f8ef907d700 1 Processor -- start 2023-07-13T14:20:43.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.174+0000 7f8ef907d700 1 -- start start 2023-07-13T14:20:43.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.174+0000 7f8ef907d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ef4070000 0x7f8ef40ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.174+0000 7f8ef907d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef41507d0 0x7f8ef413ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.174+0000 7f8ef907d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41565e0 0x7f8ef40ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.174+0000 7f8ef907d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41ee770 con 0x7f8ef4070000 2023-07-13T14:20:43.167 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.174+0000 7f8ef907d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4142a60 con 0x7f8ef41507d0 2023-07-13T14:20:43.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.174+0000 7f8ef907d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4142d00 con 0x7f8ef41565e0 2023-07-13T14:20:43.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.175+0000 7f8ef2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ef4070000 0x7f8ef40ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.168 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.175+0000 7f8ef259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef41507d0 0x7f8ef413ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.175+0000 7f8ef359e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41565e0 0x7f8ef40ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.175+0000 7f8ef2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ef4070000 0x7f8ef40ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49306/0 (socket says 172.21.15.118:49306) 2023-07-13T14:20:43.169 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.175+0000 7f8ef2d9d700 1 -- 172.21.15.118:0/786332052 learned_addr learned my addr 172.21.15.118:0/786332052 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:43.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.179+0000 7f8ef359e700 1 -- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef41507d0 msgr2=0x7f8ef413ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.179+0000 7f8ef359e700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ef41507d0 0x7f8ef413ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.179+0000 7f8ef359e700 1 -- 172.21.15.118:0/786332052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ef4070000 msgr2=0x7f8ef40ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.179+0000 7f8ef359e700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ef4070000 0x7f8ef40ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.179+0000 7f8ef359e700 1 -- 172.21.15.118:0/786332052 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0094a0 con 0x7f8ef41565e0 2023-07-13T14:20:43.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.179+0000 7f8ef2d9d700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8ef4070000 0x7f8ef40ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T14:20:43.174 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.182+0000 7f8ef359e700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41565e0 0x7f8ef40ac8c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00eab0 tx=0x7f8eec00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.186+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec010040 con 0x7f8ef41565e0 2023-07-13T14:20:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.186+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec003c20 con 0x7f8ef41565e0 2023-07-13T14:20:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.186+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec004030 con 0x7f8ef41565e0 2023-07-13T14:20:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.186+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef41ee120 con 0x7f8ef41565e0 2023-07-13T14:20:43.179 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.186+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef41ede10 con 0x7f8ef41565e0 2023-07-13T14:20:43.180 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.187+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ef40c20c0 con 0x7f8ef41565e0 2023-07-13T14:20:43.204 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8eec004190 con 0x7f8ef41565e0 2023-07-13T14:20:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8eeb7fe700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8ed406ade0 0x7f8ed406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8eec089ab0 con 0x7f8ef41565e0 2023-07-13T14:20:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8ef2d9d700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8ed406ade0 0x7f8ed406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8eeb7fe700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7f8ed4074b70 0x7f8ed4076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 --> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ed40776b0 con 0x7f8ed4074b70 2023-07-13T14:20:43.205 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8eec089e60 con 0x7f8ef41565e0 2023-07-13T14:20:43.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8ef2d9d700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8ed406ade0 0x7f8ed406d290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40113d0 tx=0x7f8ee4009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:43.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.212+0000 7f8ef259c700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7f8ed4074b70 0x7f8ed4076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.213+0000 7f8ef259c700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7f8ed4074b70 0x7f8ed4076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:43.206 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.214+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 <== osd.5 v2:172.21.15.123:6816/3894697051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8ed40776b0 con 0x7f8ed4074b70 2023-07-13T14:20:43.220 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.228+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 --> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8ef4159fe0 con 0x7f8ed4074b70 2023-07-13T14:20:43.220 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.228+0000 7f8eeb7fe700 1 -- 172.21.15.118:0/786332052 <== osd.5 v2:172.21.15.123:6816/3894697051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8edc022040 con 0x7f8ed4074b70 2023-07-13T14:20:43.221 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T14:20:43.221 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-13T14:20:43.221 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T14:20:43.222 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7f8ed4074b70 msgr2=0x7f8ed4076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.222 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:6816/3894697051,v1:172.21.15.123:6817/3894697051] conn(0x7f8ed4074b70 0x7f8ed4076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.222 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8ed406ade0 msgr2=0x7f8ed406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.222 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f8ed406ade0 0x7f8ed406d290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40113d0 tx=0x7f8ee4009210 comp rx=0 tx=0).stop 2023-07-13T14:20:43.222 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41565e0 msgr2=0x7f8ef40ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.222 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 --2- 172.21.15.118:0/786332052 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8ef41565e0 0x7f8ef40ac8c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00eab0 tx=0x7f8eec00edc0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef359e700 1 -- 172.21.15.118:0/786332052 reap_dead start 2023-07-13T14:20:43.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 shutdown_connections 2023-07-13T14:20:43.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 >> 172.21.15.118:0/786332052 conn(0x7f8ef406e060 msgr2=0x7f8ef40c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:43.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 shutdown_connections 2023-07-13T14:20:43.223 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.229+0000 7f8ef907d700 1 -- 172.21.15.118:0/786332052 wait complete. 2023-07-13T14:20:43.233 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-13T14:20:43.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.364+0000 7febd41d5700 1 Processor -- start 2023-07-13T14:20:43.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.365+0000 7febd41d5700 1 -- start start 2023-07-13T14:20:43.357 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.365+0000 7febd41d5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7febcc14eeb0 0x7febcc155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.365+0000 7febd41d5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc155aa0 con 0x7febcc069f30 2023-07-13T14:20:43.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.365+0000 7febd41d5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febcc14f280 con 0x7febcc06a360 2023-07-13T14:20:43.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.365+0000 7febd41d5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febcc071c80 con 0x7febcc14eeb0 2023-07-13T14:20:43.358 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.366+0000 7febd1f71700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7febcc14eeb0 0x7febcc155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.366+0000 7febd2772700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7febcc06a360 0x7febcc071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:46416/0 (socket says 172.21.15.118:46416) 2023-07-13T14:20:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.366+0000 7febd2772700 1 -- 172.21.15.118:0/1778782121 learned_addr learned my addr 172.21.15.118:0/1778782121 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.369+0000 7febd0f6f700 1 -- 172.21.15.118:0/1778782121 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416046421 0 0) 0x7febcc14f280 con 0x7febcc06a360 2023-07-13T14:20:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.369+0000 7febd0f6f700 1 -- 172.21.15.118:0/1778782121 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb80035b0 con 0x7febcc06a360 2023-07-13T14:20:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.370+0000 7febd1f71700 1 -- 172.21.15.118:0/1778782121 >> v1:172.21.15.123:6789/0 conn(0x7febcc06a360 legacy=0x7febcc071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.370+0000 7febd1f71700 1 -- 172.21.15.118:0/1778782121 >> v1:172.21.15.118:6789/0 conn(0x7febcc069f30 legacy=0x7febcc070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.370+0000 7febd1f71700 1 -- 172.21.15.118:0/1778782121 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc0c73f0 con 0x7febcc14eeb0 2023-07-13T14:20:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.375+0000 7febd1f71700 1 --2- 172.21.15.118:0/1778782121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc155560 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7febbc009840 tx=0x7febbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936e8250aaa33f8a server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:43.371 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.379+0000 7febd0f6f700 1 -- 172.21.15.118:0/1778782121 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc011830 con 0x7febcc14eeb0 2023-07-13T14:20:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.379+0000 7febd0f6f700 1 -- 172.21.15.118:0/1778782121 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc011990 con 0x7febcc14eeb0 2023-07-13T14:20:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.379+0000 7febd0f6f700 1 -- 172.21.15.118:0/1778782121 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc011d20 con 0x7febcc14eeb0 2023-07-13T14:20:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.379+0000 7febd41d5700 1 -- 172.21.15.118:0/1778782121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 msgr2=0x7febcc155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.379+0000 7febd41d5700 1 --2- 172.21.15.118:0/1778782121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc155560 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7febbc009840 tx=0x7febbc009b50 comp rx=0 tx=0).stop 2023-07-13T14:20:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.380+0000 7febd41d5700 1 -- 172.21.15.118:0/1778782121 shutdown_connections 2023-07-13T14:20:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.380+0000 7febd41d5700 1 --2- 172.21.15.118:0/1778782121 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc155560 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.380+0000 7febd41d5700 1 -- 172.21.15.118:0/1778782121 >> 172.21.15.118:0/1778782121 conn(0x7febcc0cb880 msgr2=0x7febcc0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.380+0000 7febd41d5700 1 -- 172.21.15.118:0/1778782121 shutdown_connections 2023-07-13T14:20:43.373 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.380+0000 7febd41d5700 1 -- 172.21.15.118:0/1778782121 wait complete. 2023-07-13T14:20:43.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.381+0000 7febd41d5700 1 Processor -- start 2023-07-13T14:20:43.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.381+0000 7febd41d5700 1 -- start start 2023-07-13T14:20:43.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.382+0000 7febd41d5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febcc069f30 0x7febcc1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.382+0000 7febd41d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febcc06a360 0x7febcc138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.382+0000 7febd41d5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc0c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.382+0000 7febd41d5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1549f0 con 0x7febcc14eeb0 2023-07-13T14:20:43.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.382+0000 7febd41d5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0c4df0 con 0x7febcc06a360 2023-07-13T14:20:43.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.382+0000 7febd41d5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc1f22d0 con 0x7febcc069f30 2023-07-13T14:20:43.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.382+0000 7febd2772700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc0c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.382+0000 7febd1770700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febcc06a360 0x7febcc138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.383+0000 7febd1f71700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febcc069f30 0x7febcc1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.383+0000 7febd2772700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc0c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49334/0 (socket says 172.21.15.118:49334) 2023-07-13T14:20:43.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.383+0000 7febd2772700 1 -- 172.21.15.118:0/1927075074 learned_addr learned my addr 172.21.15.118:0/1927075074 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:43.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.386+0000 7febd2772700 1 -- 172.21.15.118:0/1927075074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febcc069f30 msgr2=0x7febcc1544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.386+0000 7febd2772700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febcc069f30 0x7febcc1544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.386+0000 7febd2772700 1 -- 172.21.15.118:0/1927075074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febcc06a360 msgr2=0x7febcc138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.386+0000 7febd2772700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febcc06a360 0x7febcc138c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.386+0000 7febd2772700 1 -- 172.21.15.118:0/1927075074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0094a0 con 0x7febcc14eeb0 2023-07-13T14:20:43.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.389+0000 7febd2772700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc0c37c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7febc400cb40 tx=0x7febc400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:43.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.395+0000 7febc27fc700 1 -- 172.21.15.118:0/1927075074 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc400a9e0 con 0x7febcc14eeb0 2023-07-13T14:20:43.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.395+0000 7febc27fc700 1 -- 172.21.15.118:0/1927075074 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc400ab40 con 0x7febcc14eeb0 2023-07-13T14:20:43.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.395+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc154d50 con 0x7febcc14eeb0 2023-07-13T14:20:43.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.395+0000 7febc27fc700 1 -- 172.21.15.118:0/1927075074 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4012400 con 0x7febcc14eeb0 2023-07-13T14:20:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.395+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc0c4b10 con 0x7febcc14eeb0 2023-07-13T14:20:43.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.396+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc04e280 con 0x7febcc14eeb0 2023-07-13T14:20:43.406 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.414+0000 7febc27fc700 1 -- 172.21.15.118:0/1927075074 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febc401b3b0 con 0x7febcc14eeb0 2023-07-13T14:20:43.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.414+0000 7febc27fc700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7febb006ad30 0x7febb006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.415+0000 7febd1f71700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7febb006ad30 0x7febb006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.407 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.415+0000 7febd1f71700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7febb006ad30 0x7febb006d1e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7febbc0090b0 tx=0x7febbc01c040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:43.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.420+0000 7febc27fc700 1 -- 172.21.15.118:0/1927075074 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7febc405c280 con 0x7febcc14eeb0 2023-07-13T14:20:43.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.662+0000 7febc27fc700 1 -- 172.21.15.118:0/1927075074 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7febc40546b0 con 0x7febcc14eeb0 2023-07-13T14:20:43.843 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.851+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7febcc0c6350 con 0x7febb006ad30 2023-07-13T14:20:43.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.851+0000 7febc27fc700 1 -- 172.21.15.118:0/1927075074 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7febbc011b80 con 0x7febb006ad30 2023-07-13T14:20:43.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7febb006ad30 msgr2=0x7febb006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7febb006ad30 0x7febb006d1e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7febbc0090b0 tx=0x7febbc01c040 comp rx=0 tx=0).stop 2023-07-13T14:20:43.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 msgr2=0x7febcc0c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc0c37c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7febc400cb40 tx=0x7febc400ce50 comp rx=0 tx=0).stop 2023-07-13T14:20:43.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 shutdown_connections 2023-07-13T14:20:43.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7febb006ad30 0x7febb006d1e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7febcc14eeb0 0x7febcc0c37c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febcc069f30 0x7febcc1544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 --2- 172.21.15.118:0/1927075074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febcc06a360 0x7febcc138c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 >> 172.21.15.118:0/1927075074 conn(0x7febcc0cb880 msgr2=0x7febcc14d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:43.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 shutdown_connections 2023-07-13T14:20:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.853+0000 7febd41d5700 1 -- 172.21.15.118:0/1927075074 wait complete. 2023-07-13T14:20:43.848 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 5 to deep-scrub 2023-07-13T14:20:43.858 INFO:tasks.ceph:Scrubbing osd.6 2023-07-13T14:20:43.858 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-13T14:20:43.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.993+0000 7ff8ed77c700 1 Processor -- start 2023-07-13T14:20:43.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.993+0000 7ff8ed77c700 1 -- start start 2023-07-13T14:20:43.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.993+0000 7ff8ed77c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e814f790 0x7ff8e8070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.993+0000 7ff8ed77c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8e80720d0 0x7ff8e80c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:43.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.993+0000 7ff8ed77c700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80c6ca0 con 0x7ff8e8071cc0 2023-07-13T14:20:43.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.993+0000 7ff8ed77c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80c6160 con 0x7ff8e80720d0 2023-07-13T14:20:43.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.993+0000 7ff8ed77c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e8071430 con 0x7ff8e814f790 2023-07-13T14:20:43.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.994+0000 7ff8e77fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8e80720d0 0x7ff8e80c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.994+0000 7ff8e6ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e814f790 0x7ff8e8070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:43.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.994+0000 7ff8e6ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e814f790 0x7ff8e8070ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40312/0 (socket says 172.21.15.118:40312) 2023-07-13T14:20:43.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.994+0000 7ff8e77fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8e80720d0 0x7ff8e80c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:59576/0 (socket says 172.21.15.118:59576) 2023-07-13T14:20:43.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.994+0000 7ff8e6ffd700 1 -- 172.21.15.118:0/2011692258 learned_addr learned my addr 172.21.15.118:0/2011692258 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:43.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.998+0000 7ff8e6ffd700 1 -- 172.21.15.118:0/2011692258 >> v2:172.21.15.123:3300/0 conn(0x7ff8e80720d0 msgr2=0x7ff8e80c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:43.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.998+0000 7ff8e6ffd700 1 --2- 172.21.15.118:0/2011692258 >> v2:172.21.15.123:3300/0 conn(0x7ff8e80720d0 0x7ff8e80c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.998+0000 7ff8e6ffd700 1 -- 172.21.15.118:0/2011692258 >> v1:172.21.15.118:6789/0 conn(0x7ff8e8071cc0 legacy=0x7ff8e80c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:43.998+0000 7ff8e6ffd700 1 -- 172.21.15.118:0/2011692258 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80716a0 con 0x7ff8e814f790 2023-07-13T14:20:43.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.000+0000 7ff8e6ffd700 1 --2- 172.21.15.118:0/2011692258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e814f790 0x7ff8e8070ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8006fd0 tx=0x7ff8d8009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec2415b6b98e6e9c server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:43.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8e5ffb700 1 -- 172.21.15.118:0/2011692258 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8005e30 con 0x7ff8e814f790 2023-07-13T14:20:43.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8e5ffb700 1 -- 172.21.15.118:0/2011692258 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8004030 con 0x7ff8e814f790 2023-07-13T14:20:43.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8e5ffb700 1 -- 172.21.15.118:0/2011692258 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80043e0 con 0x7ff8e814f790 2023-07-13T14:20:43.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8ed77c700 1 -- 172.21.15.118:0/2011692258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e814f790 msgr2=0x7ff8e8070ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:43.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8ed77c700 1 --2- 172.21.15.118:0/2011692258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e814f790 0x7ff8e8070ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8006fd0 tx=0x7ff8d8009bd0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8ed77c700 1 -- 172.21.15.118:0/2011692258 shutdown_connections 2023-07-13T14:20:43.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8ed77c700 1 --2- 172.21.15.118:0/2011692258 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e814f790 0x7ff8e8070ef0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8ed77c700 1 --2- 172.21.15.118:0/2011692258 >> v2:172.21.15.123:3300/0 conn(0x7ff8e80720d0 0x7ff8e80c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:43.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8ed77c700 1 -- 172.21.15.118:0/2011692258 >> 172.21.15.118:0/2011692258 conn(0x7ff8e806cf60 msgr2=0x7ff8e806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:43.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8ed77c700 1 -- 172.21.15.118:0/2011692258 shutdown_connections 2023-07-13T14:20:43.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.005+0000 7ff8ed77c700 1 -- 172.21.15.118:0/2011692258 wait complete. 2023-07-13T14:20:43.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.006+0000 7ff8ed77c700 1 Processor -- start 2023-07-13T14:20:43.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.007+0000 7ff8ed77c700 1 -- start start 2023-07-13T14:20:44.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.007+0000 7ff8ed77c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8e8071cc0 0x7ff8e80cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.007+0000 7ff8ed77c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e80720d0 0x7ff8e80cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.007+0000 7ff8ed77c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e814f790 0x7ff8e8154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.007+0000 7ff8ed77c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e814dcd0 con 0x7ff8e8071cc0 2023-07-13T14:20:44.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.007+0000 7ff8ed77c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e814ce20 con 0x7ff8e814f790 2023-07-13T14:20:44.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.007+0000 7ff8ed77c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e814d0c0 con 0x7ff8e80720d0 2023-07-13T14:20:44.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.008+0000 7ff8e77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e814f790 0x7ff8e8154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.008+0000 7ff8e67fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e80720d0 0x7ff8e80cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.008+0000 7ff8e67fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e80720d0 0x7ff8e80cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40320/0 (socket says 172.21.15.118:40320) 2023-07-13T14:20:44.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.008+0000 7ff8e67fc700 1 -- 172.21.15.118:0/3213769288 learned_addr learned my addr 172.21.15.118:0/3213769288 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:44.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.014+0000 7ff8e67fc700 1 -- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e814f790 msgr2=0x7ff8e8154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.014+0000 7ff8e67fc700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8e814f790 0x7ff8e8154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.014+0000 7ff8e67fc700 1 -- 172.21.15.118:0/3213769288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8e8071cc0 msgr2=0x7ff8e80cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.014+0000 7ff8e67fc700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff8e8071cc0 0x7ff8e80cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.014+0000 7ff8e67fc700 1 -- 172.21.15.118:0/3213769288 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8009500 con 0x7ff8e80720d0 2023-07-13T14:20:44.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.017+0000 7ff8e67fc700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e80720d0 0x7ff8e80cb910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00c430 tx=0x7ff8dc00c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.021+0000 7ff8cf7fe700 1 -- 172.21.15.118:0/3213769288 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0052d0 con 0x7ff8e80720d0 2023-07-13T14:20:44.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.021+0000 7ff8cf7fe700 1 -- 172.21.15.118:0/3213769288 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc005450 con 0x7ff8e80720d0 2023-07-13T14:20:44.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.021+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e814d3a0 con 0x7ff8e80720d0 2023-07-13T14:20:44.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.021+0000 7ff8cf7fe700 1 -- 172.21.15.118:0/3213769288 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc006aa0 con 0x7ff8e80720d0 2023-07-13T14:20:44.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.021+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e814d960 con 0x7ff8e80720d0 2023-07-13T14:20:44.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.023+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8e80c6650 con 0x7ff8e80720d0 2023-07-13T14:20:44.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.041+0000 7ff8cf7fe700 1 -- 172.21.15.118:0/3213769288 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8dc003680 con 0x7ff8e80720d0 2023-07-13T14:20:44.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.041+0000 7ff8cf7fe700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff8d406ace0 0x7ff8d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.042+0000 7ff8e6ffd700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff8d406ace0 0x7ff8d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.042+0000 7ff8e6ffd700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff8d406ace0 0x7ff8d406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8006fd0 tx=0x7ff8d8010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.045+0000 7ff8cf7fe700 1 -- 172.21.15.118:0/3213769288 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff8dc05e2c0 con 0x7ff8e80720d0 2023-07-13T14:20:44.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.045+0000 7ff8cf7fe700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7ff8d40748f0 0x7ff8d4076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.045+0000 7ff8cf7fe700 1 -- 172.21.15.118:0/3213769288 --> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8d4077430 con 0x7ff8d40748f0 2023-07-13T14:20:44.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.045+0000 7ff8e77fe700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7ff8d40748f0 0x7ff8d4076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.046+0000 7ff8e77fe700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7ff8d40748f0 0x7ff8d4076d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.046+0000 7ff8cf7fe700 1 -- 172.21.15.118:0/3213769288 <== osd.6 v2:172.21.15.123:6800/381173612 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff8d4077430 con 0x7ff8d40748f0 2023-07-13T14:20:44.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 --> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff8e80c6370 con 0x7ff8d40748f0 2023-07-13T14:20:44.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8cf7fe700 1 -- 172.21.15.118:0/3213769288 <== osd.6 v2:172.21.15.123:6800/381173612 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff8e000f040 con 0x7ff8d40748f0 2023-07-13T14:20:44.055 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T14:20:44.055 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-13T14:20:44.055 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T14:20:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7ff8d40748f0 msgr2=0x7ff8d4076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:6800/381173612,v1:172.21.15.123:6801/381173612] conn(0x7ff8d40748f0 0x7ff8d4076d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff8d406ace0 msgr2=0x7ff8d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7ff8d406ace0 0x7ff8d406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8006fd0 tx=0x7ff8d8010000 comp rx=0 tx=0).stop 2023-07-13T14:20:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e80720d0 msgr2=0x7ff8e80cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 --2- 172.21.15.118:0/3213769288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8e80720d0 0x7ff8e80cb910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00c430 tx=0x7ff8dc00c740 comp rx=0 tx=0).stop 2023-07-13T14:20:44.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8e77fe700 1 -- 172.21.15.118:0/3213769288 reap_dead start 2023-07-13T14:20:44.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 shutdown_connections 2023-07-13T14:20:44.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 >> 172.21.15.118:0/3213769288 conn(0x7ff8e806cf60 msgr2=0x7ff8e80c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:44.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 shutdown_connections 2023-07-13T14:20:44.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.062+0000 7ff8ed77c700 1 -- 172.21.15.118:0/3213769288 wait complete. 2023-07-13T14:20:44.067 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-13T14:20:44.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.200+0000 7f66a4dde700 1 Processor -- start 2023-07-13T14:20:44.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.200+0000 7f66a4dde700 1 -- start start 2023-07-13T14:20:44.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.201+0000 7f66a4dde700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66a015c590 0x7f66a00c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.201+0000 7f66a4dde700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a00c59c0 con 0x7f66a00c9210 2023-07-13T14:20:44.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.201+0000 7f66a4dde700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a00c9710 con 0x7f66a0152ce0 2023-07-13T14:20:44.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.201+0000 7f66a4dde700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a01530b0 con 0x7f66a015c590 2023-07-13T14:20:44.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.202+0000 7f669ed9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66a015c590 0x7f66a00c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.202+0000 7f669e59c700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66a0152ce0 0x7f66a006ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:46432/0 (socket says 172.21.15.118:46432) 2023-07-13T14:20:44.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.202+0000 7f669e59c700 1 -- 172.21.15.118:0/1515670802 learned_addr learned my addr 172.21.15.118:0/1515670802 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:44.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.206+0000 7f669d59a700 1 -- 172.21.15.118:0/1515670802 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119822251 0 0) 0x7f66a00c9710 con 0x7f66a0152ce0 2023-07-13T14:20:44.198 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.206+0000 7f669d59a700 1 -- 172.21.15.118:0/1515670802 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66880035b0 con 0x7f66a0152ce0 2023-07-13T14:20:44.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.207+0000 7f669ed9d700 1 -- 172.21.15.118:0/1515670802 >> v1:172.21.15.123:6789/0 conn(0x7f66a0152ce0 legacy=0x7f66a006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.207+0000 7f669ed9d700 1 -- 172.21.15.118:0/1515670802 >> v1:172.21.15.118:6789/0 conn(0x7f66a00c9210 legacy=0x7f66a015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.207+0000 7f669ed9d700 1 -- 172.21.15.118:0/1515670802 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a0158990 con 0x7f66a015c590 2023-07-13T14:20:44.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.210+0000 7f669ed9d700 1 --2- 172.21.15.118:0/1515670802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 0x7f66a00c4ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6698009d90 tx=0x7f669800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46c02ab9496a53a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.218+0000 7f669d59a700 1 -- 172.21.15.118:0/1515670802 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800e070 con 0x7f66a015c590 2023-07-13T14:20:44.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.218+0000 7f669d59a700 1 -- 172.21.15.118:0/1515670802 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669800bb20 con 0x7f66a015c590 2023-07-13T14:20:44.209 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.218+0000 7f669d59a700 1 -- 172.21.15.118:0/1515670802 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698012430 con 0x7f66a015c590 2023-07-13T14:20:44.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 -- 172.21.15.118:0/1515670802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 msgr2=0x7f66a00c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 --2- 172.21.15.118:0/1515670802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 0x7f66a00c4ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6698009d90 tx=0x7f669800b330 comp rx=0 tx=0).stop 2023-07-13T14:20:44.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 -- 172.21.15.118:0/1515670802 shutdown_connections 2023-07-13T14:20:44.210 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 --2- 172.21.15.118:0/1515670802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 0x7f66a00c4ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.211 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 -- 172.21.15.118:0/1515670802 >> 172.21.15.118:0/1515670802 conn(0x7f66a006c7c0 msgr2=0x7f66a0071660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:44.211 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 -- 172.21.15.118:0/1515670802 shutdown_connections 2023-07-13T14:20:44.211 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 -- 172.21.15.118:0/1515670802 wait complete. 2023-07-13T14:20:44.211 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 Processor -- start 2023-07-13T14:20:44.211 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.219+0000 7f66a4dde700 1 -- start start 2023-07-13T14:20:44.212 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f66a4dde700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00c9210 0x7f66a00c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.212 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f66a4dde700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0152ce0 0x7f66a01463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.212 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f66a4dde700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 0x7f66a0146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.213 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f66a4dde700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00c7240 con 0x7f66a00c9210 2023-07-13T14:20:44.213 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f66a4dde700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00c8a90 con 0x7f66a015c590 2023-07-13T14:20:44.213 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f66a4dde700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00c8040 con 0x7f66a0152ce0 2023-07-13T14:20:44.213 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f669e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00c9210 0x7f66a00c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f669dd9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0152ce0 0x7f66a01463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f669ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 0x7f66a0146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f669e59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00c9210 0x7f66a00c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49356/0 (socket says 172.21.15.118:49356) 2023-07-13T14:20:44.214 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.221+0000 7f669e59c700 1 -- 172.21.15.118:0/2428291167 learned_addr learned my addr 172.21.15.118:0/2428291167 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:44.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.226+0000 7f669ed9d700 1 -- 172.21.15.118:0/2428291167 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0152ce0 msgr2=0x7f66a01463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.217 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.226+0000 7f669ed9d700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0152ce0 0x7f66a01463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.226+0000 7f669ed9d700 1 -- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00c9210 msgr2=0x7f66a00c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.226+0000 7f669ed9d700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00c9210 0x7f66a00c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.226+0000 7f669ed9d700 1 -- 172.21.15.118:0/2428291167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6698009a70 con 0x7f66a015c590 2023-07-13T14:20:44.219 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.228+0000 7f669ed9d700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 0x7f66a0146910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6698016000 tx=0x7f6698004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.232+0000 7f668effd700 1 -- 172.21.15.118:0/2428291167 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698012430 con 0x7f66a015c590 2023-07-13T14:20:44.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.232+0000 7f668effd700 1 -- 172.21.15.118:0/2428291167 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698020070 con 0x7f66a015c590 2023-07-13T14:20:44.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.232+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a00c6630 con 0x7f66a015c590 2023-07-13T14:20:44.224 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.232+0000 7f668effd700 1 -- 172.21.15.118:0/2428291167 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698004280 con 0x7f66a015c590 2023-07-13T14:20:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.232+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a00c6bf0 con 0x7f66a015c590 2023-07-13T14:20:44.225 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.234+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a00b48c0 con 0x7f66a015c590 2023-07-13T14:20:44.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.429+0000 7f668effd700 1 -- 172.21.15.118:0/2428291167 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66980043e0 con 0x7f66a015c590 2023-07-13T14:20:44.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.429+0000 7f668effd700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f668006ad30 0x7f668006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.430+0000 7f669e59c700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f668006ad30 0x7f668006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.430+0000 7f669e59c700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f668006ad30 0x7f668006d1e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66900011e0 tx=0x7f6690009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.485+0000 7f668effd700 1 -- 172.21.15.118:0/2428291167 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6698022070 con 0x7f66a015c590 2023-07-13T14:20:44.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.495+0000 7f668effd700 1 -- 172.21.15.118:0/2428291167 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6698056890 con 0x7f66a015c590 2023-07-13T14:20:44.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.701+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f66a0158f50 con 0x7f668006ad30 2023-07-13T14:20:44.693 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.701+0000 7f668effd700 1 -- 172.21.15.118:0/2428291167 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f669000f690 con 0x7f668006ad30 2023-07-13T14:20:44.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f668006ad30 msgr2=0x7f668006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f668006ad30 0x7f668006d1e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66900011e0 tx=0x7f6690009040 comp rx=0 tx=0).stop 2023-07-13T14:20:44.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 msgr2=0x7f66a0146910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 0x7f66a0146910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6698016000 tx=0x7f6698004ad0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 shutdown_connections 2023-07-13T14:20:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f668006ad30 0x7f668006d1e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a015c590 0x7f66a0146910 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66a00c9210 0x7f66a00c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 --2- 172.21.15.118:0/2428291167 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0152ce0 0x7f66a01463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 >> 172.21.15.118:0/2428291167 conn(0x7f66a006c7c0 msgr2=0x7f66a01502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 shutdown_connections 2023-07-13T14:20:44.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.703+0000 7f66a4dde700 1 -- 172.21.15.118:0/2428291167 wait complete. 2023-07-13T14:20:44.697 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 6 to deep-scrub 2023-07-13T14:20:44.707 INFO:tasks.ceph:Scrubbing osd.7 2023-07-13T14:20:44.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-13T14:20:44.833 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.842+0000 7fe777957700 1 Processor -- start 2023-07-13T14:20:44.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.842+0000 7fe777957700 1 -- start start 2023-07-13T14:20:44.834 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.843+0000 7fe777957700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7701507d0 0x7fe77015a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.843+0000 7fe777957700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe7700c6fc0 0x7fe7700c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.843+0000 7fe777957700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7700c7900 con 0x7fe7701565e0 2023-07-13T14:20:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.843+0000 7fe777957700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7700c1820 con 0x7fe7700c6fc0 2023-07-13T14:20:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.843+0000 7fe777957700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7700c1b00 con 0x7fe7701507d0 2023-07-13T14:20:44.835 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.844+0000 7fe7756f3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7701507d0 0x7fe77015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.844+0000 7fe7756f3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7701507d0 0x7fe77015a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:59608/0 (socket says 172.21.15.118:59608) 2023-07-13T14:20:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.844+0000 7fe7756f3700 1 -- 172.21.15.118:0/3071081797 learned_addr learned my addr 172.21.15.118:0/3071081797 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:44.836 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.844+0000 7fe775ef4700 1 --2- 172.21.15.118:0/3071081797 >> v2:172.21.15.118:3300/0 conn(0x7fe7700c6fc0 0x7fe7700c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.838 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.847+0000 7fe7756f3700 1 -- 172.21.15.118:0/3071081797 >> v2:172.21.15.118:3300/0 conn(0x7fe7700c6fc0 msgr2=0x7fe7700c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:44.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.847+0000 7fe7756f3700 1 --2- 172.21.15.118:0/3071081797 >> v2:172.21.15.118:3300/0 conn(0x7fe7700c6fc0 0x7fe7700c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.847+0000 7fe7756f3700 1 -- 172.21.15.118:0/3071081797 >> v1:172.21.15.118:6789/0 conn(0x7fe7701565e0 legacy=0x7fe77006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.839 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.847+0000 7fe7756f3700 1 -- 172.21.15.118:0/3071081797 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700c1de0 con 0x7fe7701507d0 2023-07-13T14:20:44.840 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.849+0000 7fe7756f3700 1 --2- 172.21.15.118:0/3071081797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7701507d0 0x7fe77015a500 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe770071cd0 tx=0x7fe760009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f83c962c425fff21 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.851+0000 7fe767fff700 1 -- 172.21.15.118:0/3071081797 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760011830 con 0x7fe7701507d0 2023-07-13T14:20:44.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.853+0000 7fe767fff700 1 -- 172.21.15.118:0/3071081797 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760011990 con 0x7fe7701507d0 2023-07-13T14:20:44.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.853+0000 7fe767fff700 1 -- 172.21.15.118:0/3071081797 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760011d20 con 0x7fe7701507d0 2023-07-13T14:20:44.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.854+0000 7fe777957700 1 -- 172.21.15.118:0/3071081797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7701507d0 msgr2=0x7fe77015a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.845 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.854+0000 7fe777957700 1 --2- 172.21.15.118:0/3071081797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7701507d0 0x7fe77015a500 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe770071cd0 tx=0x7fe760009bd0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.854+0000 7fe777957700 1 -- 172.21.15.118:0/3071081797 shutdown_connections 2023-07-13T14:20:44.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.854+0000 7fe777957700 1 --2- 172.21.15.118:0/3071081797 >> v2:172.21.15.118:3300/0 conn(0x7fe7700c6fc0 0x7fe7700c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.854+0000 7fe777957700 1 --2- 172.21.15.118:0/3071081797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7701507d0 0x7fe77015a500 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.854+0000 7fe777957700 1 -- 172.21.15.118:0/3071081797 >> 172.21.15.118:0/3071081797 conn(0x7fe77006e060 msgr2=0x7fe77006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:44.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.854+0000 7fe777957700 1 -- 172.21.15.118:0/3071081797 shutdown_connections 2023-07-13T14:20:44.846 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.854+0000 7fe777957700 1 -- 172.21.15.118:0/3071081797 wait complete. 2023-07-13T14:20:44.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.855+0000 7fe777957700 1 Processor -- start 2023-07-13T14:20:44.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.855+0000 7fe777957700 1 -- start start 2023-07-13T14:20:44.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.856+0000 7fe777957700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7700c6fc0 0x7fe770141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.856+0000 7fe777957700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7701507d0 0x7fe770148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.856+0000 7fe777957700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7701565e0 0x7fe7701ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.856+0000 7fe777957700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700c4fa0 con 0x7fe7701565e0 2023-07-13T14:20:44.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.856+0000 7fe777957700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700c62c0 con 0x7fe7700c6fc0 2023-07-13T14:20:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.856+0000 7fe777957700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700c53d0 con 0x7fe7701507d0 2023-07-13T14:20:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.856+0000 7fe775ef4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7701565e0 0x7fe7701ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.857+0000 7fe774ef2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7701507d0 0x7fe770148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.857+0000 7fe7756f3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7700c6fc0 0x7fe770141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.857+0000 7fe775ef4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7701565e0 0x7fe7701ef500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49370/0 (socket says 172.21.15.118:49370) 2023-07-13T14:20:44.849 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.857+0000 7fe775ef4700 1 -- 172.21.15.118:0/3560284924 learned_addr learned my addr 172.21.15.118:0/3560284924 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.861+0000 7fe775ef4700 1 -- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7701507d0 msgr2=0x7fe770148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.861+0000 7fe775ef4700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7701507d0 0x7fe770148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.861+0000 7fe775ef4700 1 -- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7700c6fc0 msgr2=0x7fe770141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.861+0000 7fe775ef4700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7700c6fc0 0x7fe770141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.861+0000 7fe775ef4700 1 -- 172.21.15.118:0/3560284924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760009550 con 0x7fe7701565e0 2023-07-13T14:20:44.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.863+0000 7fe775ef4700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7701565e0 0x7fe7701ef500 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe76800efc0 tx=0x7fe76800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.867+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768009ea0 con 0x7fe7701565e0 2023-07-13T14:20:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.867+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76800f040 con 0x7fe7701565e0 2023-07-13T14:20:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.867+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7700c56b0 con 0x7fe7701565e0 2023-07-13T14:20:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.867+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800ced0 con 0x7fe7701565e0 2023-07-13T14:20:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.867+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7700c5c70 con 0x7fe7701565e0 2023-07-13T14:20:44.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.868+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe770159fe0 con 0x7fe7701565e0 2023-07-13T14:20:44.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.887+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe768014480 con 0x7fe7701565e0 2023-07-13T14:20:44.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.888+0000 7fe765ffb700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe75406ad30 0x7fe75406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.888+0000 7fe7756f3700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe75406ad30 0x7fe75406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.888+0000 7fe7756f3700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe75406ad30 0x7fe75406d1e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe760009c10 tx=0x7fe760008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.893+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe76805d640 con 0x7fe7701565e0 2023-07-13T14:20:44.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.894+0000 7fe765ffb700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7fe7540748d0 0x7fe754076d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:44.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.894+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 --> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe754077410 con 0x7fe7540748d0 2023-07-13T14:20:44.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.894+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7680559c0 con 0x7fe7701565e0 2023-07-13T14:20:44.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.894+0000 7fe774ef2700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7fe7540748d0 0x7fe754076d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:44.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.894+0000 7fe774ef2700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7fe7540748d0 0x7fe754076d40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:44.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.895+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 <== osd.7 v2:172.21.15.123:6824/4183445338 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe754077410 con 0x7fe7540748d0 2023-07-13T14:20:44.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.909+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 --> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe770159d00 con 0x7fe7540748d0 2023-07-13T14:20:44.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.909+0000 7fe765ffb700 1 -- 172.21.15.118:0/3560284924 <== osd.7 v2:172.21.15.123:6824/4183445338 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe76c0014c0 con 0x7fe7540748d0 2023-07-13T14:20:44.901 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2023-07-13T14:20:44.901 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-13T14:20:44.901 INFO:teuthology.orchestra.run.smithi118.stdout:} 2023-07-13T14:20:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.909+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7fe7540748d0 msgr2=0x7fe754076d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.123:6824/4183445338,v1:172.21.15.123:6825/4183445338] conn(0x7fe7540748d0 0x7fe754076d40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe75406ad30 msgr2=0x7fe75406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.902 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fe75406ad30 0x7fe75406d1e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe760009c10 tx=0x7fe760008030 comp rx=0 tx=0).stop 2023-07-13T14:20:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7701565e0 msgr2=0x7fe7701ef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 --2- 172.21.15.118:0/3560284924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7701565e0 0x7fe7701ef500 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe76800efc0 tx=0x7fe76800c3a0 comp rx=0 tx=0).stop 2023-07-13T14:20:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe775ef4700 1 -- 172.21.15.118:0/3560284924 reap_dead start 2023-07-13T14:20:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 shutdown_connections 2023-07-13T14:20:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 >> 172.21.15.118:0/3560284924 conn(0x7fe77006e060 msgr2=0x7fe77006fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 shutdown_connections 2023-07-13T14:20:44.903 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:44.910+0000 7fe777957700 1 -- 172.21.15.118:0/3560284924 wait complete. 2023-07-13T14:20:44.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-13T14:20:45.034 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.043+0000 7f99e8982700 1 Processor -- start 2023-07-13T14:20:45.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.043+0000 7f99e8982700 1 -- start start 2023-07-13T14:20:45.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.044+0000 7f99e8982700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e40c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.035 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.044+0000 7f99e8982700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99e41590f0 0x7f99e40c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.044+0000 7f99e8982700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40c6c60 con 0x7f99e4152850 2023-07-13T14:20:45.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.044+0000 7f99e8982700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e406f1b0 con 0x7f99e41590f0 2023-07-13T14:20:45.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.044+0000 7f99e8982700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40c66a0 con 0x7f99e406f380 2023-07-13T14:20:45.036 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.044+0000 7f99e1d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e40c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.044+0000 7f99e2d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f99e41590f0 0x7f99e40c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.045+0000 7f99e1d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e40c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:40352/0 (socket says 172.21.15.118:40352) 2023-07-13T14:20:45.037 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.045+0000 7f99e1d9b700 1 -- 172.21.15.118:0/1687514907 learned_addr learned my addr 172.21.15.118:0/1687514907 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:45.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.047+0000 7f99e1d9b700 1 -- 172.21.15.118:0/1687514907 >> v2:172.21.15.118:3300/0 conn(0x7f99e41590f0 msgr2=0x7f99e40c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:45.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.047+0000 7f99e1d9b700 1 --2- 172.21.15.118:0/1687514907 >> v2:172.21.15.118:3300/0 conn(0x7f99e41590f0 0x7f99e40c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.047+0000 7f99e1d9b700 1 -- 172.21.15.118:0/1687514907 >> v1:172.21.15.118:6789/0 conn(0x7f99e4152850 legacy=0x7f99e406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.047+0000 7f99e1d9b700 1 -- 172.21.15.118:0/1687514907 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40c6980 con 0x7f99e406f380 2023-07-13T14:20:45.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.049+0000 7f99e1d9b700 1 --2- 172.21.15.118:0/1687514907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e40c5d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f99d80098f0 tx=0x7f99d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef540640ad8097c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:45.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.053+0000 7f99e159a700 1 -- 172.21.15.118:0/1687514907 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8011830 con 0x7f99e406f380 2023-07-13T14:20:45.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.053+0000 7f99e159a700 1 -- 172.21.15.118:0/1687514907 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8011990 con 0x7f99e406f380 2023-07-13T14:20:45.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.053+0000 7f99e159a700 1 -- 172.21.15.118:0/1687514907 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8011d20 con 0x7f99e406f380 2023-07-13T14:20:45.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.054+0000 7f99e8982700 1 -- 172.21.15.118:0/1687514907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 msgr2=0x7f99e40c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.054+0000 7f99e8982700 1 --2- 172.21.15.118:0/1687514907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e40c5d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f99d80098f0 tx=0x7f99d8009c00 comp rx=0 tx=0).stop 2023-07-13T14:20:45.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.054+0000 7f99e8982700 1 -- 172.21.15.118:0/1687514907 shutdown_connections 2023-07-13T14:20:45.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.054+0000 7f99e8982700 1 --2- 172.21.15.118:0/1687514907 >> v2:172.21.15.118:3300/0 conn(0x7f99e41590f0 0x7f99e40c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.054+0000 7f99e8982700 1 --2- 172.21.15.118:0/1687514907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e40c5d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.054+0000 7f99e8982700 1 -- 172.21.15.118:0/1687514907 >> 172.21.15.118:0/1687514907 conn(0x7f99e4070d40 msgr2=0x7f99e4071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:45.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.054+0000 7f99e8982700 1 -- 172.21.15.118:0/1687514907 shutdown_connections 2023-07-13T14:20:45.046 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.054+0000 7f99e8982700 1 -- 172.21.15.118:0/1687514907 wait complete. 2023-07-13T14:20:45.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.055+0000 7f99e8982700 1 Processor -- start 2023-07-13T14:20:45.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.055+0000 7f99e8982700 1 -- start start 2023-07-13T14:20:45.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.056+0000 7f99e8982700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e4158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.056+0000 7f99e8982700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4152850 0x7f99e41e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.056+0000 7f99e8982700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99e41590f0 0x7f99e415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.056+0000 7f99e8982700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4158ca0 con 0x7f99e41590f0 2023-07-13T14:20:45.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.056+0000 7f99e8982700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e414de30 con 0x7f99e4152850 2023-07-13T14:20:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.056+0000 7f99e8982700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e41ee240 con 0x7f99e406f380 2023-07-13T14:20:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.057+0000 7f99e2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99e41590f0 0x7f99e415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.057+0000 7f99e259c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e4158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.057+0000 7f99e1d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4152850 0x7f99e41e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.049 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.057+0000 7f99e2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99e41590f0 0x7f99e415bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49390/0 (socket says 172.21.15.118:49390) 2023-07-13T14:20:45.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.057+0000 7f99e2d9d700 1 -- 172.21.15.118:0/932398801 learned_addr learned my addr 172.21.15.118:0/932398801 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:45.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.061+0000 7f99e2d9d700 1 -- 172.21.15.118:0/932398801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 msgr2=0x7f99e4158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.061+0000 7f99e2d9d700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e4158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.061+0000 7f99e2d9d700 1 -- 172.21.15.118:0/932398801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4152850 msgr2=0x7f99e41e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.052 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.061+0000 7f99e2d9d700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4152850 0x7f99e41e4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.061+0000 7f99e2d9d700 1 -- 172.21.15.118:0/932398801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8009550 con 0x7f99e41590f0 2023-07-13T14:20:45.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.063+0000 7f99e2d9d700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99e41590f0 0x7f99e415bfc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00efc0 tx=0x7f99dc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:45.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.065+0000 7f99d2ffd700 1 -- 172.21.15.118:0/932398801 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc00cad0 con 0x7f99e41590f0 2023-07-13T14:20:45.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.065+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e41f2260 con 0x7f99e41590f0 2023-07-13T14:20:45.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.065+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e41ee500 con 0x7f99e41590f0 2023-07-13T14:20:45.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.066+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e40c5750 con 0x7f99e41590f0 2023-07-13T14:20:45.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.067+0000 7f99d2ffd700 1 -- 172.21.15.118:0/932398801 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc00f040 con 0x7f99e41590f0 2023-07-13T14:20:45.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.067+0000 7f99d2ffd700 1 -- 172.21.15.118:0/932398801 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc00ce30 con 0x7f99e41590f0 2023-07-13T14:20:45.233 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.242+0000 7f99d2ffd700 1 -- 172.21.15.118:0/932398801 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99dc014480 con 0x7f99e41590f0 2023-07-13T14:20:45.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.242+0000 7f99d2ffd700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f99c406ace0 0x7f99c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.242+0000 7f99d2ffd700 1 -- 172.21.15.118:0/932398801 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f99dc08a7b0 con 0x7f99e41590f0 2023-07-13T14:20:45.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.242+0000 7f99e259c700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f99c406ace0 0x7f99c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.234 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.243+0000 7f99e259c700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f99c406ace0 0x7f99c406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99d4007fd0 tx=0x7f99d4009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:45.352 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.361+0000 7f99d2ffd700 1 -- 172.21.15.118:0/932398801 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99dc055390 con 0x7f99e41590f0 2023-07-13T14:20:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.563+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f99e406e580 con 0x7f99c406ace0 2023-07-13T14:20:45.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.563+0000 7f99d2ffd700 1 -- 172.21.15.118:0/932398801 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f99d4001560 con 0x7f99c406ace0 2023-07-13T14:20:45.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f99c406ace0 msgr2=0x7f99c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f99c406ace0 0x7f99c406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99d4007fd0 tx=0x7f99d4009040 comp rx=0 tx=0).stop 2023-07-13T14:20:45.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99e41590f0 msgr2=0x7f99e415bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99e41590f0 0x7f99e415bfc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00efc0 tx=0x7f99dc00c0c0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 shutdown_connections 2023-07-13T14:20:45.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f99c406ace0 0x7f99c406d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f99e41590f0 0x7f99e415bfc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99e406f380 0x7f99e4158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 --2- 172.21.15.118:0/932398801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99e4152850 0x7f99e41e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 >> 172.21.15.118:0/932398801 conn(0x7f99e4070d40 msgr2=0x7f99e406e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:45.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 shutdown_connections 2023-07-13T14:20:45.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.565+0000 7f99e8982700 1 -- 172.21.15.118:0/932398801 wait complete. 2023-07-13T14:20:45.559 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 7 to deep-scrub 2023-07-13T14:20:45.569 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T14:20:45.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.707+0000 7feb9a838700 1 Processor -- start 2023-07-13T14:20:45.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.707+0000 7feb9a838700 1 -- start start 2023-07-13T14:20:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.707+0000 7feb9a838700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feb940c9d90 0x7feb94163ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.707+0000 7feb9a838700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940c8b40 con 0x7feb940c90c0 2023-07-13T14:20:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.707+0000 7feb9a838700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940ca910 con 0x7feb940c99c0 2023-07-13T14:20:45.699 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.707+0000 7feb9a838700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9406c080 con 0x7feb940c9d90 2023-07-13T14:20:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.708+0000 7feb937fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7feb940c90c0 0x7feb94158390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:45142/0 (socket says 172.21.15.118:45142) 2023-07-13T14:20:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.708+0000 7feb937fe700 1 -- 172.21.15.118:0/2198944832 learned_addr learned my addr 172.21.15.118:0/2198944832 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:20:45.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.708+0000 7feb98dd5700 1 --2- 172.21.15.118:0/2198944832 >> v2:172.21.15.123:3300/0 conn(0x7feb940c9d90 0x7feb94163ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.711+0000 7feb98dd5700 1 -- 172.21.15.118:0/2198944832 >> v1:172.21.15.123:6789/0 conn(0x7feb940c99c0 legacy=0x7feb940c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:20:45.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.711+0000 7feb98dd5700 1 -- 172.21.15.118:0/2198944832 >> v1:172.21.15.118:6789/0 conn(0x7feb940c90c0 legacy=0x7feb94158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.711+0000 7feb92ffd700 1 -- 172.21.15.118:0/2198944832 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489642438 0 0) 0x7feb940c8b40 con 0x7feb940c90c0 2023-07-13T14:20:45.703 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.711+0000 7feb98dd5700 1 -- 172.21.15.118:0/2198944832 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940c9560 con 0x7feb940c9d90 2023-07-13T14:20:45.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.716+0000 7feb98dd5700 1 --2- 172.21.15.118:0/2198944832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 0x7feb94163ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009d90 tx=0x7feb8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a87b6c485c18ded2 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:45.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.724+0000 7feb92ffd700 1 -- 172.21.15.118:0/2198944832 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c00e070 con 0x7feb940c9d90 2023-07-13T14:20:45.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.724+0000 7feb92ffd700 1 -- 172.21.15.118:0/2198944832 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c00bb90 con 0x7feb940c9d90 2023-07-13T14:20:45.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.724+0000 7feb92ffd700 1 -- 172.21.15.118:0/2198944832 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c003a20 con 0x7feb940c9d90 2023-07-13T14:20:45.716 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.725+0000 7feb9a838700 1 -- 172.21.15.118:0/2198944832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 msgr2=0x7feb94163ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.716 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.725+0000 7feb9a838700 1 --2- 172.21.15.118:0/2198944832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 0x7feb94163ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009d90 tx=0x7feb8c00b330 comp rx=0 tx=0).stop 2023-07-13T14:20:45.716 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.725+0000 7feb9a838700 1 -- 172.21.15.118:0/2198944832 shutdown_connections 2023-07-13T14:20:45.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.725+0000 7feb9a838700 1 --2- 172.21.15.118:0/2198944832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 0x7feb94163ce0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.725+0000 7feb9a838700 1 -- 172.21.15.118:0/2198944832 >> 172.21.15.118:0/2198944832 conn(0x7feb9406c750 msgr2=0x7feb9406cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:45.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.725+0000 7feb9a838700 1 -- 172.21.15.118:0/2198944832 shutdown_connections 2023-07-13T14:20:45.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.725+0000 7feb9a838700 1 -- 172.21.15.118:0/2198944832 wait complete. 2023-07-13T14:20:45.717 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.726+0000 7feb9a838700 1 Processor -- start 2023-07-13T14:20:45.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.726+0000 7feb9a838700 1 -- start start 2023-07-13T14:20:45.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.727+0000 7feb9a838700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb940c90c0 0x7feb94152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.718 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.727+0000 7feb9a838700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb940c99c0 0x7feb941f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.727+0000 7feb9a838700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 0x7feb941eeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.727+0000 7feb9a838700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb94155000 con 0x7feb940c90c0 2023-07-13T14:20:45.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.727+0000 7feb9a838700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb941f1bc0 con 0x7feb940c9d90 2023-07-13T14:20:45.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.727+0000 7feb9a838700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb941f18e0 con 0x7feb940c99c0 2023-07-13T14:20:45.719 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.727+0000 7feb93fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb940c90c0 0x7feb94152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.727+0000 7feb98dd5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 0x7feb941eeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.728+0000 7feb93fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb940c90c0 0x7feb94152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49394/0 (socket says 172.21.15.118:49394) 2023-07-13T14:20:45.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.728+0000 7feb93fff700 1 -- 172.21.15.118:0/1949196266 learned_addr learned my addr 172.21.15.118:0/1949196266 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:20:45.720 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.728+0000 7feb937fe700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb940c99c0 0x7feb941f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.723 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.732+0000 7feb98dd5700 1 -- 172.21.15.118:0/1949196266 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb940c99c0 msgr2=0x7feb941f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.723 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.732+0000 7feb98dd5700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb940c99c0 0x7feb941f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.723 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.732+0000 7feb98dd5700 1 -- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb940c90c0 msgr2=0x7feb94152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:45.723 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.732+0000 7feb98dd5700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb940c90c0 0x7feb94152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:45.724 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.732+0000 7feb98dd5700 1 -- 172.21.15.118:0/1949196266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c009a70 con 0x7feb940c9d90 2023-07-13T14:20:45.725 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.734+0000 7feb98dd5700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 0x7feb941eeb70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feb9406a2b0 tx=0x7feb8c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:45.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.738+0000 7feb90ff9700 1 -- 172.21.15.118:0/1949196266 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c012430 con 0x7feb940c9d90 2023-07-13T14:20:45.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.738+0000 7feb90ff9700 1 -- 172.21.15.118:0/1949196266 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c0125b0 con 0x7feb940c9d90 2023-07-13T14:20:45.729 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.738+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb94153f20 con 0x7feb940c9d90 2023-07-13T14:20:45.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.738+0000 7feb90ff9700 1 -- 172.21.15.118:0/1949196266 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c012960 con 0x7feb940c9d90 2023-07-13T14:20:45.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.738+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb941544e0 con 0x7feb940c9d90 2023-07-13T14:20:45.730 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.739+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb94153d80 con 0x7feb940c9d90 2023-07-13T14:20:45.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.757+0000 7feb90ff9700 1 -- 172.21.15.118:0/1949196266 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb8c02e420 con 0x7feb940c9d90 2023-07-13T14:20:45.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.757+0000 7feb90ff9700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feb8006ad30 0x7feb8006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:20:45.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.758+0000 7feb93fff700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feb8006ad30 0x7feb8006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:20:45.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.758+0000 7feb93fff700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feb8006ad30 0x7feb8006d1e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb84003ac0 tx=0x7feb84003a50 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:20:45.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.764+0000 7feb90ff9700 1 -- 172.21.15.118:0/1949196266 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feb8c05ea00 con 0x7feb940c9d90 2023-07-13T14:20:45.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:45.997+0000 7feb90ff9700 1 -- 172.21.15.118:0/1949196266 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb8c05a810 con 0x7feb940c9d90 2023-07-13T14:20:46.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.181+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb940cec80 con 0x7feb8006ad30 2023-07-13T14:20:46.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.191+0000 7feb90ff9700 1 -- 172.21.15.118:0/1949196266 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391602 (secure 0 0 0) 0x7feb8400f640 con 0x7feb8006ad30 2023-07-13T14:20:46.186 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:20:46.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feb8006ad30 msgr2=0x7feb8006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:46.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feb8006ad30 0x7feb8006d1e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb84003ac0 tx=0x7feb84003a50 comp rx=0 tx=0).stop 2023-07-13T14:20:46.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 msgr2=0x7feb941eeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:20:46.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 0x7feb941eeb70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feb9406a2b0 tx=0x7feb8c004ad0 comp rx=0 tx=0).stop 2023-07-13T14:20:46.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 shutdown_connections 2023-07-13T14:20:46.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7feb8006ad30 0x7feb8006d1e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:46.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb940c9d90 0x7feb941eeb70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:46.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feb940c90c0 0x7feb94152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:46.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 --2- 172.21.15.118:0/1949196266 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb940c99c0 0x7feb941f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:20:46.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 >> 172.21.15.118:0/1949196266 conn(0x7feb9406c750 msgr2=0x7feb940ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:20:46.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 shutdown_connections 2023-07-13T14:20:46.189 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:20:46.194+0000 7feb9a838700 1 -- 172.21.15.118:0/1949196266 wait complete. 2023-07-13T14:20:46.190 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T14:20:46.198 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":884,"stamp":"2023-07-13T14:20:45.300214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35755431,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":925,"num_read_kb":952,"num_write":11483,"num_write_kb":323812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13364,"ondisk_log_size":13364,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406344,"kb_used_data":50824,"kb_used_omap":13,"kb_used_meta":355442,"kb_avail":754568376,"statfs":{"total":773094113280,"available":772678017024,"internally_reserved":0,"allocated":52043776,"data_stored":72647622,"data_compressed":6272288,"data_compressed_allocated":9814016,"data_compressed_original":32006144,"omap_allocated":14248,"internal_metadata":363972696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002964"},"pg_stats":[{"pgid":"4.3f","version":"31'26","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071085+0000","last_change":"2023-07-13T13:52:17.926057+0000","last_active":"2023-07-13T14:20:29.071085+0000","last_peered":"2023-07-13T14:20:29.071085+0000","last_clean":"2023-07-13T14:20:29.071085+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T14:20:29.071085+0000","last_undegraded":"2023-07-13T14:20:29.071085+0000","last_fullsized":"2023-07-13T14:20:29.071085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"31'31","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.030541+0000","last_change":"2023-07-13T13:52:17.952706+0000","last_active":"2023-07-13T14:20:29.030541+0000","last_peered":"2023-07-13T14:20:29.030541+0000","last_clean":"2023-07-13T14:20:29.030541+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T14:20:29.030541+0000","last_undegraded":"2023-07-13T14:20:29.030541+0000","last_fullsized":"2023-07-13T14:20:29.030541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:47.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052353+0000","last_change":"2023-07-13T13:52:17.943505+0000","last_active":"2023-07-13T14:20:29.052353+0000","last_peered":"2023-07-13T14:20:29.052353+0000","last_clean":"2023-07-13T14:20:29.052353+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T14:20:29.052353+0000","last_undegraded":"2023-07-13T14:20:29.052353+0000","last_fullsized":"2023-07-13T14:20:29.052353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:57:33.638855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"31'25","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.116236+0000","last_change":"2023-07-13T13:52:17.933893+0000","last_active":"2023-07-13T14:20:29.116236+0000","last_peered":"2023-07-13T14:20:29.116236+0000","last_clean":"2023-07-13T14:20:29.116236+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T14:20:29.116236+0000","last_undegraded":"2023-07-13T14:20:29.116236+0000","last_fullsized":"2023-07-13T14:20:29.116236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:37:29.189222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"31'23","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227708+0000","last_change":"2023-07-13T13:52:17.886730+0000","last_active":"2023-07-13T14:20:29.227708+0000","last_peered":"2023-07-13T14:20:29.227708+0000","last_clean":"2023-07-13T14:20:29.227708+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T14:20:29.227708+0000","last_undegraded":"2023-07-13T14:20:29.227708+0000","last_fullsized":"2023-07-13T14:20:29.227708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.042967+0000","last_change":"2023-07-13T13:52:17.942599+0000","last_active":"2023-07-13T14:20:29.042967+0000","last_peered":"2023-07-13T14:20:29.042967+0000","last_clean":"2023-07-13T14:20:29.042967+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T14:20:29.042967+0000","last_undegraded":"2023-07-13T14:20:29.042967+0000","last_fullsized":"2023-07-13T14:20:29.042967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:15:36.932887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071363+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T14:20:29.071363+0000","last_peered":"2023-07-13T14:20:29.071363+0000","last_clean":"2023-07-13T14:20:29.071363+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T14:20:29.071363+0000","last_undegraded":"2023-07-13T14:20:29.071363+0000","last_fullsized":"2023-07-13T14:20:29.071363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:29.831587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"31'22","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037767+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T14:20:29.037767+0000","last_peered":"2023-07-13T14:20:29.037767+0000","last_clean":"2023-07-13T14:20:29.037767+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T14:20:29.037767+0000","last_undegraded":"2023-07-13T14:20:29.037767+0000","last_fullsized":"2023-07-13T14:20:29.037767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:05:01.082348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"31'35","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.224047+0000","last_change":"2023-07-13T13:52:58.032563+0000","last_active":"2023-07-13T14:20:29.224047+0000","last_peered":"2023-07-13T14:20:29.224047+0000","last_clean":"2023-07-13T14:20:29.224047+0000","last_became_active":"2023-07-13T13:52:58.032221+0000","last_became_peered":"2023-07-13T13:52:58.032221+0000","last_unstale":"2023-07-13T14:20:29.224047+0000","last_undegraded":"2023-07-13T14:20:29.224047+0000","last_fullsized":"2023-07-13T14:20:29.224047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'37","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.040091+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T14:20:29.040091+0000","last_peered":"2023-07-13T14:20:29.040091+0000","last_clean":"2023-07-13T14:20:29.040091+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T14:20:29.040091+0000","last_undegraded":"2023-07-13T14:20:29.040091+0000","last_fullsized":"2023-07-13T14:20:29.040091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"31'30","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.045065+0000","last_change":"2023-07-13T13:52:58.431745+0000","last_active":"2023-07-13T14:20:29.045065+0000","last_peered":"2023-07-13T14:20:29.045065+0000","last_clean":"2023-07-13T14:20:29.045065+0000","last_became_active":"2023-07-13T13:52:58.431466+0000","last_became_peered":"2023-07-13T13:52:58.431466+0000","last_unstale":"2023-07-13T14:20:29.045065+0000","last_undegraded":"2023-07-13T14:20:29.045065+0000","last_fullsized":"2023-07-13T14:20:29.045065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:27:08.861062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"31'22","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.070363+0000","last_change":"2023-07-13T13:52:17.943253+0000","last_active":"2023-07-13T14:20:29.070363+0000","last_peered":"2023-07-13T14:20:29.070363+0000","last_clean":"2023-07-13T14:20:29.070363+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T14:20:29.070363+0000","last_undegraded":"2023-07-13T14:20:29.070363+0000","last_fullsized":"2023-07-13T14:20:29.070363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"31'35","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071233+0000","last_change":"2023-07-13T13:52:17.925230+0000","last_active":"2023-07-13T14:20:29.071233+0000","last_peered":"2023-07-13T14:20:29.071233+0000","last_clean":"2023-07-13T14:20:29.071233+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T14:20:29.071233+0000","last_undegraded":"2023-07-13T14:20:29.071233+0000","last_fullsized":"2023-07-13T14:20:29.071233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'35","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037770+0000","last_change":"2023-07-13T13:52:17.925445+0000","last_active":"2023-07-13T14:20:29.037770+0000","last_peered":"2023-07-13T14:20:29.037770+0000","last_clean":"2023-07-13T14:20:29.037770+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T14:20:29.037770+0000","last_undegraded":"2023-07-13T14:20:29.037770+0000","last_fullsized":"2023-07-13T14:20:29.037770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:38:34.228527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"31'35","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071487+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T14:20:29.071487+0000","last_peered":"2023-07-13T14:20:29.071487+0000","last_clean":"2023-07-13T14:20:29.071487+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T14:20:29.071487+0000","last_undegraded":"2023-07-13T14:20:29.071487+0000","last_fullsized":"2023-07-13T14:20:29.071487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:33.058046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"31'33","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052262+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T14:20:29.052262+0000","last_peered":"2023-07-13T14:20:29.052262+0000","last_clean":"2023-07-13T14:20:29.052262+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T14:20:29.052262+0000","last_undegraded":"2023-07-13T14:20:29.052262+0000","last_fullsized":"2023-07-13T14:20:29.052262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:58:13.171516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"31'32","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219147+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T14:20:29.219147+0000","last_peered":"2023-07-13T14:20:29.219147+0000","last_clean":"2023-07-13T14:20:29.219147+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T14:20:29.219147+0000","last_undegraded":"2023-07-13T14:20:29.219147+0000","last_fullsized":"2023-07-13T14:20:29.219147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"31'42","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.053186+0000","last_change":"2023-07-13T13:52:17.942704+0000","last_active":"2023-07-13T14:20:29.053186+0000","last_peered":"2023-07-13T14:20:29.053186+0000","last_clean":"2023-07-13T14:20:29.053186+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T14:20:29.053186+0000","last_undegraded":"2023-07-13T14:20:29.053186+0000","last_fullsized":"2023-07-13T14:20:29.053186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:55:37.936044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.070037+0000","last_change":"2023-07-13T13:52:17.934990+0000","last_active":"2023-07-13T14:20:29.070037+0000","last_peered":"2023-07-13T14:20:29.070037+0000","last_clean":"2023-07-13T14:20:29.070037+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T14:20:29.070037+0000","last_undegraded":"2023-07-13T14:20:29.070037+0000","last_fullsized":"2023-07-13T14:20:29.070037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"31'36","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052769+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T14:20:29.052769+0000","last_peered":"2023-07-13T14:20:29.052769+0000","last_clean":"2023-07-13T14:20:29.052769+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T14:20:29.052769+0000","last_undegraded":"2023-07-13T14:20:29.052769+0000","last_fullsized":"2023-07-13T14:20:29.052769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:06:12.632230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"31'46","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071286+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T14:20:29.071286+0000","last_peered":"2023-07-13T14:20:29.071286+0000","last_clean":"2023-07-13T14:20:29.071286+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T14:20:29.071286+0000","last_undegraded":"2023-07-13T14:20:29.071286+0000","last_fullsized":"2023-07-13T14:20:29.071286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:34.535336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"31'34","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218078+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T14:20:29.218078+0000","last_peered":"2023-07-13T14:20:29.218078+0000","last_clean":"2023-07-13T14:20:29.218078+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T14:20:29.218078+0000","last_undegraded":"2023-07-13T14:20:29.218078+0000","last_fullsized":"2023-07-13T14:20:29.218078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"31'37","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.060231+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T14:20:29.060231+0000","last_peered":"2023-07-13T14:20:29.060231+0000","last_clean":"2023-07-13T14:20:29.060231+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T14:20:29.060231+0000","last_undegraded":"2023-07-13T14:20:29.060231+0000","last_fullsized":"2023-07-13T14:20:29.060231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:47.016707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071246+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T14:20:29.071246+0000","last_peered":"2023-07-13T14:20:29.071246+0000","last_clean":"2023-07-13T14:20:29.071246+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T14:20:29.071246+0000","last_undegraded":"2023-07-13T14:20:29.071246+0000","last_fullsized":"2023-07-13T14:20:29.071246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"31'27","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.228825+0000","last_change":"2023-07-13T13:52:17.951443+0000","last_active":"2023-07-13T14:20:29.228825+0000","last_peered":"2023-07-13T14:20:29.228825+0000","last_clean":"2023-07-13T14:20:29.228825+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T14:20:29.228825+0000","last_undegraded":"2023-07-13T14:20:29.228825+0000","last_fullsized":"2023-07-13T14:20:29.228825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"31'39","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230392+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T14:20:29.230392+0000","last_peered":"2023-07-13T14:20:29.230392+0000","last_clean":"2023-07-13T14:20:29.230392+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T14:20:29.230392+0000","last_undegraded":"2023-07-13T14:20:29.230392+0000","last_fullsized":"2023-07-13T14:20:29.230392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"31'23","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035220+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T14:20:29.035220+0000","last_peered":"2023-07-13T14:20:29.035220+0000","last_clean":"2023-07-13T14:20:29.035220+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T14:20:29.035220+0000","last_undegraded":"2023-07-13T14:20:29.035220+0000","last_fullsized":"2023-07-13T14:20:29.035220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:12.557056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"31'82","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573994+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T14:19:53.573994+0000","last_peered":"2023-07-13T14:19:53.573994+0000","last_clean":"2023-07-13T14:19:53.573994+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T14:19:53.573994+0000","last_undegraded":"2023-07-13T14:19:53.573994+0000","last_fullsized":"2023-07-13T14:19:53.573994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:29:36.180810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"31'645","reported_seq":683,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.802282+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T14:19:57.802282+0000","last_peered":"2023-07-13T14:19:57.802282+0000","last_clean":"2023-07-13T14:19:57.802282+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T14:19:57.802282+0000","last_undegraded":"2023-07-13T14:19:57.802282+0000","last_fullsized":"2023-07-13T14:19:57.802282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:50:15.899141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'42","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055906+0000","last_change":"2023-07-13T13:52:17.948432+0000","last_active":"2023-07-13T14:20:29.055906+0000","last_peered":"2023-07-13T14:20:29.055906+0000","last_clean":"2023-07-13T14:20:29.055906+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T14:20:29.055906+0000","last_undegraded":"2023-07-13T14:20:29.055906+0000","last_fullsized":"2023-07-13T14:20:29.055906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:45:09.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'125","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:48.633658+0000","last_change":"2023-07-13T13:52:23.984769+0000","last_active":"2023-07-13T14:19:48.633658+0000","last_peered":"2023-07-13T14:19:48.633658+0000","last_clean":"2023-07-13T14:19:48.633658+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T14:19:48.633658+0000","last_undegraded":"2023-07-13T14:19:48.633658+0000","last_fullsized":"2023-07-13T14:19:48.633658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:01:10.403090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":11569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:11.973184+0000","last_change":"2023-07-13T13:52:16.667863+0000","last_active":"2023-07-13T14:20:11.973184+0000","last_peered":"2023-07-13T14:20:11.973184+0000","last_clean":"2023-07-13T14:20:11.973184+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T14:20:11.973184+0000","last_undegraded":"2023-07-13T14:20:11.973184+0000","last_fullsized":"2023-07-13T14:20:11.973184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'20","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217374+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T14:20:29.217374+0000","last_peered":"2023-07-13T14:20:29.217374+0000","last_clean":"2023-07-13T14:20:29.217374+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T14:20:29.217374+0000","last_undegraded":"2023-07-13T14:20:29.217374+0000","last_fullsized":"2023-07-13T14:20:29.217374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"31'103","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.903687+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T14:20:26.903687+0000","last_peered":"2023-07-13T14:20:26.903687+0000","last_clean":"2023-07-13T14:20:26.903687+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T14:20:26.903687+0000","last_undegraded":"2023-07-13T14:20:26.903687+0000","last_fullsized":"2023-07-13T14:20:26.903687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:10.959724+0000","last_change":"2023-07-13T13:52:16.607515+0000","last_active":"2023-07-13T14:20:10.959724+0000","last_peered":"2023-07-13T14:20:10.959724+0000","last_clean":"2023-07-13T14:20:10.959724+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T14:20:10.959724+0000","last_undegraded":"2023-07-13T14:20:10.959724+0000","last_fullsized":"2023-07-13T14:20:10.959724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:31.911995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'33","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.115258+0000","last_change":"2023-07-13T13:52:17.934538+0000","last_active":"2023-07-13T14:20:29.115258+0000","last_peered":"2023-07-13T14:20:29.115258+0000","last_clean":"2023-07-13T14:20:29.115258+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T14:20:29.115258+0000","last_undegraded":"2023-07-13T14:20:29.115258+0000","last_fullsized":"2023-07-13T14:20:29.115258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:01.447721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"31'138","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.568510+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T14:19:53.568510+0000","last_peered":"2023-07-13T14:19:53.568510+0000","last_clean":"2023-07-13T14:19:53.568510+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T14:19:53.568510+0000","last_undegraded":"2023-07-13T14:19:53.568510+0000","last_fullsized":"2023-07-13T14:19:53.568510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:13:08.564646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.195885+0000","last_change":"2023-07-13T13:52:16.668908+0000","last_active":"2023-07-13T14:20:17.195885+0000","last_peered":"2023-07-13T14:20:17.195885+0000","last_clean":"2023-07-13T14:20:17.195885+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T14:20:17.195885+0000","last_undegraded":"2023-07-13T14:20:17.195885+0000","last_fullsized":"2023-07-13T14:20:17.195885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'25","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056582+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T14:20:29.056582+0000","last_peered":"2023-07-13T14:20:29.056582+0000","last_clean":"2023-07-13T14:20:29.056582+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T14:20:29.056582+0000","last_undegraded":"2023-07-13T14:20:29.056582+0000","last_fullsized":"2023-07-13T14:20:29.056582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:48.380599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'89","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.577512+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T14:19:53.577512+0000","last_peered":"2023-07-13T14:19:53.577512+0000","last_clean":"2023-07-13T14:19:53.577512+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T14:19:53.577512+0000","last_undegraded":"2023-07-13T14:19:53.577512+0000","last_fullsized":"2023-07-13T14:19:53.577512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:34:34.679685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":9189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:08.889486+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T14:20:08.889486+0000","last_peered":"2023-07-13T14:20:08.889486+0000","last_clean":"2023-07-13T14:20:08.889486+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T14:20:08.889486+0000","last_undegraded":"2023-07-13T14:20:08.889486+0000","last_fullsized":"2023-07-13T14:20:08.889486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:02.471208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"31'28","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.060805+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T14:20:29.060805+0000","last_peered":"2023-07-13T14:20:29.060805+0000","last_clean":"2023-07-13T14:20:29.060805+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T14:20:29.060805+0000","last_undegraded":"2023-07-13T14:20:29.060805+0000","last_fullsized":"2023-07-13T14:20:29.060805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:23.423317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"31'148","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:54.594249+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T14:19:54.594249+0000","last_peered":"2023-07-13T14:19:54.594249+0000","last_clean":"2023-07-13T14:19:54.594249+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T14:19:54.594249+0000","last_undegraded":"2023-07-13T14:19:54.594249+0000","last_fullsized":"2023-07-13T14:19:54.594249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:18.763893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":18843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'535","reported_seq":573,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.083140+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T14:20:21.083140+0000","last_peered":"2023-07-13T14:20:21.083140+0000","last_clean":"2023-07-13T14:20:21.083140+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T14:20:21.083140+0000","last_undegraded":"2023-07-13T14:20:21.083140+0000","last_fullsized":"2023-07-13T14:20:21.083140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:47.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"31'35","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.231056+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T14:20:29.231056+0000","last_peered":"2023-07-13T14:20:29.231056+0000","last_clean":"2023-07-13T14:20:29.231056+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T14:20:29.231056+0000","last_undegraded":"2023-07-13T14:20:29.231056+0000","last_fullsized":"2023-07-13T14:20:29.231056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'132","reported_seq":162,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.918958+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T14:20:26.918958+0000","last_peered":"2023-07-13T14:20:26.918958+0000","last_clean":"2023-07-13T14:20:26.918958+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T14:20:26.918958+0000","last_undegraded":"2023-07-13T14:20:26.918958+0000","last_fullsized":"2023-07-13T14:20:26.918958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":15927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'845","reported_seq":884,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:16.964985+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T14:20:16.964985+0000","last_peered":"2023-07-13T14:20:16.964985+0000","last_clean":"2023-07-13T14:20:16.964985+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T14:20:16.964985+0000","last_undegraded":"2023-07-13T14:20:16.964985+0000","last_fullsized":"2023-07-13T14:20:16.964985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:28:31.879491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"31'43","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055462+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T14:20:29.055462+0000","last_peered":"2023-07-13T14:20:29.055462+0000","last_clean":"2023-07-13T14:20:29.055462+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T14:20:29.055462+0000","last_undegraded":"2023-07-13T14:20:29.055462+0000","last_fullsized":"2023-07-13T14:20:29.055462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:20:57.526559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"31'113","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.764052+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T14:19:51.764052+0000","last_peered":"2023-07-13T14:19:51.764052+0000","last_clean":"2023-07-13T14:19:51.764052+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T14:19:51.764052+0000","last_undegraded":"2023-07-13T14:19:51.764052+0000","last_fullsized":"2023-07-13T14:19:51.764052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:24:54.587437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":11208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'8","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.097250+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T14:20:17.097250+0000","last_peered":"2023-07-13T14:20:17.097250+0000","last_clean":"2023-07-13T14:20:17.097250+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T14:20:17.097250+0000","last_undegraded":"2023-07-13T14:20:17.097250+0000","last_fullsized":"2023-07-13T14:20:17.097250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'27","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055907+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T14:20:29.055907+0000","last_peered":"2023-07-13T14:20:29.055907+0000","last_clean":"2023-07-13T14:20:29.055907+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T14:20:29.055907+0000","last_undegraded":"2023-07-13T14:20:29.055907+0000","last_fullsized":"2023-07-13T14:20:29.055907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:21:54.287499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'88","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576577+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T14:19:53.576577+0000","last_peered":"2023-07-13T14:19:53.576577+0000","last_clean":"2023-07-13T14:19:53.576577+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T14:19:53.576577+0000","last_undegraded":"2023-07-13T14:19:53.576577+0000","last_fullsized":"2023-07-13T14:19:53.576577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:39:40.932985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.079299+0000","last_change":"2023-07-13T13:52:16.663350+0000","last_active":"2023-07-13T14:20:21.079299+0000","last_peered":"2023-07-13T14:20:21.079299+0000","last_clean":"2023-07-13T14:20:21.079299+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T14:20:21.079299+0000","last_undegraded":"2023-07-13T14:20:21.079299+0000","last_fullsized":"2023-07-13T14:20:21.079299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'29","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.032664+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T14:20:29.032664+0000","last_peered":"2023-07-13T14:20:29.032664+0000","last_clean":"2023-07-13T14:20:29.032664+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T14:20:29.032664+0000","last_undegraded":"2023-07-13T14:20:29.032664+0000","last_fullsized":"2023-07-13T14:20:29.032664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:20:42.938534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"31'107","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.773562+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T14:19:51.773562+0000","last_peered":"2023-07-13T14:19:51.773562+0000","last_clean":"2023-07-13T14:19:51.773562+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T14:19:51.773562+0000","last_undegraded":"2023-07-13T14:19:51.773562+0000","last_fullsized":"2023-07-13T14:19:51.773562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:14:55.793442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:20.085088+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T14:20:20.085088+0000","last_peered":"2023-07-13T14:20:20.085088+0000","last_clean":"2023-07-13T14:20:20.085088+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T14:20:20.085088+0000","last_undegraded":"2023-07-13T14:20:20.085088+0000","last_fullsized":"2023-07-13T14:20:20.085088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:04.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"31'37","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217621+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T14:20:29.217621+0000","last_peered":"2023-07-13T14:20:29.217621+0000","last_clean":"2023-07-13T14:20:29.217621+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T14:20:29.217621+0000","last_undegraded":"2023-07-13T14:20:29.217621+0000","last_fullsized":"2023-07-13T14:20:29.217621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'128","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.462763+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T14:19:52.462763+0000","last_peered":"2023-07-13T14:19:52.462763+0000","last_clean":"2023-07-13T14:19:52.462763+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T14:19:52.462763+0000","last_undegraded":"2023-07-13T14:19:52.462763+0000","last_fullsized":"2023-07-13T14:19:52.462763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:36.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'14","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.005215+0000","last_change":"2023-07-13T13:52:16.692808+0000","last_active":"2023-07-13T14:20:17.005215+0000","last_peered":"2023-07-13T14:20:17.005215+0000","last_clean":"2023-07-13T14:20:17.005215+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T14:20:17.005215+0000","last_undegraded":"2023-07-13T14:20:17.005215+0000","last_fullsized":"2023-07-13T14:20:17.005215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:10.067515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'32","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055961+0000","last_change":"2023-07-13T13:52:17.838408+0000","last_active":"2023-07-13T14:20:29.055961+0000","last_peered":"2023-07-13T14:20:29.055961+0000","last_clean":"2023-07-13T14:20:29.055961+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T14:20:29.055961+0000","last_undegraded":"2023-07-13T14:20:29.055961+0000","last_fullsized":"2023-07-13T14:20:29.055961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:57:58.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"31'122","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.465270+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T14:19:52.465270+0000","last_peered":"2023-07-13T14:19:52.465270+0000","last_clean":"2023-07-13T14:19:52.465270+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T14:19:52.465270+0000","last_undegraded":"2023-07-13T14:19:52.465270+0000","last_fullsized":"2023-07-13T14:19:52.465270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:18:53.223544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.158417+0000","last_change":"2023-07-13T13:52:16.666097+0000","last_active":"2023-07-13T14:20:17.158417+0000","last_peered":"2023-07-13T14:20:17.158417+0000","last_clean":"2023-07-13T14:20:17.158417+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T14:20:17.158417+0000","last_undegraded":"2023-07-13T14:20:17.158417+0000","last_fullsized":"2023-07-13T14:20:17.158417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"31'31","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035188+0000","last_change":"2023-07-13T13:52:17.838908+0000","last_active":"2023-07-13T14:20:29.035188+0000","last_peered":"2023-07-13T14:20:29.035188+0000","last_clean":"2023-07-13T14:20:29.035188+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T14:20:29.035188+0000","last_undegraded":"2023-07-13T14:20:29.035188+0000","last_fullsized":"2023-07-13T14:20:29.035188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:34:28.472848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'99","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:37.065255+0000","last_change":"2023-07-13T13:52:23.993113+0000","last_active":"2023-07-13T14:20:37.065255+0000","last_peered":"2023-07-13T14:20:37.065255+0000","last_clean":"2023-07-13T14:20:37.065255+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T14:20:37.065255+0000","last_undegraded":"2023-07-13T14:20:37.065255+0000","last_fullsized":"2023-07-13T14:20:37.065255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:09.919165+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T14:20:09.919165+0000","last_peered":"2023-07-13T14:20:09.919165+0000","last_clean":"2023-07-13T14:20:09.919165+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T14:20:09.919165+0000","last_undegraded":"2023-07-13T14:20:09.919165+0000","last_fullsized":"2023-07-13T14:20:09.919165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:22.277267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035068+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T14:20:29.035068+0000","last_peered":"2023-07-13T14:20:29.035068+0000","last_clean":"2023-07-13T14:20:29.035068+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T14:20:29.035068+0000","last_undegraded":"2023-07-13T14:20:29.035068+0000","last_fullsized":"2023-07-13T14:20:29.035068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:29:43.401303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"31'154","reported_seq":184,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.254387+0000","last_change":"2023-07-13T13:52:23.992085+0000","last_active":"2023-07-13T14:19:51.254387+0000","last_peered":"2023-07-13T14:19:51.254387+0000","last_clean":"2023-07-13T14:19:51.254387+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T14:19:51.254387+0000","last_undegraded":"2023-07-13T14:19:51.254387+0000","last_fullsized":"2023-07-13T14:19:51.254387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.792804+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T14:19:57.792804+0000","last_peered":"2023-07-13T14:19:57.792804+0000","last_clean":"2023-07-13T14:19:57.792804+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T14:19:57.792804+0000","last_undegraded":"2023-07-13T14:19:57.792804+0000","last_fullsized":"2023-07-13T14:19:57.792804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:18.416220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"31'24","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.116356+0000","last_change":"2023-07-13T13:52:17.952164+0000","last_active":"2023-07-13T14:20:29.116356+0000","last_peered":"2023-07-13T14:20:29.116356+0000","last_clean":"2023-07-13T14:20:29.116356+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T14:20:29.116356+0000","last_undegraded":"2023-07-13T14:20:29.116356+0000","last_fullsized":"2023-07-13T14:20:29.116356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:58:56.106442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'113","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:41.315058+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T14:20:41.315058+0000","last_peered":"2023-07-13T14:20:41.315058+0000","last_clean":"2023-07-13T14:20:41.315058+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T14:20:41.315058+0000","last_undegraded":"2023-07-13T14:20:41.315058+0000","last_fullsized":"2023-07-13T14:20:41.315058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:04.797820+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T14:20:04.797820+0000","last_peered":"2023-07-13T14:20:04.797820+0000","last_clean":"2023-07-13T14:20:04.797820+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T14:20:04.797820+0000","last_undegraded":"2023-07-13T14:20:04.797820+0000","last_fullsized":"2023-07-13T14:20:04.797820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:18.013759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:40.804765+0000","last_change":"2023-07-13T14:20:40.804835+0000","last_active":"2023-07-13T14:20:40.804765+0000","last_peered":"2023-07-13T14:20:40.804765+0000","last_clean":"2023-07-13T14:20:40.804765+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T14:20:40.804765+0000","last_undegraded":"2023-07-13T14:20:40.804765+0000","last_fullsized":"2023-07-13T14:20:40.804765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_clean_scrub_stamp":"2023-07-13T14:20:40.804640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:21.603330+0000","scrub_duration":0.026215853000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'94","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.770555+0000","last_change":"2023-07-13T13:52:23.987269+0000","last_active":"2023-07-13T14:19:51.770555+0000","last_peered":"2023-07-13T14:19:51.770555+0000","last_clean":"2023-07-13T14:19:51.770555+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T14:19:51.770555+0000","last_undegraded":"2023-07-13T14:19:51.770555+0000","last_fullsized":"2023-07-13T14:19:51.770555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'580","reported_seq":619,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.881428+0000","last_change":"2023-07-13T13:52:16.607455+0000","last_active":"2023-07-13T14:20:06.881428+0000","last_peered":"2023-07-13T14:20:06.881428+0000","last_clean":"2023-07-13T14:20:06.881428+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T14:20:06.881428+0000","last_undegraded":"2023-07-13T14:20:06.881428+0000","last_fullsized":"2023-07-13T14:20:06.881428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:18.416220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"31'30","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.038118+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T14:20:29.038118+0000","last_peered":"2023-07-13T14:20:29.038118+0000","last_clean":"2023-07-13T14:20:29.038118+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T14:20:29.038118+0000","last_undegraded":"2023-07-13T14:20:29.038118+0000","last_fullsized":"2023-07-13T14:20:29.038118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:11.058247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'157","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.470063+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T14:19:52.470063+0000","last_peered":"2023-07-13T14:19:52.470063+0000","last_clean":"2023-07-13T14:19:52.470063+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T14:19:52.470063+0000","last_undegraded":"2023-07-13T14:19:52.470063+0000","last_fullsized":"2023-07-13T14:19:52.470063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":13657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:08.889681+0000","last_change":"2023-07-13T13:52:16.692899+0000","last_active":"2023-07-13T14:20:08.889681+0000","last_peered":"2023-07-13T14:20:08.889681+0000","last_clean":"2023-07-13T14:20:08.889681+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T14:20:08.889681+0000","last_undegraded":"2023-07-13T14:20:08.889681+0000","last_fullsized":"2023-07-13T14:20:08.889681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:16:15.151366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"31'28","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052840+0000","last_change":"2023-07-13T13:52:17.942165+0000","last_active":"2023-07-13T14:20:29.052840+0000","last_peered":"2023-07-13T14:20:29.052840+0000","last_clean":"2023-07-13T14:20:29.052840+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T14:20:29.052840+0000","last_undegraded":"2023-07-13T14:20:29.052840+0000","last_fullsized":"2023-07-13T14:20:29.052840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.112967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'108","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576192+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T14:19:53.576192+0000","last_peered":"2023-07-13T14:19:53.576192+0000","last_clean":"2023-07-13T14:19:53.576192+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T14:19:53.576192+0000","last_undegraded":"2023-07-13T14:19:53.576192+0000","last_fullsized":"2023-07-13T14:19:53.576192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:25.769108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":8018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.896456+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T14:20:06.896456+0000","last_peered":"2023-07-13T14:20:06.896456+0000","last_clean":"2023-07-13T14:20:06.896456+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T14:20:06.896456+0000","last_undegraded":"2023-07-13T14:20:06.896456+0000","last_fullsized":"2023-07-13T14:20:06.896456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:48:26.050917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"31'17","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.042824+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T14:20:29.042824+0000","last_peered":"2023-07-13T14:20:29.042824+0000","last_clean":"2023-07-13T14:20:29.042824+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T14:20:29.042824+0000","last_undegraded":"2023-07-13T14:20:29.042824+0000","last_fullsized":"2023-07-13T14:20:29.042824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:57:35.779420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.776600+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T14:19:51.776600+0000","last_peered":"2023-07-13T14:19:51.776600+0000","last_clean":"2023-07-13T14:19:51.776600+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T14:19:51.776600+0000","last_undegraded":"2023-07-13T14:19:51.776600+0000","last_fullsized":"2023-07-13T14:19:51.776600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:29:10.436681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:18.080416+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T14:20:18.080416+0000","last_peered":"2023-07-13T14:20:18.080416+0000","last_clean":"2023-07-13T14:20:18.080416+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T14:20:18.080416+0000","last_undegraded":"2023-07-13T14:20:18.080416+0000","last_fullsized":"2023-07-13T14:20:18.080416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'31","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227810+0000","last_change":"2023-07-13T13:52:17.949610+0000","last_active":"2023-07-13T14:20:29.227810+0000","last_peered":"2023-07-13T14:20:29.227810+0000","last_clean":"2023-07-13T14:20:29.227810+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T14:20:29.227810+0000","last_undegraded":"2023-07-13T14:20:29.227810+0000","last_fullsized":"2023-07-13T14:20:29.227810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"31'114","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.565550+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T14:19:53.565550+0000","last_peered":"2023-07-13T14:19:53.565550+0000","last_clean":"2023-07-13T14:19:53.565550+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T14:19:53.565550+0000","last_undegraded":"2023-07-13T14:19:53.565550+0000","last_fullsized":"2023-07-13T14:19:53.565550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:06.911211+0000","last_change":"2023-07-13T13:51:59.916015+0000","last_active":"2023-07-13T14:19:06.911211+0000","last_peered":"2023-07-13T14:19:06.911211+0000","last_clean":"2023-07-13T14:19:06.911211+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T14:19:06.911211+0000","last_undegraded":"2023-07-13T14:19:06.911211+0000","last_fullsized":"2023-07-13T14:19:06.911211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.882185+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T14:20:06.882185+0000","last_peered":"2023-07-13T14:20:06.882185+0000","last_clean":"2023-07-13T14:20:06.882185+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T14:20:06.882185+0000","last_undegraded":"2023-07-13T14:20:06.882185+0000","last_fullsized":"2023-07-13T14:20:06.882185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:59:31.911995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'29","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233850+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T14:20:29.233850+0000","last_peered":"2023-07-13T14:20:29.233850+0000","last_clean":"2023-07-13T14:20:29.233850+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T14:20:29.233850+0000","last_undegraded":"2023-07-13T14:20:29.233850+0000","last_fullsized":"2023-07-13T14:20:29.233850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'128","reported_seq":159,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.565365+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T14:19:53.565365+0000","last_peered":"2023-07-13T14:19:53.565365+0000","last_clean":"2023-07-13T14:19:53.565365+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T14:19:53.565365+0000","last_undegraded":"2023-07-13T14:19:53.565365+0000","last_fullsized":"2023-07-13T14:19:53.565365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":10905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.024467+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T14:17:02.024467+0000","last_peered":"2023-07-13T14:17:02.024467+0000","last_clean":"2023-07-13T14:17:02.024467+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T14:17:02.024467+0000","last_undegraded":"2023-07-13T14:17:02.024467+0000","last_fullsized":"2023-07-13T14:17:02.024467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:16.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:09.925212+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T14:20:09.925212+0000","last_peered":"2023-07-13T14:20:09.925212+0000","last_clean":"2023-07-13T14:20:09.925212+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T14:20:09.925212+0000","last_undegraded":"2023-07-13T14:20:09.925212+0000","last_fullsized":"2023-07-13T14:20:09.925212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:29:17.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"31'27","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230194+0000","last_change":"2023-07-13T13:52:17.947909+0000","last_active":"2023-07-13T14:20:29.230194+0000","last_peered":"2023-07-13T14:20:29.230194+0000","last_clean":"2023-07-13T14:20:29.230194+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T14:20:29.230194+0000","last_undegraded":"2023-07-13T14:20:29.230194+0000","last_fullsized":"2023-07-13T14:20:29.230194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'124","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:37.065395+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T14:20:37.065395+0000","last_peered":"2023-07-13T14:20:37.065395+0000","last_clean":"2023-07-13T14:20:37.065395+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T14:20:37.065395+0000","last_undegraded":"2023-07-13T14:20:37.065395+0000","last_fullsized":"2023-07-13T14:20:37.065395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:07.056812+0000","last_change":"2023-07-13T13:52:01.224691+0000","last_active":"2023-07-13T14:19:07.056812+0000","last_peered":"2023-07-13T14:19:07.056812+0000","last_clean":"2023-07-13T14:19:07.056812+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T14:19:07.056812+0000","last_undegraded":"2023-07-13T14:19:07.056812+0000","last_fullsized":"2023-07-13T14:19:07.056812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'185","reported_seq":225,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.353692+0000","last_change":"2023-07-13T13:52:16.668065+0000","last_active":"2023-07-13T14:20:29.353692+0000","last_peered":"2023-07-13T14:20:29.353692+0000","last_clean":"2023-07-13T14:20:29.353692+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T14:20:29.353692+0000","last_undegraded":"2023-07-13T14:20:29.353692+0000","last_fullsized":"2023-07-13T14:20:29.353692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1434466,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'31","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233438+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T14:20:29.233438+0000","last_peered":"2023-07-13T14:20:29.233438+0000","last_clean":"2023-07-13T14:20:29.233438+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T14:20:29.233438+0000","last_undegraded":"2023-07-13T14:20:29.233438+0000","last_fullsized":"2023-07-13T14:20:29.233438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'87","reported_seq":117,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:49.425871+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T14:19:49.425871+0000","last_peered":"2023-07-13T14:19:49.425871+0000","last_clean":"2023-07-13T14:19:49.425871+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T14:19:49.425871+0000","last_undegraded":"2023-07-13T14:19:49.425871+0000","last_fullsized":"2023-07-13T14:19:49.425871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:25.366647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:02.024504+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T14:17:02.024504+0000","last_peered":"2023-07-13T14:17:02.024504+0000","last_clean":"2023-07-13T14:17:02.024504+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T14:17:02.024504+0000","last_undegraded":"2023-07-13T14:17:02.024504+0000","last_fullsized":"2023-07-13T14:17:02.024504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:51:43.589579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:02.080996+0000","last_change":"2023-07-13T13:51:57.962882+0000","last_active":"2023-07-13T14:18:02.080996+0000","last_peered":"2023-07-13T14:18:02.080996+0000","last_clean":"2023-07-13T14:18:02.080996+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T14:18:02.080996+0000","last_undegraded":"2023-07-13T14:18:02.080996+0000","last_fullsized":"2023-07-13T14:18:02.080996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:55.598839+0000","last_clean_scrub_stamp":"2023-07-13T13:51:55.598839+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:04:40.216785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:16.894211+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T14:17:16.894211+0000","last_peered":"2023-07-13T14:17:16.894211+0000","last_clean":"2023-07-13T14:17:16.894211+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T14:17:16.894211+0000","last_undegraded":"2023-07-13T14:17:16.894211+0000","last_fullsized":"2023-07-13T14:17:16.894211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"31'29","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.108922+0000","last_change":"2023-07-13T13:52:17.942525+0000","last_active":"2023-07-13T14:20:29.108922+0000","last_peered":"2023-07-13T14:20:29.108922+0000","last_clean":"2023-07-13T14:20:29.108922+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T14:20:29.108922+0000","last_undegraded":"2023-07-13T14:20:29.108922+0000","last_fullsized":"2023-07-13T14:20:29.108922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:18:05.040114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"31'125","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.767150+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T14:19:51.767150+0000","last_peered":"2023-07-13T14:19:51.767150+0000","last_clean":"2023-07-13T14:19:51.767150+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T14:19:51.767150+0000","last_undegraded":"2023-07-13T14:19:51.767150+0000","last_fullsized":"2023-07-13T14:19:51.767150+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:38:29.630154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:07.081687+0000","last_change":"2023-07-13T13:52:00.016430+0000","last_active":"2023-07-13T14:18:07.081687+0000","last_peered":"2023-07-13T14:18:07.081687+0000","last_clean":"2023-07-13T14:18:07.081687+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T14:18:07.081687+0000","last_undegraded":"2023-07-13T14:18:07.081687+0000","last_fullsized":"2023-07-13T14:18:07.081687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:38:16.040470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"31'816","reported_seq":1664,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:24.079869+0000","last_change":"2023-07-13T13:52:16.630297+0000","last_active":"2023-07-13T14:20:24.079869+0000","last_peered":"2023-07-13T14:20:24.079869+0000","last_clean":"2023-07-13T14:20:24.079869+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T14:20:24.079869+0000","last_undegraded":"2023-07-13T14:20:24.079869+0000","last_fullsized":"2023-07-13T14:20:24.079869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174695,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":810,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"31'38","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.229326+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T14:20:29.229326+0000","last_peered":"2023-07-13T14:20:29.229326+0000","last_clean":"2023-07-13T14:20:29.229326+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T14:20:29.229326+0000","last_undegraded":"2023-07-13T14:20:29.229326+0000","last_fullsized":"2023-07-13T14:20:29.229326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"31'163","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.699178+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T14:19:51.699178+0000","last_peered":"2023-07-13T14:19:51.699178+0000","last_clean":"2023-07-13T14:19:51.699178+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T14:19:51.699178+0000","last_undegraded":"2023-07-13T14:19:51.699178+0000","last_fullsized":"2023-07-13T14:19:51.699178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:49:00.719154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":7667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:17:07.073993+0000","last_change":"2023-07-13T13:52:00.019670+0000","last_active":"2023-07-13T14:17:07.073993+0000","last_peered":"2023-07-13T14:17:07.073993+0000","last_clean":"2023-07-13T14:17:07.073993+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T14:17:07.073993+0000","last_undegraded":"2023-07-13T14:17:07.073993+0000","last_fullsized":"2023-07-13T14:17:07.073993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:23:45.429201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:15.025262+0000","last_change":"2023-07-13T13:52:16.668244+0000","last_active":"2023-07-13T14:20:15.025262+0000","last_peered":"2023-07-13T14:20:15.025262+0000","last_clean":"2023-07-13T14:20:15.025262+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T14:20:15.025262+0000","last_undegraded":"2023-07-13T14:20:15.025262+0000","last_fullsized":"2023-07-13T14:20:15.025262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"31'29","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.228492+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T14:20:29.228492+0000","last_peered":"2023-07-13T14:20:29.228492+0000","last_clean":"2023-07-13T14:20:29.228492+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T14:20:29.228492+0000","last_undegraded":"2023-07-13T14:20:29.228492+0000","last_fullsized":"2023-07-13T14:20:29.228492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"31'90","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573245+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T14:19:53.573245+0000","last_peered":"2023-07-13T14:19:53.573245+0000","last_clean":"2023-07-13T14:19:53.573245+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T14:19:53.573245+0000","last_undegraded":"2023-07-13T14:19:53.573245+0000","last_fullsized":"2023-07-13T14:19:53.573245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:46:13.524291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'9","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:21.078016+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T14:20:21.078016+0000","last_peered":"2023-07-13T14:20:21.078016+0000","last_clean":"2023-07-13T14:20:21.078016+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T14:20:21.078016+0000","last_undegraded":"2023-07-13T14:20:21.078016+0000","last_fullsized":"2023-07-13T14:20:21.078016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:33.167123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:11.917508+0000","last_change":"2023-07-13T13:51:59.757569+0000","last_active":"2023-07-13T14:20:11.917508+0000","last_peered":"2023-07-13T14:20:11.917508+0000","last_clean":"2023-07-13T14:20:11.917508+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T14:20:11.917508+0000","last_undegraded":"2023-07-13T14:20:11.917508+0000","last_fullsized":"2023-07-13T14:20:11.917508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'30","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056742+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T14:20:29.056742+0000","last_peered":"2023-07-13T14:20:29.056742+0000","last_clean":"2023-07-13T14:20:29.056742+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T14:20:29.056742+0000","last_undegraded":"2023-07-13T14:20:29.056742+0000","last_fullsized":"2023-07-13T14:20:29.056742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:22:19.159810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"31'139","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.577318+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T14:19:53.577318+0000","last_peered":"2023-07-13T14:19:53.577318+0000","last_clean":"2023-07-13T14:19:53.577318+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T14:19:53.577318+0000","last_undegraded":"2023-07-13T14:19:53.577318+0000","last_fullsized":"2023-07-13T14:19:53.577318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:36.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":9717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:18:01.989782+0000","last_change":"2023-07-13T13:52:00.015919+0000","last_active":"2023-07-13T14:18:01.989782+0000","last_peered":"2023-07-13T14:18:01.989782+0000","last_clean":"2023-07-13T14:18:01.989782+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T14:18:01.989782+0000","last_undegraded":"2023-07-13T14:18:01.989782+0000","last_fullsized":"2023-07-13T14:18:01.989782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:04:39.121531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'314","reported_seq":353,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:27.129300+0000","last_change":"2023-07-13T13:52:16.665545+0000","last_active":"2023-07-13T14:20:27.129300+0000","last_peered":"2023-07-13T14:20:27.129300+0000","last_clean":"2023-07-13T14:20:27.129300+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T14:20:27.129300+0000","last_undegraded":"2023-07-13T14:20:27.129300+0000","last_fullsized":"2023-07-13T14:20:27.129300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"31'21","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052825+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T14:20:29.052825+0000","last_peered":"2023-07-13T14:20:29.052825+0000","last_clean":"2023-07-13T14:20:29.052825+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T14:20:29.052825+0000","last_undegraded":"2023-07-13T14:20:29.052825+0000","last_fullsized":"2023-07-13T14:20:29.052825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:18:29.892355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'134","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:56.916164+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T14:19:56.916164+0000","last_peered":"2023-07-13T14:19:56.916164+0000","last_clean":"2023-07-13T14:19:56.916164+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T14:19:56.916164+0000","last_undegraded":"2023-07-13T14:19:56.916164+0000","last_fullsized":"2023-07-13T14:19:56.916164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'713","reported_seq":750,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:19.052711+0000","last_change":"2023-07-13T13:52:16.631174+0000","last_active":"2023-07-13T14:20:19.052711+0000","last_peered":"2023-07-13T14:20:19.052711+0000","last_clean":"2023-07-13T14:20:19.052711+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T14:20:19.052711+0000","last_undegraded":"2023-07-13T14:20:19.052711+0000","last_fullsized":"2023-07-13T14:20:19.052711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'26","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071853+0000","last_change":"2023-07-13T13:52:17.952450+0000","last_active":"2023-07-13T14:20:29.071853+0000","last_peered":"2023-07-13T14:20:29.071853+0000","last_clean":"2023-07-13T14:20:29.071853+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T14:20:29.071853+0000","last_undegraded":"2023-07-13T14:20:29.071853+0000","last_fullsized":"2023-07-13T14:20:29.071853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"31'117","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576845+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T14:19:53.576845+0000","last_peered":"2023-07-13T14:19:53.576845+0000","last_clean":"2023-07-13T14:19:53.576845+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T14:19:53.576845+0000","last_undegraded":"2023-07-13T14:19:53.576845+0000","last_fullsized":"2023-07-13T14:19:53.576845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:52:07.984474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":13476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.735845+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T14:19:57.735845+0000","last_peered":"2023-07-13T14:19:57.735845+0000","last_clean":"2023-07-13T14:19:57.735845+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T14:19:57.735845+0000","last_undegraded":"2023-07-13T14:19:57.735845+0000","last_fullsized":"2023-07-13T14:19:57.735845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:40:09.464268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'33","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055762+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T14:20:29.055762+0000","last_peered":"2023-07-13T14:20:29.055762+0000","last_clean":"2023-07-13T14:20:29.055762+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T14:20:29.055762+0000","last_undegraded":"2023-07-13T14:20:29.055762+0000","last_fullsized":"2023-07-13T14:20:29.055762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:00.624407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'97","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576096+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T14:19:53.576096+0000","last_peered":"2023-07-13T14:19:53.576096+0000","last_clean":"2023-07-13T14:19:53.576096+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T14:19:53.576096+0000","last_undegraded":"2023-07-13T14:19:53.576096+0000","last_fullsized":"2023-07-13T14:19:53.576096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:59:12.309060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":9809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"31'1257","reported_seq":1295,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:15.025807+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T14:20:15.025807+0000","last_peered":"2023-07-13T14:20:15.025807+0000","last_clean":"2023-07-13T14:20:15.025807+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T14:20:15.025807+0000","last_undegraded":"2023-07-13T14:20:15.025807+0000","last_fullsized":"2023-07-13T14:20:15.025807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:35:37.974870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'30","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056304+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T14:20:29.056304+0000","last_peered":"2023-07-13T14:20:29.056304+0000","last_clean":"2023-07-13T14:20:29.056304+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T14:20:29.056304+0000","last_undegraded":"2023-07-13T14:20:29.056304+0000","last_fullsized":"2023-07-13T14:20:29.056304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:21:26.463017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"31'115","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573399+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T14:19:53.573399+0000","last_peered":"2023-07-13T14:19:53.573399+0000","last_clean":"2023-07-13T14:19:53.573399+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T14:19:53.573399+0000","last_undegraded":"2023-07-13T14:19:53.573399+0000","last_fullsized":"2023-07-13T14:19:53.573399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:30:47.139618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'763","reported_seq":804,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:03.781157+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T14:20:03.781157+0000","last_peered":"2023-07-13T14:20:03.781157+0000","last_clean":"2023-07-13T14:20:03.781157+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T14:20:03.781157+0000","last_undegraded":"2023-07-13T14:20:03.781157+0000","last_fullsized":"2023-07-13T14:20:03.781157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:52:00.662042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":4555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'35","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071562+0000","last_change":"2023-07-13T13:52:17.925281+0000","last_active":"2023-07-13T14:20:29.071562+0000","last_peered":"2023-07-13T14:20:29.071562+0000","last_clean":"2023-07-13T14:20:29.071562+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T14:20:29.071562+0000","last_undegraded":"2023-07-13T14:20:29.071562+0000","last_fullsized":"2023-07-13T14:20:29.071562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:24:03.617258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'135","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:48.543081+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T14:19:48.543081+0000","last_peered":"2023-07-13T14:19:48.543081+0000","last_clean":"2023-07-13T14:19:48.543081+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T14:19:48.543081+0000","last_undegraded":"2023-07-13T14:19:48.543081+0000","last_fullsized":"2023-07-13T14:19:48.543081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":6623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"31'733","reported_seq":772,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:19.051718+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T14:20:19.051718+0000","last_peered":"2023-07-13T14:20:19.051718+0000","last_clean":"2023-07-13T14:20:19.051718+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T14:20:19.051718+0000","last_undegraded":"2023-07-13T14:20:19.051718+0000","last_fullsized":"2023-07-13T14:20:19.051718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'37","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.044987+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T14:20:29.044987+0000","last_peered":"2023-07-13T14:20:29.044987+0000","last_clean":"2023-07-13T14:20:29.044987+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T14:20:29.044987+0000","last_undegraded":"2023-07-13T14:20:29.044987+0000","last_fullsized":"2023-07-13T14:20:29.044987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:57:11.485106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"31'43","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.109653+0000","last_change":"2023-07-13T13:52:17.933894+0000","last_active":"2023-07-13T14:20:29.109653+0000","last_peered":"2023-07-13T14:20:29.109653+0000","last_clean":"2023-07-13T14:20:29.109653+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T14:20:29.109653+0000","last_undegraded":"2023-07-13T14:20:29.109653+0000","last_fullsized":"2023-07-13T14:20:29.109653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:44:32.655763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.061494+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T14:20:29.061494+0000","last_peered":"2023-07-13T14:20:29.061494+0000","last_clean":"2023-07-13T14:20:29.061494+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T14:20:29.061494+0000","last_undegraded":"2023-07-13T14:20:29.061494+0000","last_fullsized":"2023-07-13T14:20:29.061494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:20:42.938534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"31'42","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.033130+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T14:20:29.033130+0000","last_peered":"2023-07-13T14:20:29.033130+0000","last_clean":"2023-07-13T14:20:29.033130+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T14:20:29.033130+0000","last_undegraded":"2023-07-13T14:20:29.033130+0000","last_fullsized":"2023-07-13T14:20:29.033130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:36:22.078595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"31'28","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.054230+0000","last_change":"2023-07-13T13:52:17.838377+0000","last_active":"2023-07-13T14:20:29.054230+0000","last_peered":"2023-07-13T14:20:29.054230+0000","last_clean":"2023-07-13T14:20:29.054230+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T14:20:29.054230+0000","last_undegraded":"2023-07-13T14:20:29.054230+0000","last_fullsized":"2023-07-13T14:20:29.054230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:43:30.589677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'22","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227859+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T14:20:29.227859+0000","last_peered":"2023-07-13T14:20:29.227859+0000","last_clean":"2023-07-13T14:20:29.227859+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T14:20:29.227859+0000","last_undegraded":"2023-07-13T14:20:29.227859+0000","last_fullsized":"2023-07-13T14:20:29.227859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3402,"num_write_kb":282366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3765,"ondisk_log_size":3765,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":35165063,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":7922,"num_write_kb":39030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49258496,"data_stored":70330126,"data_compressed":6207514,"data_compressed_allocated":9723904,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":0},"log_size":7484,"ondisk_log_size":7484,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509787,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34704,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337136,"statfs":{"total":96636764160,"available":96601227264,"internally_reserved":0,"allocated":3678208,"data_stored":4927655,"data_compressed":341063,"data_compressed_allocated":569344,"data_compressed_original":2035712,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.28000000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.625,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44,"15min":0.45100000000000001},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.56100000000000005,"5min":0.64800000000000002,"15min":0.72099999999999997},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44800000000000001,"15min":0.45800000000000002},"min":{"1min":0.315,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.28399999999999997,"15min":0.28199999999999997},"max":{"1min":0.57499999999999996,"5min":0.62,"15min":3.2789999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67400000000000004,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.59499999999999997,"5min":1.0700000000000001,"15min":1.4630000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47699999999999998,"15min":0.48699999999999999},"min":{"1min":0.35799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61099999999999999,"5min":0.93300000000000005,"15min":1.4650000000000001},"last":0.372},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67900000000000005,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.626,"5min":0.67600000000000005,"15min":0.83399999999999996},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.45400000000000001,"15min":0.47399999999999998},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.65500000000000003,"15min":0.83299999999999996},"last":0.31}]},{"osd":5,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48599999999999999,"15min":0.50800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66700000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.308,"5min":0.253,"15min":0.253},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.79700000000000004},"last":0.33000000000000002}]},{"osd":6,"last update":"Thu Jul 13 14:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.53400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.86699999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.53500000000000003},"min":{"1min":0.34100000000000003,"5min":0.33100000000000002,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.81399999999999995},"last":0.437}]}]},{"osd":6,"up_from":15,"seq":64424509787,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30324,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341516,"statfs":{"total":96636764160,"available":96605712384,"internally_reserved":0,"allocated":3387392,"data_stored":4336399,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.41599999999999998,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.217},"max":{"1min":0.58399999999999996,"5min":0.61299999999999999,"15min":1.2549999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.67100000000000004,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.432},"min":{"1min":0.307,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.56699999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.48599999999999999,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.23400000000000001},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.92500000000000004,"15min":2.1789999999999998},"last":0.38},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45900000000000002,"15min":0.47799999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":3.4060000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.52900000000000003},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.28599999999999998},"max":{"1min":2.9500000000000002,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.25900000000000001},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":5.3810000000000002},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.23799999999999999},"max":{"1min":0.59299999999999997,"5min":0.72099999999999997,"15min":0.749},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.246},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.80100000000000005},"last":0.435}]},{"osd":5,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47599999999999998,"15min":0.46200000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63400000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"last":0.503},{"interface":"front","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.89500000000000002},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52100000000000002,"15min":0.51400000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":0.745,"15min":0.75800000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63700000000000001,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.45900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575195,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39120,"kb_used_data":3912,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94332720,"statfs":{"total":96636764160,"available":96596705280,"internally_reserved":0,"allocated":4005888,"data_stored":5770865,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":3.7240000000000002},"last":0.31},{"interface":"front","average":{"1min":0.318,"5min":0.33800000000000002,"15min":0.34100000000000003},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":0.442,"5min":0.71099999999999997,"15min":0.76200000000000001},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.313,"15min":0.33300000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":1.49},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20300000000000001},"max":{"1min":0.57899999999999996,"5min":0.79700000000000004,"15min":0.996},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.60099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.51100000000000001,"5min":1.548,"15min":1.548},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.30099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.76200000000000001,"5min":0.80100000000000005,"15min":1.266},"last":0.44}]},{"osd":5,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.36899999999999999,"15min":0.309},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":1.2869999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.89300000000000002,"15min":0.92800000000000005},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.34799999999999998,"15min":0.33700000000000002},"max":{"1min":0.75,"5min":1.625,"15min":1.625},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.38,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":1.242},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.95299999999999996},"last":0.496},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":1.657,"15min":1.657},"last":0.42499999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542491,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66744,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94305096,"statfs":{"total":96636764160,"available":96568418304,"internally_reserved":0,"allocated":9617408,"data_stored":13490652,"data_compressed":1179065,"data_compressed_allocated":1941504,"data_compressed_original":6012928,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 14:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30399999999999999,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.185},"max":{"1min":0.40999999999999998,"5min":0.53600000000000003,"15min":0.64800000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.19},"max":{"1min":0.48799999999999999,"5min":0.64400000000000002,"15min":1.6879999999999999},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23000000000000001},"max":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.77200000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":3.4940000000000002,"15min":3.4940000000000002},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22},"max":{"1min":0.69599999999999995,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":0.56699999999999995,"5min":1.2230000000000001,"15min":2.5379999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.85099999999999998,"15min":0.91400000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.499}]},{"osd":5,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.26100000000000001},"max":{"1min":0.74099999999999999,"5min":0.80700000000000005,"15min":0.94299999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.748,"5min":0.76900000000000002,"15min":1.0529999999999999},"last":0.46899999999999997}]},{"osd":6,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.33900000000000002},"max":{"1min":0.753,"5min":0.83699999999999997,"15min":0.96599999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":0.83699999999999997,"15min":0.98299999999999998},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.81499999999999995,"15min":0.997},"last":0.443},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.86599999999999999,"15min":1.03},"last":0.432}]}]},{"osd":2,"up_from":15,"seq":64424509787,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1228800,"data_stored":1576561,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.308},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.46000000000000002,"5min":0.65200000000000002,"15min":0.751},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.34000000000000002,"15min":0.35899999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.42699999999999999,"5min":0.57099999999999995,"15min":3.0939999999999999},"last":0.215}]},{"osd":1,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.24299999999999999,"15min":0.19},"max":{"1min":0.56799999999999995,"5min":0.749,"15min":1.248},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.372,"15min":0.38500000000000001},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53300000000000003,"5min":1.081,"15min":2.9529999999999998},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34799999999999998,"15min":0.36699999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.21299999999999999},"max":{"1min":0.53100000000000003,"5min":0.57999999999999996,"15min":2.2490000000000001},"last":0.247},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41399999999999998,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.51800000000000002,"5min":1.167,"15min":1.167},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":0.68500000000000005,"5min":0.79300000000000004,"15min":0.82999999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.31900000000000001,"15min":0.26700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":2.3220000000000001},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.86899999999999999,"15min":2.3660000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32300000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":1.681},"last":0.373}]},{"osd":6,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.34799999999999998},"max":{"1min":0.67900000000000005,"5min":0.73699999999999999,"15min":1.6970000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78200000000000003,"5min":0.94699999999999995,"15min":0.98999999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jul 13 14:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.79300000000000004,"5min":0.83899999999999997,"15min":2.4020000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.40100000000000002,"5min":0.371,"15min":0.32600000000000001},"max":{"1min":0.69299999999999995,"5min":0.73799999999999999,"15min":1.6619999999999999},"last":0.46300000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509787,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":6184960,"data_stored":8530793,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.31900000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.17899999999999999},"max":{"1min":0.37,"5min":0.65500000000000003,"15min":0.78300000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.313,"5min":0.316,"15min":0.33500000000000002},"min":{"1min":0.23300000000000001,"5min":0.19600000000000001,"15min":0.193},"max":{"1min":0.55300000000000005,"5min":0.59399999999999997,"15min":2.972},"last":0.24299999999999999}]},{"osd":1,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.374,"15min":0.35499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19900000000000001},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.377},"min":{"1min":0.221,"5min":0.221,"15min":0.218},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":2.173},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.38100000000000001,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.23200000000000001},"max":{"1min":0.48299999999999998,"5min":1.6759999999999999,"15min":2.335},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.41099999999999998,"15min":0.41399999999999998},"min":{"1min":0.30599999999999999,"5min":0.22800000000000001,"15min":0.214},"max":{"1min":0.501,"5min":0.71399999999999997,"15min":2.2000000000000002},"last":0.376}]},{"osd":4,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.26000000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.83999999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73999999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34000000000000002},"max":{"1min":0.69499999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.38600000000000001,"15min":0.33200000000000002},"max":{"1min":0.82899999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.34300000000000003},"max":{"1min":0.68000000000000005,"5min":0.84299999999999997,"15min":0.84999999999999998},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jul 13 14:19:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.78500000000000003,"5min":0.79200000000000004,"15min":0.82299999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.34100000000000003},"max":{"1min":0.747,"5min":0.91100000000000003,"15min":0.97599999999999998},"last":0.40300000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509787,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77928,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94293912,"statfs":{"total":96636764160,"available":96556965888,"internally_reserved":0,"allocated":15171584,"data_stored":21289038,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":1781,"internal_metadata":64616715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.28999999999999998,"5min":0.24299999999999999,"15min":0.23400000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.72399999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.441,"15min":0.432},"min":{"1min":0.35199999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.68100000000000005,"15min":0.68500000000000005},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.436,"15min":0.44},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.25},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.72599999999999998},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"min":{"1min":0.33700000000000002,"5min":0.29899999999999999,"15min":0.29199999999999998},"max":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.73499999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63800000000000001,"5min":0.64700000000000002,"15min":0.72899999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":2.266,"15min":2.266},"last":0.37}]},{"osd":3,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45800000000000002,"15min":0.46800000000000003},"min":{"1min":0.34899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64100000000000001,"5min":1.2849999999999999,"15min":1.5620000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.29599999999999999},"max":{"1min":0.72699999999999998,"5min":1.4259999999999999,"15min":2.6960000000000002},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.44400000000000001,"15min":0.46600000000000003},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.66200000000000003,"5min":0.73299999999999998,"15min":0.74199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44900000000000001,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.58799999999999997,"5min":0.65900000000000003,"15min":0.754},"last":0.32500000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.46899999999999997,"15min":0.48599999999999999},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.25600000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.80900000000000005},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.30399999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.76300000000000001,"15min":0.78900000000000003},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jul 13 14:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.41999999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.68100000000000005,"5min":0.68799999999999994,"15min":0.79000000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.48399999999999999,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.82799999999999996},"last":0.46700000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509787,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61820,"kb_used_data":8564,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94310020,"statfs":{"total":96636764160,"available":96573460480,"internally_reserved":0,"allocated":8769536,"data_stored":12725659,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.379},{"interface":"front","average":{"1min":0.439,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.248,"15min":0.23899999999999999},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":0.72399999999999998},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.35399999999999998,"5min":0.29099999999999998,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.77700000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.57099999999999995,"5min":1.2729999999999999,"15min":1.7430000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.312,"5min":0.30299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58299999999999996,"5min":0.66800000000000004,"15min":1.284},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.056},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":0.63300000000000001,"5min":1.3879999999999999,"15min":1.78},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.438,"15min":0.439},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.77400000000000002},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73499999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68300000000000005,"5min":1.351,"15min":1.351},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":12758189,"data_compressed":1146678,"data_compressed_allocated":1896448,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3674112,"data_stored":5628770,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897024,"data_stored":1434466,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5853184,"data_stored":8388698,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":21146943,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":12583564,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3055616,"data_stored":4194304,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":4195192,"data_compressed":308676,"data_compressed_allocated":524288,"data_compressed_original":1462272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T14:20:46.209 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.209 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.209 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.210 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.210 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.210 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.210 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.211 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.211 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.211 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.211 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.211 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.212 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.212 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.212 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.212 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.212 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.213 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.213 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.213 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.213 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.214 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.214 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.214 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.214 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.215 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.215 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.215 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.216 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.216 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.216 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.217 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.217 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.217 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.217 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.218 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.218 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.218 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.218 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.218 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.219 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.219 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.219 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.219 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.219 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.220 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.220 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.220 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.220 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.220 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.221 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.221 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.221 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.221 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.221 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.222 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.222 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.222 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.222 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.223 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.223 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.223 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.223 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.223 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.224 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.224 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.224 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.224 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.224 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.225 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.225 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.225 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.225 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.226 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.226 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.226 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.226 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.226 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.227 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.227 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.227 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.227 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.227 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.228 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.228 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.228 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.228 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.228 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.229 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.229 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.229 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.229 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.229 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.230 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.230 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.230 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.230 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.231 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-13T13:51:55.598839+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=55, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.231 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.231 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.231 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.231 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.232 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.232 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.232 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.232 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.232 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.233 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.233 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.233 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.233 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.234 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.234 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.234 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.234 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.234 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.235 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.235 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.235 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.235 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.235 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.236 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.236 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.236 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.236 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.236 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.237 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.237 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.237 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.237 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.238 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.238 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.238 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.238 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.238 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.239 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:20:46.239 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-13T14:20:58.149 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:20:58.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:21:06.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T14:21:06.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.371+0000 7f37f2c2c700 1 Processor -- start 2023-07-13T14:21:06.363 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.371+0000 7f37f2c2c700 1 -- start start 2023-07-13T14:21:06.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.372+0000 7f37f2c2c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f37ec152670 0x7f37ec0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:06.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.372+0000 7f37f2c2c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec06f4f0 0x7f37ec0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:06.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.372+0000 7f37f2c2c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec06e790 con 0x7f37ec070d80 2023-07-13T14:21:06.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.372+0000 7f37f2c2c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ec15bce0 con 0x7f37ec152670 2023-07-13T14:21:06.364 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.372+0000 7f37f2c2c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec159210 con 0x7f37ec06f4f0 2023-07-13T14:21:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.373+0000 7f37f09c8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f37ec152670 0x7f37ec0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.373+0000 7f37ebfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec06f4f0 0x7f37ec0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.373+0000 7f37f11c9700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f37ec070d80 0x7f37ec15c170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:47204/0 (socket says 172.21.15.118:47204) 2023-07-13T14:21:06.365 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.373+0000 7f37f11c9700 1 -- 172.21.15.118:0/3804152 learned_addr learned my addr 172.21.15.118:0/3804152 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:21:06.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.375+0000 7f37eb7fe700 1 -- 172.21.15.118:0/3804152 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358278128 0 0) 0x7f37ec06e790 con 0x7f37ec070d80 2023-07-13T14:21:06.367 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.375+0000 7f37eb7fe700 1 -- 172.21.15.118:0/3804152 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37dc0035b0 con 0x7f37ec070d80 2023-07-13T14:21:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.376+0000 7f37f09c8700 1 -- 172.21.15.118:0/3804152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec06f4f0 msgr2=0x7f37ec0cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:21:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.376+0000 7f37f09c8700 1 --2- 172.21.15.118:0/3804152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec06f4f0 0x7f37ec0cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.376+0000 7f37f09c8700 1 -- 172.21.15.118:0/3804152 >> v1:172.21.15.123:6789/0 conn(0x7f37ec070d80 legacy=0x7f37ec15c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:06.368 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.376+0000 7f37f09c8700 1 -- 172.21.15.118:0/3804152 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec152d90 con 0x7f37ec152670 2023-07-13T14:21:06.370 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.378+0000 7f37f09c8700 1 --2- 172.21.15.118:0/3804152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec0cb8e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009840 tx=0x7f37e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1d0012836c2b58 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:06.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.382+0000 7f37eb7fe700 1 -- 172.21.15.118:0/3804152 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0011830 con 0x7f37ec152670 2023-07-13T14:21:06.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.382+0000 7f37eb7fe700 1 -- 172.21.15.118:0/3804152 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e0011990 con 0x7f37ec152670 2023-07-13T14:21:06.374 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.382+0000 7f37eb7fe700 1 -- 172.21.15.118:0/3804152 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0011d20 con 0x7f37ec152670 2023-07-13T14:21:06.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.383+0000 7f37f2c2c700 1 -- 172.21.15.118:0/3804152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 msgr2=0x7f37ec0cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:06.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.383+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/3804152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec0cb8e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009840 tx=0x7f37e0009b50 comp rx=0 tx=0).stop 2023-07-13T14:21:06.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.383+0000 7f37f2c2c700 1 -- 172.21.15.118:0/3804152 shutdown_connections 2023-07-13T14:21:06.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.383+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/3804152 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec0cb8e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.383+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/3804152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec06f4f0 0x7f37ec0cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.375 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.383+0000 7f37f2c2c700 1 -- 172.21.15.118:0/3804152 >> 172.21.15.118:0/3804152 conn(0x7f37ec06cf10 msgr2=0x7f37ec06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:21:06.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.383+0000 7f37f2c2c700 1 -- 172.21.15.118:0/3804152 shutdown_connections 2023-07-13T14:21:06.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.383+0000 7f37f2c2c700 1 -- 172.21.15.118:0/3804152 wait complete. 2023-07-13T14:21:06.376 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.384+0000 7f37f2c2c700 1 Processor -- start 2023-07-13T14:21:06.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.384+0000 7f37f2c2c700 1 -- start start 2023-07-13T14:21:06.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.385+0000 7f37f2c2c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37ec06f4f0 0x7f37ec0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:06.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.385+0000 7f37f2c2c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec070d80 0x7f37ec15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:06.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.385+0000 7f37f2c2c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:06.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.385+0000 7f37f2c2c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec14fea0 con 0x7f37ec152670 2023-07-13T14:21:06.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.385+0000 7f37f2c2c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec1598b0 con 0x7f37ec06f4f0 2023-07-13T14:21:06.377 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.385+0000 7f37f2c2c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec150d10 con 0x7f37ec070d80 2023-07-13T14:21:06.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.386+0000 7f37f11c9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:06.378 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.386+0000 7f37f09c8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37ec06f4f0 0x7f37ec0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:06.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.386+0000 7f37ebfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec070d80 0x7f37ec15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:06.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.386+0000 7f37f11c9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec15b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:55338/0 (socket says 172.21.15.118:55338) 2023-07-13T14:21:06.379 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.386+0000 7f37f11c9700 1 -- 172.21.15.118:0/2022039818 learned_addr learned my addr 172.21.15.118:0/2022039818 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:21:06.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.390+0000 7f37f11c9700 1 -- 172.21.15.118:0/2022039818 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec070d80 msgr2=0x7f37ec15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:06.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.390+0000 7f37f11c9700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec070d80 0x7f37ec15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.390+0000 7f37f11c9700 1 -- 172.21.15.118:0/2022039818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37ec06f4f0 msgr2=0x7f37ec0c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:06.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.390+0000 7f37f11c9700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37ec06f4f0 0x7f37ec0c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.390+0000 7f37f11c9700 1 -- 172.21.15.118:0/2022039818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e00094a0 con 0x7f37ec152670 2023-07-13T14:21:06.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.393+0000 7f37f11c9700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec15b570 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f37e400cb70 tx=0x7f37e400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:06.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.399+0000 7f37e97fa700 1 -- 172.21.15.118:0/2022039818 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400aa60 con 0x7f37ec152670 2023-07-13T14:21:06.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.399+0000 7f37e97fa700 1 -- 172.21.15.118:0/2022039818 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e400abc0 con 0x7f37ec152670 2023-07-13T14:21:06.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.399+0000 7f37e97fa700 1 -- 172.21.15.118:0/2022039818 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4012400 con 0x7f37ec152670 2023-07-13T14:21:06.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.399+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ec1518b0 con 0x7f37ec152670 2023-07-13T14:21:06.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.399+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ec150f80 con 0x7f37ec152670 2023-07-13T14:21:06.391 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.400+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ec0c7d10 con 0x7f37ec152670 2023-07-13T14:21:06.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.418+0000 7f37e97fa700 1 -- 172.21.15.118:0/2022039818 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37e401b3b0 con 0x7f37ec152670 2023-07-13T14:21:06.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.419+0000 7f37e97fa700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f37d006ad30 0x7f37d006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.419+0000 7f37f09c8700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f37d006ad30 0x7f37d006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.419+0000 7f37f09c8700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f37d006ad30 0x7f37d006d1e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37e0000c00 tx=0x7f37e0008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:06.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.662+0000 7f37e97fa700 1 -- 172.21.15.118:0/2022039818 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37e405c2e0 con 0x7f37ec152670 2023-07-13T14:21:06.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.662+0000 7f37e97fa700 1 -- 172.21.15.118:0/2022039818 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37e4054660 con 0x7f37ec152670 2023-07-13T14:21:06.842 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.851+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37ec0cb310 con 0x7f37d006ad30 2023-07-13T14:21:06.852 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.861+0000 7f37e97fa700 1 -- 172.21.15.118:0/2022039818 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+390809 (secure 0 0 0) 0x7f37ec0cb310 con 0x7f37d006ad30 2023-07-13T14:21:06.856 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:21:06.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f37d006ad30 msgr2=0x7f37d006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:06.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f37d006ad30 0x7f37d006d1e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37e0000c00 tx=0x7f37e0008030 comp rx=0 tx=0).stop 2023-07-13T14:21:06.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 msgr2=0x7f37ec15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:06.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec15b570 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f37e400cb70 tx=0x7f37e400ce80 comp rx=0 tx=0).stop 2023-07-13T14:21:06.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 shutdown_connections 2023-07-13T14:21:06.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f37d006ad30 0x7f37d006d1e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37ec06f4f0 0x7f37ec0c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37ec152670 0x7f37ec15b570 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 --2- 172.21.15.118:0/2022039818 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37ec070d80 0x7f37ec15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:06.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 >> 172.21.15.118:0/2022039818 conn(0x7f37ec06cf10 msgr2=0x7f37ec157f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:21:06.859 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 shutdown_connections 2023-07-13T14:21:06.860 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:06.865+0000 7f37f2c2c700 1 -- 172.21.15.118:0/2022039818 wait complete. 2023-07-13T14:21:06.860 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T14:21:06.869 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":894,"stamp":"2023-07-13T14:21:05.305294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35755431,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":925,"num_read_kb":952,"num_write":11483,"num_write_kb":323812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13375,"ondisk_log_size":13375,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406344,"kb_used_data":50824,"kb_used_omap":13,"kb_used_meta":355442,"kb_avail":754568376,"statfs":{"total":773094113280,"available":772678017024,"internally_reserved":0,"allocated":52043776,"data_stored":72647622,"data_compressed":6272288,"data_compressed_allocated":9814016,"data_compressed_original":32006144,"omap_allocated":14248,"internal_metadata":363972696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003158"},"pg_stats":[{"pgid":"4.3f","version":"31'26","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.697016+0000","last_change":"2023-07-13T14:20:54.697055+0000","last_active":"2023-07-13T14:20:54.697016+0000","last_peered":"2023-07-13T14:20:54.697016+0000","last_clean":"2023-07-13T14:20:54.697016+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T14:20:54.697016+0000","last_undegraded":"2023-07-13T14:20:54.697016+0000","last_fullsized":"2023-07-13T14:20:54.697016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2023-07-13T14:20:54.696939+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2023-07-13T14:20:54.696939+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.696939+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:29:01.595104+0000","scrub_duration":0.018622025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"31'31","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.133178+0000","last_change":"2023-07-13T14:20:48.133215+0000","last_active":"2023-07-13T14:20:48.133178+0000","last_peered":"2023-07-13T14:20:48.133178+0000","last_clean":"2023-07-13T14:20:48.133178+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T14:20:48.133178+0000","last_undegraded":"2023-07-13T14:20:48.133178+0000","last_fullsized":"2023-07-13T14:20:48.133178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:48.133089+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:48.133089+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.133089+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:26:56.268712+0000","scrub_duration":0.021360286999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"31'36","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:45.472603+0000","last_change":"2023-07-13T14:20:45.472644+0000","last_active":"2023-07-13T14:20:45.472603+0000","last_peered":"2023-07-13T14:20:45.472603+0000","last_clean":"2023-07-13T14:20:45.472603+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T14:20:45.472603+0000","last_undegraded":"2023-07-13T14:20:45.472603+0000","last_fullsized":"2023-07-13T14:20:45.472603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:20:45.472514+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:20:45.472514+0000","last_clean_scrub_stamp":"2023-07-13T14:20:45.472514+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:24.113486+0000","scrub_duration":0.021725029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"31'25","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:53.442661+0000","last_change":"2023-07-13T14:20:53.442722+0000","last_active":"2023-07-13T14:20:53.442661+0000","last_peered":"2023-07-13T14:20:53.442661+0000","last_clean":"2023-07-13T14:20:53.442661+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T14:20:53.442661+0000","last_undegraded":"2023-07-13T14:20:53.442661+0000","last_fullsized":"2023-07-13T14:20:53.442661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2023-07-13T14:20:53.442582+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2023-07-13T14:20:53.442582+0000","last_clean_scrub_stamp":"2023-07-13T14:20:53.442582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:26:25.786899+0000","scrub_duration":0.021817185999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"31'23","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:42.761836+0000","last_change":"2023-07-13T14:20:42.761873+0000","last_active":"2023-07-13T14:20:42.761836+0000","last_peered":"2023-07-13T14:20:42.761836+0000","last_clean":"2023-07-13T14:20:42.761836+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T14:20:42.761836+0000","last_undegraded":"2023-07-13T14:20:42.761836+0000","last_fullsized":"2023-07-13T14:20:42.761836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2023-07-13T14:20:42.761766+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2023-07-13T14:20:42.761766+0000","last_clean_scrub_stamp":"2023-07-13T14:20:42.761766+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:02.865757+0000","scrub_duration":0.026158679000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.541567+0000","last_change":"2023-07-13T14:20:54.541633+0000","last_active":"2023-07-13T14:20:54.541567+0000","last_peered":"2023-07-13T14:20:54.541567+0000","last_clean":"2023-07-13T14:20:54.541567+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T14:20:54.541567+0000","last_undegraded":"2023-07-13T14:20:54.541567+0000","last_fullsized":"2023-07-13T14:20:54.541567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:54.541444+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:54.541444+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.541444+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:14:52.144625+0000","scrub_duration":0.021735659000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"31'31","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071549+0000","last_change":"2023-07-13T13:52:17.950184+0000","last_active":"2023-07-13T14:20:29.071549+0000","last_peered":"2023-07-13T14:20:29.071549+0000","last_clean":"2023-07-13T14:20:29.071549+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T14:20:29.071549+0000","last_undegraded":"2023-07-13T14:20:29.071549+0000","last_fullsized":"2023-07-13T14:20:29.071549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"31'22","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.040019+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T14:20:29.040019+0000","last_peered":"2023-07-13T14:20:29.040019+0000","last_clean":"2023-07-13T14:20:29.040019+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T14:20:29.040019+0000","last_undegraded":"2023-07-13T14:20:29.040019+0000","last_fullsized":"2023-07-13T14:20:29.040019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"31'35","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.224047+0000","last_change":"2023-07-13T13:52:58.032563+0000","last_active":"2023-07-13T14:20:29.224047+0000","last_peered":"2023-07-13T14:20:29.224047+0000","last_clean":"2023-07-13T14:20:29.224047+0000","last_became_active":"2023-07-13T13:52:58.032221+0000","last_became_peered":"2023-07-13T13:52:58.032221+0000","last_unstale":"2023-07-13T14:20:29.224047+0000","last_undegraded":"2023-07-13T14:20:29.224047+0000","last_fullsized":"2023-07-13T14:20:29.224047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'37","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.040154+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T14:20:29.040154+0000","last_peered":"2023-07-13T14:20:29.040154+0000","last_clean":"2023-07-13T14:20:29.040154+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T14:20:29.040154+0000","last_undegraded":"2023-07-13T14:20:29.040154+0000","last_fullsized":"2023-07-13T14:20:29.040154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052762+0000","last_change":"2023-07-13T13:52:58.431745+0000","last_active":"2023-07-13T14:20:29.052762+0000","last_peered":"2023-07-13T14:20:29.052762+0000","last_clean":"2023-07-13T14:20:29.052762+0000","last_became_active":"2023-07-13T13:52:58.431466+0000","last_became_peered":"2023-07-13T13:52:58.431466+0000","last_unstale":"2023-07-13T14:20:29.052762+0000","last_undegraded":"2023-07-13T14:20:29.052762+0000","last_fullsized":"2023-07-13T14:20:29.052762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"31'22","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:53.729025+0000","last_change":"2023-07-13T14:20:53.729089+0000","last_active":"2023-07-13T14:20:53.729025+0000","last_peered":"2023-07-13T14:20:53.729025+0000","last_clean":"2023-07-13T14:20:53.729025+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T14:20:53.729025+0000","last_undegraded":"2023-07-13T14:20:53.729025+0000","last_fullsized":"2023-07-13T14:20:53.729025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:20:53.728917+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:20:53.728917+0000","last_clean_scrub_stamp":"2023-07-13T14:20:53.728917+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:13:12.259842+0000","scrub_duration":0.018519234999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"31'35","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:49.683636+0000","last_change":"2023-07-13T14:20:49.683702+0000","last_active":"2023-07-13T14:20:49.683636+0000","last_peered":"2023-07-13T14:20:49.683636+0000","last_clean":"2023-07-13T14:20:49.683636+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T14:20:49.683636+0000","last_undegraded":"2023-07-13T14:20:49.683636+0000","last_fullsized":"2023-07-13T14:20:49.683636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:49.683512+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:49.683512+0000","last_clean_scrub_stamp":"2023-07-13T14:20:49.683512+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:17.670520+0000","scrub_duration":0.018508302000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.160281+0000","last_change":"2023-07-13T14:20:51.160322+0000","last_active":"2023-07-13T14:20:51.160281+0000","last_peered":"2023-07-13T14:20:51.160281+0000","last_clean":"2023-07-13T14:20:51.160281+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T14:20:51.160281+0000","last_undegraded":"2023-07-13T14:20:51.160281+0000","last_fullsized":"2023-07-13T14:20:51.160281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:51.160209+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:51.160209+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.160209+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:42:01.494240+0000","scrub_duration":0.021377126999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"31'35","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071552+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T14:20:29.071552+0000","last_peered":"2023-07-13T14:20:29.071552+0000","last_clean":"2023-07-13T14:20:29.071552+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T14:20:29.071552+0000","last_undegraded":"2023-07-13T14:20:29.071552+0000","last_fullsized":"2023-07-13T14:20:29.071552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"31'33","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.055616+0000","last_change":"2023-07-13T13:52:17.942200+0000","last_active":"2023-07-13T14:20:29.055616+0000","last_peered":"2023-07-13T14:20:29.055616+0000","last_clean":"2023-07-13T14:20:29.055616+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T14:20:29.055616+0000","last_undegraded":"2023-07-13T14:20:29.055616+0000","last_fullsized":"2023-07-13T14:20:29.055616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"31'32","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.219147+0000","last_change":"2023-07-13T13:52:17.888126+0000","last_active":"2023-07-13T14:20:29.219147+0000","last_peered":"2023-07-13T14:20:29.219147+0000","last_clean":"2023-07-13T14:20:29.219147+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T14:20:29.219147+0000","last_undegraded":"2023-07-13T14:20:29.219147+0000","last_fullsized":"2023-07-13T14:20:29.219147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"31'42","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.423055+0000","last_change":"2023-07-13T14:20:43.423153+0000","last_active":"2023-07-13T14:20:43.423055+0000","last_peered":"2023-07-13T14:20:43.423055+0000","last_clean":"2023-07-13T14:20:43.423055+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T14:20:43.423055+0000","last_undegraded":"2023-07-13T14:20:43.423055+0000","last_fullsized":"2023-07-13T14:20:43.423055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:20:43.422890+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:20:43.422890+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.422890+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:18.209416+0000","scrub_duration":0.021729281999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"31'31","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.700194+0000","last_change":"2023-07-13T14:20:52.700259+0000","last_active":"2023-07-13T14:20:52.700194+0000","last_peered":"2023-07-13T14:20:52.700194+0000","last_clean":"2023-07-13T14:20:52.700194+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T14:20:52.700194+0000","last_undegraded":"2023-07-13T14:20:52.700194+0000","last_fullsized":"2023-07-13T14:20:52.700194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:52.700065+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:52.700065+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.700065+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:50:47.705198+0000","scrub_duration":0.018490046999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.053082+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T14:20:29.053082+0000","last_peered":"2023-07-13T14:20:29.053082+0000","last_clean":"2023-07-13T14:20:29.053082+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T14:20:29.053082+0000","last_undegraded":"2023-07-13T14:20:29.053082+0000","last_fullsized":"2023-07-13T14:20:29.053082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"31'46","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071840+0000","last_change":"2023-07-13T13:52:17.839636+0000","last_active":"2023-07-13T14:20:29.071840+0000","last_peered":"2023-07-13T14:20:29.071840+0000","last_clean":"2023-07-13T14:20:29.071840+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T14:20:29.071840+0000","last_undegraded":"2023-07-13T14:20:29.071840+0000","last_fullsized":"2023-07-13T14:20:29.071840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"31'34","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.218078+0000","last_change":"2023-07-13T13:52:17.952615+0000","last_active":"2023-07-13T14:20:29.218078+0000","last_peered":"2023-07-13T14:20:29.218078+0000","last_clean":"2023-07-13T14:20:29.218078+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T14:20:29.218078+0000","last_undegraded":"2023-07-13T14:20:29.218078+0000","last_fullsized":"2023-07-13T14:20:29.218078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"31'37","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.066257+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T14:20:29.066257+0000","last_peered":"2023-07-13T14:20:29.066257+0000","last_clean":"2023-07-13T14:20:29.066257+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T14:20:29.066257+0000","last_undegraded":"2023-07-13T14:20:29.066257+0000","last_fullsized":"2023-07-13T14:20:29.066257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"31'27","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:32.098876+0000","last_change":"2023-07-13T13:52:17.839611+0000","last_active":"2023-07-13T14:20:32.098876+0000","last_peered":"2023-07-13T14:20:32.098876+0000","last_clean":"2023-07-13T14:20:32.098876+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T14:20:32.098876+0000","last_undegraded":"2023-07-13T14:20:32.098876+0000","last_fullsized":"2023-07-13T14:20:32.098876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"31'27","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.315400+0000","last_change":"2023-07-13T14:20:43.315464+0000","last_active":"2023-07-13T14:20:43.315400+0000","last_peered":"2023-07-13T14:20:43.315400+0000","last_clean":"2023-07-13T14:20:43.315400+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T14:20:43.315400+0000","last_undegraded":"2023-07-13T14:20:43.315400+0000","last_fullsized":"2023-07-13T14:20:43.315400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:20:43.315283+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:20:43.315283+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.315283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:20:32.602676+0000","scrub_duration":0.019068186000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"31'39","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.230392+0000","last_change":"2023-07-13T13:52:17.951636+0000","last_active":"2023-07-13T14:20:29.230392+0000","last_peered":"2023-07-13T14:20:29.230392+0000","last_clean":"2023-07-13T14:20:29.230392+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T14:20:29.230392+0000","last_undegraded":"2023-07-13T14:20:29.230392+0000","last_fullsized":"2023-07-13T14:20:29.230392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"31'23","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037902+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T14:20:29.037902+0000","last_peered":"2023-07-13T14:20:29.037902+0000","last_clean":"2023-07-13T14:20:29.037902+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T14:20:29.037902+0000","last_undegraded":"2023-07-13T14:20:29.037902+0000","last_fullsized":"2023-07-13T14:20:29.037902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"31'82","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:56.962208+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T14:19:56.962208+0000","last_peered":"2023-07-13T14:19:56.962208+0000","last_clean":"2023-07-13T14:19:56.962208+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T14:19:56.962208+0000","last_undegraded":"2023-07-13T14:19:56.962208+0000","last_fullsized":"2023-07-13T14:19:56.962208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"31'645","reported_seq":684,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:01.747789+0000","last_change":"2023-07-13T13:52:16.664581+0000","last_active":"2023-07-13T14:20:01.747789+0000","last_peered":"2023-07-13T14:20:01.747789+0000","last_clean":"2023-07-13T14:20:01.747789+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T14:20:01.747789+0000","last_undegraded":"2023-07-13T14:20:01.747789+0000","last_fullsized":"2023-07-13T14:20:01.747789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'42","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.145466+0000","last_change":"2023-07-13T14:20:51.145520+0000","last_active":"2023-07-13T14:20:51.145466+0000","last_peered":"2023-07-13T14:20:51.145466+0000","last_clean":"2023-07-13T14:20:51.145466+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T14:20:51.145466+0000","last_undegraded":"2023-07-13T14:20:51.145466+0000","last_fullsized":"2023-07-13T14:20:51.145466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:20:51.145400+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:20:51.145400+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.145400+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:47:22.361088+0000","scrub_duration":0.018685159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'125","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:01.236205+0000","last_change":"2023-07-13T14:21:01.236275+0000","last_active":"2023-07-13T14:21:01.236205+0000","last_peered":"2023-07-13T14:21:01.236205+0000","last_clean":"2023-07-13T14:21:01.236205+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T14:21:01.236205+0000","last_undegraded":"2023-07-13T14:21:01.236205+0000","last_fullsized":"2023-07-13T14:21:01.236205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'125","last_scrub_stamp":"2023-07-13T14:21:01.236103+0000","last_deep_scrub":"31'125","last_deep_scrub_stamp":"2023-07-13T14:21:01.236103+0000","last_clean_scrub_stamp":"2023-07-13T14:21:01.236103+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:12:45.305574+0000","scrub_duration":0.021819373999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":11569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.246139+0000","last_change":"2023-07-13T14:20:51.246199+0000","last_active":"2023-07-13T14:20:51.246139+0000","last_peered":"2023-07-13T14:20:51.246139+0000","last_clean":"2023-07-13T14:20:51.246139+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T14:20:51.246139+0000","last_undegraded":"2023-07-13T14:20:51.246139+0000","last_fullsized":"2023-07-13T14:20:51.246139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:20:51.246065+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:20:51.246065+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.246065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:11.350056+0000","scrub_duration":0.019069163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'20","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217374+0000","last_change":"2023-07-13T13:52:17.887219+0000","last_active":"2023-07-13T14:20:29.217374+0000","last_peered":"2023-07-13T14:20:29.217374+0000","last_clean":"2023-07-13T14:20:29.217374+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T14:20:29.217374+0000","last_undegraded":"2023-07-13T14:20:29.217374+0000","last_fullsized":"2023-07-13T14:20:29.217374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"31'103","reported_seq":135,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.903687+0000","last_change":"2023-07-13T13:52:23.991604+0000","last_active":"2023-07-13T14:20:26.903687+0000","last_peered":"2023-07-13T14:20:26.903687+0000","last_clean":"2023-07-13T14:20:26.903687+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T14:20:26.903687+0000","last_undegraded":"2023-07-13T14:20:26.903687+0000","last_fullsized":"2023-07-13T14:20:26.903687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'5","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:00.291707+0000","last_change":"2023-07-13T14:21:00.291754+0000","last_active":"2023-07-13T14:21:00.291707+0000","last_peered":"2023-07-13T14:21:00.291707+0000","last_clean":"2023-07-13T14:21:00.291707+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T14:21:00.291707+0000","last_undegraded":"2023-07-13T14:21:00.291707+0000","last_fullsized":"2023-07-13T14:21:00.291707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:00.291634+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:00.291634+0000","last_clean_scrub_stamp":"2023-07-13T14:21:00.291634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:14:46.956921+0000","scrub_duration":0.018782136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.429793+0000","last_change":"2023-07-13T14:20:54.429841+0000","last_active":"2023-07-13T14:20:54.429793+0000","last_peered":"2023-07-13T14:20:54.429793+0000","last_clean":"2023-07-13T14:20:54.429793+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T14:20:54.429793+0000","last_undegraded":"2023-07-13T14:20:54.429793+0000","last_fullsized":"2023-07-13T14:20:54.429793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:20:54.429670+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:20:54.429670+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.429670+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:42:05.035579+0000","scrub_duration":0.021817006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"31'138","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:27.006285+0000","last_change":"2023-07-13T13:52:23.991039+0000","last_active":"2023-07-13T14:20:27.006285+0000","last_peered":"2023-07-13T14:20:27.006285+0000","last_clean":"2023-07-13T14:20:27.006285+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T14:20:27.006285+0000","last_undegraded":"2023-07-13T14:20:27.006285+0000","last_fullsized":"2023-07-13T14:20:27.006285+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.826530+0000","last_change":"2023-07-13T14:20:55.826568+0000","last_active":"2023-07-13T14:20:55.826530+0000","last_peered":"2023-07-13T14:20:55.826530+0000","last_clean":"2023-07-13T14:20:55.826530+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T14:20:55.826530+0000","last_undegraded":"2023-07-13T14:20:55.826530+0000","last_fullsized":"2023-07-13T14:20:55.826530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:20:55.826367+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:20:55.826367+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.826367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:34:15.274393+0000","scrub_duration":0.026266379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'25","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056669+0000","last_change":"2023-07-13T13:52:17.950745+0000","last_active":"2023-07-13T14:20:29.056669+0000","last_peered":"2023-07-13T14:20:29.056669+0000","last_clean":"2023-07-13T14:20:29.056669+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T14:20:29.056669+0000","last_undegraded":"2023-07-13T14:20:29.056669+0000","last_fullsized":"2023-07-13T14:20:29.056669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:27.098233+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T14:20:27.098233+0000","last_peered":"2023-07-13T14:20:27.098233+0000","last_clean":"2023-07-13T14:20:27.098233+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T14:20:27.098233+0000","last_undegraded":"2023-07-13T14:20:27.098233+0000","last_fullsized":"2023-07-13T14:20:27.098233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":9189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:11.973231+0000","last_change":"2023-07-13T13:52:16.670155+0000","last_active":"2023-07-13T14:20:11.973231+0000","last_peered":"2023-07-13T14:20:11.973231+0000","last_clean":"2023-07-13T14:20:11.973231+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T14:20:11.973231+0000","last_undegraded":"2023-07-13T14:20:11.973231+0000","last_fullsized":"2023-07-13T14:20:11.973231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"31'28","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.066141+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T14:20:29.066141+0000","last_peered":"2023-07-13T14:20:29.066141+0000","last_clean":"2023-07-13T14:20:29.066141+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T14:20:29.066141+0000","last_undegraded":"2023-07-13T14:20:29.066141+0000","last_fullsized":"2023-07-13T14:20:29.066141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"31'148","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.914524+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T14:20:26.914524+0000","last_peered":"2023-07-13T14:20:26.914524+0000","last_clean":"2023-07-13T14:20:26.914524+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T14:20:26.914524+0000","last_undegraded":"2023-07-13T14:20:26.914524+0000","last_fullsized":"2023-07-13T14:20:26.914524+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":18843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'535","reported_seq":574,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:24.088682+0000","last_change":"2023-07-13T13:52:16.665375+0000","last_active":"2023-07-13T14:20:24.088682+0000","last_peered":"2023-07-13T14:20:24.088682+0000","last_clean":"2023-07-13T14:20:24.088682+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T14:20:24.088682+0000","last_undegraded":"2023-07-13T14:20:24.088682+0000","last_fullsized":"2023-07-13T14:20:24.088682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"31'35","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.231056+0000","last_change":"2023-07-13T13:52:17.954277+0000","last_active":"2023-07-13T14:20:29.231056+0000","last_peered":"2023-07-13T14:20:29.231056+0000","last_clean":"2023-07-13T14:20:29.231056+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T14:20:29.231056+0000","last_undegraded":"2023-07-13T14:20:29.231056+0000","last_fullsized":"2023-07-13T14:20:29.231056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'132","reported_seq":162,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.918958+0000","last_change":"2023-07-13T13:52:23.996378+0000","last_active":"2023-07-13T14:20:26.918958+0000","last_peered":"2023-07-13T14:20:26.918958+0000","last_clean":"2023-07-13T14:20:26.918958+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T14:20:26.918958+0000","last_undegraded":"2023-07-13T14:20:26.918958+0000","last_fullsized":"2023-07-13T14:20:26.918958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":15927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'845","reported_seq":885,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.172701+0000","last_change":"2023-07-13T13:52:16.662650+0000","last_active":"2023-07-13T14:20:17.172701+0000","last_peered":"2023-07-13T14:20:17.172701+0000","last_clean":"2023-07-13T14:20:17.172701+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T14:20:17.172701+0000","last_undegraded":"2023-07-13T14:20:17.172701+0000","last_fullsized":"2023-07-13T14:20:17.172701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"31'43","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.058123+0000","last_change":"2023-07-13T13:52:17.946211+0000","last_active":"2023-07-13T14:20:29.058123+0000","last_peered":"2023-07-13T14:20:29.058123+0000","last_clean":"2023-07-13T14:20:29.058123+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T14:20:29.058123+0000","last_undegraded":"2023-07-13T14:20:29.058123+0000","last_fullsized":"2023-07-13T14:20:29.058123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"31'113","reported_seq":142,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.462888+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T14:19:52.462888+0000","last_peered":"2023-07-13T14:19:52.462888+0000","last_clean":"2023-07-13T14:19:52.462888+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T14:19:52.462888+0000","last_undegraded":"2023-07-13T14:19:52.462888+0000","last_fullsized":"2023-07-13T14:19:52.462888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":11208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:20.076448+0000","last_change":"2023-07-13T13:52:16.663566+0000","last_active":"2023-07-13T14:20:20.076448+0000","last_peered":"2023-07-13T14:20:20.076448+0000","last_clean":"2023-07-13T14:20:20.076448+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T14:20:20.076448+0000","last_undegraded":"2023-07-13T14:20:20.076448+0000","last_fullsized":"2023-07-13T14:20:20.076448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'27","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056017+0000","last_change":"2023-07-13T13:52:17.951671+0000","last_active":"2023-07-13T14:20:29.056017+0000","last_peered":"2023-07-13T14:20:29.056017+0000","last_clean":"2023-07-13T14:20:29.056017+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T14:20:29.056017+0000","last_undegraded":"2023-07-13T14:20:29.056017+0000","last_fullsized":"2023-07-13T14:20:29.056017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'88","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.914537+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T14:20:26.914537+0000","last_peered":"2023-07-13T14:20:26.914537+0000","last_clean":"2023-07-13T14:20:26.914537+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T14:20:26.914537+0000","last_undegraded":"2023-07-13T14:20:26.914537+0000","last_fullsized":"2023-07-13T14:20:26.914537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.785349+0000","last_change":"2023-07-13T14:20:43.785391+0000","last_active":"2023-07-13T14:20:43.785349+0000","last_peered":"2023-07-13T14:20:43.785349+0000","last_clean":"2023-07-13T14:20:43.785349+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T14:20:43.785349+0000","last_undegraded":"2023-07-13T14:20:43.785349+0000","last_fullsized":"2023-07-13T14:20:43.785349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:20:43.785283+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:20:43.785283+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.785283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:08:06.382987+0000","scrub_duration":0.026179840999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'29","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.035132+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T14:20:29.035132+0000","last_peered":"2023-07-13T14:20:29.035132+0000","last_clean":"2023-07-13T14:20:29.035132+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T14:20:29.035132+0000","last_undegraded":"2023-07-13T14:20:29.035132+0000","last_fullsized":"2023-07-13T14:20:29.035132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"31'107","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:54.594033+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T14:19:54.594033+0000","last_peered":"2023-07-13T14:19:54.594033+0000","last_clean":"2023-07-13T14:19:54.594033+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T14:19:54.594033+0000","last_undegraded":"2023-07-13T14:19:54.594033+0000","last_fullsized":"2023-07-13T14:19:54.594033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:20.085418+0000","last_change":"2023-07-13T13:52:16.665049+0000","last_active":"2023-07-13T14:20:20.085418+0000","last_peered":"2023-07-13T14:20:20.085418+0000","last_clean":"2023-07-13T14:20:20.085418+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T14:20:20.085418+0000","last_undegraded":"2023-07-13T14:20:20.085418+0000","last_fullsized":"2023-07-13T14:20:20.085418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"31'37","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.217621+0000","last_change":"2023-07-13T13:52:17.887785+0000","last_active":"2023-07-13T14:20:29.217621+0000","last_peered":"2023-07-13T14:20:29.217621+0000","last_clean":"2023-07-13T14:20:29.217621+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T14:20:29.217621+0000","last_undegraded":"2023-07-13T14:20:29.217621+0000","last_fullsized":"2023-07-13T14:20:29.217621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'128","reported_seq":157,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.574726+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T14:19:53.574726+0000","last_peered":"2023-07-13T14:19:53.574726+0000","last_clean":"2023-07-13T14:19:53.574726+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T14:19:53.574726+0000","last_undegraded":"2023-07-13T14:19:53.574726+0000","last_fullsized":"2023-07-13T14:19:53.574726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'18","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.559346+0000","last_change":"2023-07-13T14:20:48.559393+0000","last_active":"2023-07-13T14:20:48.559346+0000","last_peered":"2023-07-13T14:20:48.559346+0000","last_clean":"2023-07-13T14:20:48.559346+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T14:20:48.559346+0000","last_undegraded":"2023-07-13T14:20:48.559346+0000","last_fullsized":"2023-07-13T14:20:48.559346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2023-07-13T14:20:48.559269+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2023-07-13T14:20:48.559269+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.559269+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:31:48.936886+0000","scrub_duration":0.030617008000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'32","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.214403+0000","last_change":"2023-07-13T14:20:43.214449+0000","last_active":"2023-07-13T14:20:43.214403+0000","last_peered":"2023-07-13T14:20:43.214403+0000","last_clean":"2023-07-13T14:20:43.214403+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T14:20:43.214403+0000","last_undegraded":"2023-07-13T14:20:43.214403+0000","last_fullsized":"2023-07-13T14:20:43.214403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:43.214310+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:43.214310+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.214310+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:41:53.548341+0000","scrub_duration":0.018645834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"31'122","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:37.099564+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T14:20:37.099564+0000","last_peered":"2023-07-13T14:20:37.099564+0000","last_clean":"2023-07-13T14:20:37.099564+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T14:20:37.099564+0000","last_undegraded":"2023-07-13T14:20:37.099564+0000","last_fullsized":"2023-07-13T14:20:37.099564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.629229+0000","last_change":"2023-07-13T14:20:48.629275+0000","last_active":"2023-07-13T14:20:48.629229+0000","last_peered":"2023-07-13T14:20:48.629229+0000","last_clean":"2023-07-13T14:20:48.629229+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T14:20:48.629229+0000","last_undegraded":"2023-07-13T14:20:48.629229+0000","last_fullsized":"2023-07-13T14:20:48.629229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:20:48.629154+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:20:48.629154+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.629154+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:08:43.034204+0000","scrub_duration":0.031242654000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"31'31","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:46.079615+0000","last_change":"2023-07-13T14:20:46.079652+0000","last_active":"2023-07-13T14:20:46.079615+0000","last_peered":"2023-07-13T14:20:46.079615+0000","last_clean":"2023-07-13T14:20:46.079615+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T14:20:46.079615+0000","last_undegraded":"2023-07-13T14:20:46.079615+0000","last_fullsized":"2023-07-13T14:20:46.079615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:46.079455+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:46.079455+0000","last_clean_scrub_stamp":"2023-07-13T14:20:46.079455+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:36:54.890046+0000","scrub_duration":0.021429993000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'99","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:00.640773+0000","last_change":"2023-07-13T14:21:00.640860+0000","last_active":"2023-07-13T14:21:00.640773+0000","last_peered":"2023-07-13T14:21:00.640773+0000","last_clean":"2023-07-13T14:21:00.640773+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T14:21:00.640773+0000","last_undegraded":"2023-07-13T14:21:00.640773+0000","last_fullsized":"2023-07-13T14:21:00.640773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2023-07-13T14:21:00.640670+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2023-07-13T14:21:00.640670+0000","last_clean_scrub_stamp":"2023-07-13T14:21:00.640670+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:26:32.984986+0000","scrub_duration":0.018598401000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'7","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:20.085409+0000","last_change":"2023-07-13T13:52:16.666427+0000","last_active":"2023-07-13T14:20:20.085409+0000","last_peered":"2023-07-13T14:20:20.085409+0000","last_clean":"2023-07-13T14:20:20.085409+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T14:20:20.085409+0000","last_undegraded":"2023-07-13T14:20:20.085409+0000","last_fullsized":"2023-07-13T14:20:20.085409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"31'27","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:31.966752+0000","last_change":"2023-07-13T13:52:17.955781+0000","last_active":"2023-07-13T14:20:31.966752+0000","last_peered":"2023-07-13T14:20:31.966752+0000","last_clean":"2023-07-13T14:20:31.966752+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T14:20:31.966752+0000","last_undegraded":"2023-07-13T14:20:31.966752+0000","last_fullsized":"2023-07-13T14:20:31.966752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"31'154","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.713795+0000","last_change":"2023-07-13T14:20:55.713847+0000","last_active":"2023-07-13T14:20:55.713795+0000","last_peered":"2023-07-13T14:20:55.713795+0000","last_clean":"2023-07-13T14:20:55.713795+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T14:20:55.713795+0000","last_undegraded":"2023-07-13T14:20:55.713795+0000","last_fullsized":"2023-07-13T14:20:55.713795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-07-13T14:20:55.713721+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-07-13T14:20:55.713721+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.713721+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:03:36.441089+0000","scrub_duration":0.018574487000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:17.178362+0000","last_change":"2023-07-13T13:52:16.669216+0000","last_active":"2023-07-13T14:20:17.178362+0000","last_peered":"2023-07-13T14:20:17.178362+0000","last_clean":"2023-07-13T14:20:17.178362+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T14:20:17.178362+0000","last_undegraded":"2023-07-13T14:20:17.178362+0000","last_fullsized":"2023-07-13T14:20:17.178362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"31'24","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.273574+0000","last_change":"2023-07-13T14:20:59.273634+0000","last_active":"2023-07-13T14:20:59.273574+0000","last_peered":"2023-07-13T14:20:59.273574+0000","last_clean":"2023-07-13T14:20:59.273574+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T14:20:59.273574+0000","last_undegraded":"2023-07-13T14:20:59.273574+0000","last_fullsized":"2023-07-13T14:20:59.273574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2023-07-13T14:20:59.273490+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2023-07-13T14:20:59.273490+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.273490+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:09:45.879482+0000","scrub_duration":0.021897019,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'113","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:41.315058+0000","last_change":"2023-07-13T13:52:23.981911+0000","last_active":"2023-07-13T14:20:41.315058+0000","last_peered":"2023-07-13T14:20:41.315058+0000","last_clean":"2023-07-13T14:20:41.315058+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T14:20:41.315058+0000","last_undegraded":"2023-07-13T14:20:41.315058+0000","last_fullsized":"2023-07-13T14:20:41.315058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:19.052624+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T14:20:19.052624+0000","last_peered":"2023-07-13T14:20:19.052624+0000","last_clean":"2023-07-13T14:20:19.052624+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T14:20:19.052624+0000","last_undegraded":"2023-07-13T14:20:19.052624+0000","last_fullsized":"2023-07-13T14:20:19.052624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:40.804765+0000","last_change":"2023-07-13T14:20:40.804835+0000","last_active":"2023-07-13T14:20:40.804765+0000","last_peered":"2023-07-13T14:20:40.804765+0000","last_clean":"2023-07-13T14:20:40.804765+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T14:20:40.804765+0000","last_undegraded":"2023-07-13T14:20:40.804765+0000","last_fullsized":"2023-07-13T14:20:40.804765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_clean_scrub_stamp":"2023-07-13T14:20:40.804640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:21.603330+0000","scrub_duration":0.026215853000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'94","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.659702+0000","last_change":"2023-07-13T14:20:59.659758+0000","last_active":"2023-07-13T14:20:59.659702+0000","last_peered":"2023-07-13T14:20:59.659702+0000","last_clean":"2023-07-13T14:20:59.659702+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T14:20:59.659702+0000","last_undegraded":"2023-07-13T14:20:59.659702+0000","last_fullsized":"2023-07-13T14:20:59.659702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'94","last_scrub_stamp":"2023-07-13T14:20:59.659593+0000","last_deep_scrub":"31'94","last_deep_scrub_stamp":"2023-07-13T14:20:59.659593+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.659593+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:03:44.402498+0000","scrub_duration":0.018527055000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'582","reported_seq":630,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.321603+0000","last_change":"2023-07-13T14:20:59.321647+0000","last_active":"2023-07-13T14:20:59.321603+0000","last_peered":"2023-07-13T14:20:59.321603+0000","last_clean":"2023-07-13T14:20:59.321603+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T14:20:59.321603+0000","last_undegraded":"2023-07-13T14:20:59.321603+0000","last_fullsized":"2023-07-13T14:20:59.321603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'582","last_scrub_stamp":"2023-07-13T14:20:59.321528+0000","last_deep_scrub":"31'582","last_deep_scrub_stamp":"2023-07-13T14:20:59.321528+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.321528+0000","objects_scrubbed":2,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:35.652804+0000","scrub_duration":0.066498466000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"31'30","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056266+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T14:20:29.056266+0000","last_peered":"2023-07-13T14:20:29.056266+0000","last_clean":"2023-07-13T14:20:29.056266+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T14:20:29.056266+0000","last_undegraded":"2023-07-13T14:20:29.056266+0000","last_fullsized":"2023-07-13T14:20:29.056266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'157","reported_seq":187,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.470063+0000","last_change":"2023-07-13T13:52:23.996369+0000","last_active":"2023-07-13T14:19:52.470063+0000","last_peered":"2023-07-13T14:19:52.470063+0000","last_clean":"2023-07-13T14:19:52.470063+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T14:19:52.470063+0000","last_undegraded":"2023-07-13T14:19:52.470063+0000","last_fullsized":"2023-07-13T14:19:52.470063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":13657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.537406+0000","last_change":"2023-07-13T14:20:47.537449+0000","last_active":"2023-07-13T14:20:47.537406+0000","last_peered":"2023-07-13T14:20:47.537406+0000","last_clean":"2023-07-13T14:20:47.537406+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T14:20:47.537406+0000","last_undegraded":"2023-07-13T14:20:47.537406+0000","last_fullsized":"2023-07-13T14:20:47.537406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-07-13T14:20:47.537321+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-07-13T14:20:47.537321+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.537321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:28:54.435486+0000","scrub_duration":0.021817349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"31'28","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.552781+0000","last_change":"2023-07-13T14:20:48.552823+0000","last_active":"2023-07-13T14:20:48.552781+0000","last_peered":"2023-07-13T14:20:48.552781+0000","last_clean":"2023-07-13T14:20:48.552781+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T14:20:48.552781+0000","last_undegraded":"2023-07-13T14:20:48.552781+0000","last_fullsized":"2023-07-13T14:20:48.552781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:20:48.552706+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:20:48.552706+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.552706+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:08:55.376149+0000","scrub_duration":0.021718227999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'108","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576338+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T14:19:53.576338+0000","last_peered":"2023-07-13T14:19:53.576338+0000","last_clean":"2023-07-13T14:19:53.576338+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T14:19:53.576338+0000","last_undegraded":"2023-07-13T14:19:53.576338+0000","last_fullsized":"2023-07-13T14:19:53.576338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":8018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.966164+0000","last_change":"2023-07-13T13:52:16.632684+0000","last_active":"2023-07-13T14:20:26.966164+0000","last_peered":"2023-07-13T14:20:26.966164+0000","last_clean":"2023-07-13T14:20:26.966164+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T14:20:26.966164+0000","last_undegraded":"2023-07-13T14:20:26.966164+0000","last_fullsized":"2023-07-13T14:20:26.966164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"31'17","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.053228+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T14:20:29.053228+0000","last_peered":"2023-07-13T14:20:29.053228+0000","last_clean":"2023-07-13T14:20:29.053228+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T14:20:29.053228+0000","last_undegraded":"2023-07-13T14:20:29.053228+0000","last_fullsized":"2023-07-13T14:20:29.053228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'97","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.776725+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T14:19:51.776725+0000","last_peered":"2023-07-13T14:19:51.776725+0000","last_clean":"2023-07-13T14:19:51.776725+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T14:19:51.776725+0000","last_undegraded":"2023-07-13T14:19:51.776725+0000","last_fullsized":"2023-07-13T14:19:51.776725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.914435+0000","last_change":"2023-07-13T13:52:16.664998+0000","last_active":"2023-07-13T14:20:26.914435+0000","last_peered":"2023-07-13T14:20:26.914435+0000","last_clean":"2023-07-13T14:20:26.914435+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T14:20:26.914435+0000","last_undegraded":"2023-07-13T14:20:26.914435+0000","last_fullsized":"2023-07-13T14:20:26.914435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'31","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:01.167043+0000","last_change":"2023-07-13T14:21:01.167106+0000","last_active":"2023-07-13T14:21:01.167043+0000","last_peered":"2023-07-13T14:21:01.167043+0000","last_clean":"2023-07-13T14:21:01.167043+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T14:21:01.167043+0000","last_undegraded":"2023-07-13T14:21:01.167043+0000","last_fullsized":"2023-07-13T14:21:01.167043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:01.166959+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:01.166959+0000","last_clean_scrub_stamp":"2023-07-13T14:21:01.166959+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:55.302665+0000","scrub_duration":0.019059868000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"31'114","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.565550+0000","last_change":"2023-07-13T13:52:23.991890+0000","last_active":"2023-07-13T14:19:53.565550+0000","last_peered":"2023-07-13T14:19:53.565550+0000","last_clean":"2023-07-13T14:19:53.565550+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T14:19:53.565550+0000","last_undegraded":"2023-07-13T14:19:53.565550+0000","last_fullsized":"2023-07-13T14:19:53.565550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.250090+0000","last_change":"2023-07-13T14:20:47.250142+0000","last_active":"2023-07-13T14:20:47.250090+0000","last_peered":"2023-07-13T14:20:47.250090+0000","last_clean":"2023-07-13T14:20:47.250090+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T14:20:47.250090+0000","last_undegraded":"2023-07-13T14:20:47.250090+0000","last_fullsized":"2023-07-13T14:20:47.250090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:47.250012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:47.250012+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.250012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:52.091091+0000","scrub_duration":0.019134366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:15.007204+0000","last_change":"2023-07-13T13:52:16.669178+0000","last_active":"2023-07-13T14:20:15.007204+0000","last_peered":"2023-07-13T14:20:15.007204+0000","last_clean":"2023-07-13T14:20:15.007204+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T14:20:15.007204+0000","last_undegraded":"2023-07-13T14:20:15.007204+0000","last_fullsized":"2023-07-13T14:20:15.007204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'29","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233850+0000","last_change":"2023-07-13T13:52:17.953921+0000","last_active":"2023-07-13T14:20:29.233850+0000","last_peered":"2023-07-13T14:20:29.233850+0000","last_clean":"2023-07-13T14:20:29.233850+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T14:20:29.233850+0000","last_undegraded":"2023-07-13T14:20:29.233850+0000","last_fullsized":"2023-07-13T14:20:29.233850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'128","reported_seq":159,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.565365+0000","last_change":"2023-07-13T13:52:23.998111+0000","last_active":"2023-07-13T14:19:53.565365+0000","last_peered":"2023-07-13T14:19:53.565365+0000","last_clean":"2023-07-13T14:19:53.565365+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T14:19:53.565365+0000","last_undegraded":"2023-07-13T14:19:53.565365+0000","last_fullsized":"2023-07-13T14:19:53.565365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":10905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:07.039782+0000","last_change":"2023-07-13T13:51:59.772956+0000","last_active":"2023-07-13T14:19:07.039782+0000","last_peered":"2023-07-13T14:19:07.039782+0000","last_clean":"2023-07-13T14:19:07.039782+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T14:19:07.039782+0000","last_undegraded":"2023-07-13T14:19:07.039782+0000","last_fullsized":"2023-07-13T14:19:07.039782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:11.981939+0000","last_change":"2023-07-13T13:52:16.630777+0000","last_active":"2023-07-13T14:20:11.981939+0000","last_peered":"2023-07-13T14:20:11.981939+0000","last_clean":"2023-07-13T14:20:11.981939+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T14:20:11.981939+0000","last_undegraded":"2023-07-13T14:20:11.981939+0000","last_fullsized":"2023-07-13T14:20:11.981939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"31'27","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.148434+0000","last_change":"2023-07-13T14:20:59.148473+0000","last_active":"2023-07-13T14:20:59.148434+0000","last_peered":"2023-07-13T14:20:59.148434+0000","last_clean":"2023-07-13T14:20:59.148434+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T14:20:59.148434+0000","last_undegraded":"2023-07-13T14:20:59.148434+0000","last_fullsized":"2023-07-13T14:20:59.148434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:20:59.148355+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:20:59.148355+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.148355+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:16:31.674123+0000","scrub_duration":0.019042481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'124","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:37.065395+0000","last_change":"2023-07-13T13:52:23.988735+0000","last_active":"2023-07-13T14:20:37.065395+0000","last_peered":"2023-07-13T14:20:37.065395+0000","last_clean":"2023-07-13T14:20:37.065395+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T14:20:37.065395+0000","last_undegraded":"2023-07-13T14:20:37.065395+0000","last_fullsized":"2023-07-13T14:20:37.065395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:46.643820+0000","last_change":"2023-07-13T14:20:46.643875+0000","last_active":"2023-07-13T14:20:46.643820+0000","last_peered":"2023-07-13T14:20:46.643820+0000","last_clean":"2023-07-13T14:20:46.643820+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T14:20:46.643820+0000","last_undegraded":"2023-07-13T14:20:46.643820+0000","last_fullsized":"2023-07-13T14:20:46.643820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:46.643707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:46.643707+0000","last_clean_scrub_stamp":"2023-07-13T14:20:46.643707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:27:19.450339+0000","scrub_duration":0.018539291999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'185","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.217415+0000","last_change":"2023-07-13T14:20:52.217479+0000","last_active":"2023-07-13T14:20:52.217415+0000","last_peered":"2023-07-13T14:20:52.217415+0000","last_clean":"2023-07-13T14:20:52.217415+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T14:20:52.217415+0000","last_undegraded":"2023-07-13T14:20:52.217415+0000","last_fullsized":"2023-07-13T14:20:52.217415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'185","last_scrub_stamp":"2023-07-13T14:20:52.217273+0000","last_deep_scrub":"31'185","last_deep_scrub_stamp":"2023-07-13T14:20:52.217273+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.217273+0000","objects_scrubbed":1,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:08:14.814977+0000","scrub_duration":0.030479297999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1434466,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'31","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.233438+0000","last_change":"2023-07-13T13:52:17.953819+0000","last_active":"2023-07-13T14:20:29.233438+0000","last_peered":"2023-07-13T14:20:29.233438+0000","last_clean":"2023-07-13T14:20:29.233438+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T14:20:29.233438+0000","last_undegraded":"2023-07-13T14:20:29.233438+0000","last_fullsized":"2023-07-13T14:20:29.233438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'87","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.462810+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T14:19:52.462810+0000","last_peered":"2023-07-13T14:19:52.462810+0000","last_clean":"2023-07-13T14:19:52.462810+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T14:19:52.462810+0000","last_undegraded":"2023-07-13T14:19:52.462810+0000","last_fullsized":"2023-07-13T14:19:52.462810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:07.039806+0000","last_change":"2023-07-13T13:51:59.921531+0000","last_active":"2023-07-13T14:19:07.039806+0000","last_peered":"2023-07-13T14:19:07.039806+0000","last_clean":"2023-07-13T14:19:07.039806+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T14:19:07.039806+0000","last_undegraded":"2023-07-13T14:19:07.039806+0000","last_fullsized":"2023-07-13T14:19:07.039806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:51:58.276344+0000","last_clean_scrub_stamp":"2023-07-13T13:51:58.276344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.541331+0000","last_change":"2023-07-13T14:20:55.541461+0000","last_active":"2023-07-13T14:20:55.541331+0000","last_peered":"2023-07-13T14:20:55.541331+0000","last_clean":"2023-07-13T14:20:55.541331+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T14:20:55.541331+0000","last_undegraded":"2023-07-13T14:20:55.541331+0000","last_fullsized":"2023-07-13T14:20:55.541331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-07-13T14:20:55.541167+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-07-13T14:20:55.541167+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.541167+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:27:03.676791+0000","scrub_duration":0.031242277999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:21.907438+0000","last_change":"2023-07-13T13:52:16.668184+0000","last_active":"2023-07-13T14:19:21.907438+0000","last_peered":"2023-07-13T14:19:21.907438+0000","last_clean":"2023-07-13T14:19:21.907438+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T14:19:21.907438+0000","last_undegraded":"2023-07-13T14:19:21.907438+0000","last_fullsized":"2023-07-13T14:19:21.907438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"31'29","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.398673+0000","last_change":"2023-07-13T14:20:55.398775+0000","last_active":"2023-07-13T14:20:55.398673+0000","last_peered":"2023-07-13T14:20:55.398673+0000","last_clean":"2023-07-13T14:20:55.398673+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T14:20:55.398673+0000","last_undegraded":"2023-07-13T14:20:55.398673+0000","last_fullsized":"2023-07-13T14:20:55.398673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:20:55.398507+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:20:55.398507+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.398507+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:34:38.158480+0000","scrub_duration":0.021835706999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"31'125","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:37.050287+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T14:20:37.050287+0000","last_peered":"2023-07-13T14:20:37.050287+0000","last_clean":"2023-07-13T14:20:37.050287+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T14:20:37.050287+0000","last_undegraded":"2023-07-13T14:20:37.050287+0000","last_fullsized":"2023-07-13T14:20:37.050287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.532628+0000","last_change":"2023-07-13T14:20:57.532718+0000","last_active":"2023-07-13T14:20:57.532628+0000","last_peered":"2023-07-13T14:20:57.532628+0000","last_clean":"2023-07-13T14:20:57.532628+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T14:20:57.532628+0000","last_undegraded":"2023-07-13T14:20:57.532628+0000","last_fullsized":"2023-07-13T14:20:57.532628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:57.532508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:57.532508+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.532508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:33.635034+0000","scrub_duration":0.022295781000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"31'816","reported_seq":1672,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.872734+0000","last_change":"2023-07-13T14:20:52.872773+0000","last_active":"2023-07-13T14:20:52.872734+0000","last_peered":"2023-07-13T14:20:52.872734+0000","last_clean":"2023-07-13T14:20:52.872734+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T14:20:52.872734+0000","last_undegraded":"2023-07-13T14:20:52.872734+0000","last_fullsized":"2023-07-13T14:20:52.872734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'816","last_scrub_stamp":"2023-07-13T14:20:52.872671+0000","last_deep_scrub":"31'816","last_deep_scrub_stamp":"2023-07-13T14:20:52.872671+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.872671+0000","objects_scrubbed":1,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:47.008377+0000","scrub_duration":0.031418862999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174695,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":810,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"31'38","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.229326+0000","last_change":"2023-07-13T13:52:17.950233+0000","last_active":"2023-07-13T14:20:29.229326+0000","last_peered":"2023-07-13T14:20:29.229326+0000","last_clean":"2023-07-13T14:20:29.229326+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T14:20:29.229326+0000","last_undegraded":"2023-07-13T14:20:29.229326+0000","last_fullsized":"2023-07-13T14:20:29.229326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"31'163","reported_seq":194,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.568896+0000","last_change":"2023-07-13T13:52:23.989270+0000","last_active":"2023-07-13T14:19:53.568896+0000","last_peered":"2023-07-13T14:19:53.568896+0000","last_clean":"2023-07-13T14:19:53.568896+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T14:19:53.568896+0000","last_undegraded":"2023-07-13T14:19:53.568896+0000","last_fullsized":"2023-07-13T14:19:53.568896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":7667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:58.535370+0000","last_change":"2023-07-13T14:20:58.535405+0000","last_active":"2023-07-13T14:20:58.535370+0000","last_peered":"2023-07-13T14:20:58.535370+0000","last_clean":"2023-07-13T14:20:58.535370+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T14:20:58.535370+0000","last_undegraded":"2023-07-13T14:20:58.535370+0000","last_fullsized":"2023-07-13T14:20:58.535370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:58.535275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:58.535275+0000","last_clean_scrub_stamp":"2023-07-13T14:20:58.535275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:42:08.869306+0000","scrub_duration":0.022332606000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:58.126248+0000","last_change":"2023-07-13T14:20:58.126314+0000","last_active":"2023-07-13T14:20:58.126248+0000","last_peered":"2023-07-13T14:20:58.126248+0000","last_clean":"2023-07-13T14:20:58.126248+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T14:20:58.126248+0000","last_undegraded":"2023-07-13T14:20:58.126248+0000","last_fullsized":"2023-07-13T14:20:58.126248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:20:58.126153+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:20:58.126153+0000","last_clean_scrub_stamp":"2023-07-13T14:20:58.126153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:56:38.869235+0000","scrub_duration":0.019046782000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"31'29","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.228492+0000","last_change":"2023-07-13T13:52:17.886017+0000","last_active":"2023-07-13T14:20:29.228492+0000","last_peered":"2023-07-13T14:20:29.228492+0000","last_clean":"2023-07-13T14:20:29.228492+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T14:20:29.228492+0000","last_undegraded":"2023-07-13T14:20:29.228492+0000","last_fullsized":"2023-07-13T14:20:29.228492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"31'90","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573360+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T14:19:53.573360+0000","last_peered":"2023-07-13T14:19:53.573360+0000","last_clean":"2023-07-13T14:19:53.573360+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T14:19:53.573360+0000","last_undegraded":"2023-07-13T14:19:53.573360+0000","last_fullsized":"2023-07-13T14:19:53.573360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'9","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.914581+0000","last_change":"2023-07-13T13:52:16.663656+0000","last_active":"2023-07-13T14:20:26.914581+0000","last_peered":"2023-07-13T14:20:26.914581+0000","last_clean":"2023-07-13T14:20:26.914581+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T14:20:26.914581+0000","last_undegraded":"2023-07-13T14:20:26.914581+0000","last_fullsized":"2023-07-13T14:20:26.914581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:44.296225+0000","last_change":"2023-07-13T14:20:44.296281+0000","last_active":"2023-07-13T14:20:44.296225+0000","last_peered":"2023-07-13T14:20:44.296225+0000","last_clean":"2023-07-13T14:20:44.296225+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T14:20:44.296225+0000","last_undegraded":"2023-07-13T14:20:44.296225+0000","last_fullsized":"2023-07-13T14:20:44.296225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:44.296110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:44.296110+0000","last_clean_scrub_stamp":"2023-07-13T14:20:44.296110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:40:36.078817+0000","scrub_duration":0.019097020999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'30","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056792+0000","last_change":"2023-07-13T13:52:17.838271+0000","last_active":"2023-07-13T14:20:29.056792+0000","last_peered":"2023-07-13T14:20:29.056792+0000","last_clean":"2023-07-13T14:20:29.056792+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T14:20:29.056792+0000","last_undegraded":"2023-07-13T14:20:29.056792+0000","last_fullsized":"2023-07-13T14:20:29.056792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"31'139","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.914401+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T14:20:26.914401+0000","last_peered":"2023-07-13T14:20:26.914401+0000","last_clean":"2023-07-13T14:20:26.914401+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T14:20:26.914401+0000","last_undegraded":"2023-07-13T14:20:26.914401+0000","last_fullsized":"2023-07-13T14:20:26.914401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":9717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:45.540863+0000","last_change":"2023-07-13T14:20:45.540898+0000","last_active":"2023-07-13T14:20:45.540863+0000","last_peered":"2023-07-13T14:20:45.540863+0000","last_clean":"2023-07-13T14:20:45.540863+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T14:20:45.540863+0000","last_undegraded":"2023-07-13T14:20:45.540863+0000","last_fullsized":"2023-07-13T14:20:45.540863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:45.540787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:45.540787+0000","last_clean_scrub_stamp":"2023-07-13T14:20:45.540787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:13:04.071711+0000","scrub_duration":0.021879480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'315","reported_seq":362,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.857667+0000","last_change":"2023-07-13T14:20:57.857749+0000","last_active":"2023-07-13T14:20:57.857667+0000","last_peered":"2023-07-13T14:20:57.857667+0000","last_clean":"2023-07-13T14:20:57.857667+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T14:20:57.857667+0000","last_undegraded":"2023-07-13T14:20:57.857667+0000","last_fullsized":"2023-07-13T14:20:57.857667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'315","last_scrub_stamp":"2023-07-13T14:20:57.857551+0000","last_deep_scrub":"31'315","last_deep_scrub_stamp":"2023-07-13T14:20:57.857551+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.857551+0000","objects_scrubbed":1,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:28:59.718479+0000","scrub_duration":0.036700948999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"31'21","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052894+0000","last_change":"2023-07-13T13:52:17.943993+0000","last_active":"2023-07-13T14:20:29.052894+0000","last_peered":"2023-07-13T14:20:29.052894+0000","last_clean":"2023-07-13T14:20:29.052894+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T14:20:29.052894+0000","last_undegraded":"2023-07-13T14:20:29.052894+0000","last_fullsized":"2023-07-13T14:20:29.052894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'134","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:56.916164+0000","last_change":"2023-07-13T13:52:23.986990+0000","last_active":"2023-07-13T14:19:56.916164+0000","last_peered":"2023-07-13T14:19:56.916164+0000","last_clean":"2023-07-13T14:19:56.916164+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T14:19:56.916164+0000","last_undegraded":"2023-07-13T14:19:56.916164+0000","last_fullsized":"2023-07-13T14:19:56.916164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'714","reported_seq":759,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.883967+0000","last_change":"2023-07-13T14:20:51.884018+0000","last_active":"2023-07-13T14:20:51.883967+0000","last_peered":"2023-07-13T14:20:51.883967+0000","last_clean":"2023-07-13T14:20:51.883967+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T14:20:51.883967+0000","last_undegraded":"2023-07-13T14:20:51.883967+0000","last_fullsized":"2023-07-13T14:20:51.883967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'714","last_scrub_stamp":"2023-07-13T14:20:51.883901+0000","last_deep_scrub":"31'714","last_deep_scrub_stamp":"2023-07-13T14:20:51.883901+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.883901+0000","objects_scrubbed":1,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:16:24.409670+0000","scrub_duration":0.073239398999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'26","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.681270+0000","last_change":"2023-07-13T14:20:47.681332+0000","last_active":"2023-07-13T14:20:47.681270+0000","last_peered":"2023-07-13T14:20:47.681270+0000","last_clean":"2023-07-13T14:20:47.681270+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T14:20:47.681270+0000","last_undegraded":"2023-07-13T14:20:47.681270+0000","last_fullsized":"2023-07-13T14:20:47.681270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2023-07-13T14:20:47.681178+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2023-07-13T14:20:47.681178+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.681178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:54:56.528327+0000","scrub_duration":0.018502169999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"31'117","reported_seq":146,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.094545+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T14:19:57.094545+0000","last_peered":"2023-07-13T14:19:57.094545+0000","last_clean":"2023-07-13T14:19:57.094545+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T14:19:57.094545+0000","last_undegraded":"2023-07-13T14:19:57.094545+0000","last_fullsized":"2023-07-13T14:19:57.094545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":13476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:06.882101+0000","last_change":"2023-07-13T13:52:16.669272+0000","last_active":"2023-07-13T14:20:06.882101+0000","last_peered":"2023-07-13T14:20:06.882101+0000","last_clean":"2023-07-13T14:20:06.882101+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T14:20:06.882101+0000","last_undegraded":"2023-07-13T14:20:06.882101+0000","last_fullsized":"2023-07-13T14:20:06.882101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'33","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056538+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T14:20:29.056538+0000","last_peered":"2023-07-13T14:20:29.056538+0000","last_clean":"2023-07-13T14:20:29.056538+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T14:20:29.056538+0000","last_undegraded":"2023-07-13T14:20:29.056538+0000","last_fullsized":"2023-07-13T14:20:29.056538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.045531+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T14:19:57.045531+0000","last_peered":"2023-07-13T14:19:57.045531+0000","last_clean":"2023-07-13T14:19:57.045531+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T14:19:57.045531+0000","last_undegraded":"2023-07-13T14:19:57.045531+0000","last_fullsized":"2023-07-13T14:19:57.045531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":9809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"31'1257","reported_seq":1296,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:20.086045+0000","last_change":"2023-07-13T13:52:16.669551+0000","last_active":"2023-07-13T14:20:20.086045+0000","last_peered":"2023-07-13T14:20:20.086045+0000","last_clean":"2023-07-13T14:20:20.086045+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T14:20:20.086045+0000","last_undegraded":"2023-07-13T14:20:20.086045+0000","last_fullsized":"2023-07-13T14:20:20.086045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'30","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056470+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T14:20:29.056470+0000","last_peered":"2023-07-13T14:20:29.056470+0000","last_clean":"2023-07-13T14:20:29.056470+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T14:20:29.056470+0000","last_undegraded":"2023-07-13T14:20:29.056470+0000","last_fullsized":"2023-07-13T14:20:29.056470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"31'115","reported_seq":144,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:54.594394+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T14:19:54.594394+0000","last_peered":"2023-07-13T14:19:54.594394+0000","last_clean":"2023-07-13T14:19:54.594394+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T14:19:54.594394+0000","last_undegraded":"2023-07-13T14:19:54.594394+0000","last_fullsized":"2023-07-13T14:19:54.594394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'763","reported_seq":805,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:16.913449+0000","last_change":"2023-07-13T13:52:16.693049+0000","last_active":"2023-07-13T14:20:16.913449+0000","last_peered":"2023-07-13T14:20:16.913449+0000","last_clean":"2023-07-13T14:20:16.913449+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T14:20:16.913449+0000","last_undegraded":"2023-07-13T14:20:16.913449+0000","last_fullsized":"2023-07-13T14:20:16.913449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":4555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'35","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.170369+0000","last_change":"2023-07-13T14:20:55.170407+0000","last_active":"2023-07-13T14:20:55.170369+0000","last_peered":"2023-07-13T14:20:55.170369+0000","last_clean":"2023-07-13T14:20:55.170369+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T14:20:55.170369+0000","last_undegraded":"2023-07-13T14:20:55.170369+0000","last_fullsized":"2023-07-13T14:20:55.170369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:55.170275+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:55.170275+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.170275+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:16.808243+0000","scrub_duration":0.018752201999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'135","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:48.543081+0000","last_change":"2023-07-13T13:52:23.991069+0000","last_active":"2023-07-13T14:19:48.543081+0000","last_peered":"2023-07-13T14:19:48.543081+0000","last_clean":"2023-07-13T14:19:48.543081+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T14:19:48.543081+0000","last_undegraded":"2023-07-13T14:19:48.543081+0000","last_fullsized":"2023-07-13T14:19:48.543081+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":6623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"31'733","reported_seq":772,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:19.051718+0000","last_change":"2023-07-13T13:52:16.669194+0000","last_active":"2023-07-13T14:20:19.051718+0000","last_peered":"2023-07-13T14:20:19.051718+0000","last_clean":"2023-07-13T14:20:19.051718+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T14:20:19.051718+0000","last_undegraded":"2023-07-13T14:20:19.051718+0000","last_fullsized":"2023-07-13T14:20:19.051718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'37","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.045712+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T14:20:29.045712+0000","last_peered":"2023-07-13T14:20:29.045712+0000","last_clean":"2023-07-13T14:20:29.045712+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T14:20:29.045712+0000","last_undegraded":"2023-07-13T14:20:29.045712+0000","last_fullsized":"2023-07-13T14:20:29.045712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"31'43","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.494369+0000","last_change":"2023-07-13T14:20:51.494451+0000","last_active":"2023-07-13T14:20:51.494369+0000","last_peered":"2023-07-13T14:20:51.494369+0000","last_clean":"2023-07-13T14:20:51.494369+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T14:20:51.494369+0000","last_undegraded":"2023-07-13T14:20:51.494369+0000","last_fullsized":"2023-07-13T14:20:51.494369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-07-13T14:20:51.494264+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-07-13T14:20:51.494264+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.494264+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:19:20.845976+0000","scrub_duration":0.021866048999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"31'36","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.070985+0000","last_change":"2023-07-13T13:52:17.950946+0000","last_active":"2023-07-13T14:20:29.070985+0000","last_peered":"2023-07-13T14:20:29.070985+0000","last_clean":"2023-07-13T14:20:29.070985+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T14:20:29.070985+0000","last_undegraded":"2023-07-13T14:20:29.070985+0000","last_fullsized":"2023-07-13T14:20:29.070985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"31'42","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.052960+0000","last_change":"2023-07-13T13:52:17.946899+0000","last_active":"2023-07-13T14:20:29.052960+0000","last_peered":"2023-07-13T14:20:29.052960+0000","last_clean":"2023-07-13T14:20:29.052960+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T14:20:29.052960+0000","last_undegraded":"2023-07-13T14:20:29.052960+0000","last_fullsized":"2023-07-13T14:20:29.052960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"31'28","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.231386+0000","last_change":"2023-07-13T14:20:57.231458+0000","last_active":"2023-07-13T14:20:57.231386+0000","last_peered":"2023-07-13T14:20:57.231386+0000","last_clean":"2023-07-13T14:20:57.231386+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T14:20:57.231386+0000","last_undegraded":"2023-07-13T14:20:57.231386+0000","last_fullsized":"2023-07-13T14:20:57.231386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:20:57.231265+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:20:57.231265+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.231265+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:35:53.580424+0000","scrub_duration":0.018638647000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'22","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.227859+0000","last_change":"2023-07-13T13:52:17.951485+0000","last_active":"2023-07-13T14:20:29.227859+0000","last_peered":"2023-07-13T14:20:29.227859+0000","last_clean":"2023-07-13T14:20:29.227859+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T14:20:29.227859+0000","last_undegraded":"2023-07-13T14:20:29.227859+0000","last_fullsized":"2023-07-13T14:20:29.227859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3402,"num_write_kb":282366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3765,"ondisk_log_size":3765,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":35165063,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":7922,"num_write_kb":39030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49258496,"data_stored":70330126,"data_compressed":6207514,"data_compressed_allocated":9723904,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":0},"log_size":7493,"ondisk_log_size":7493,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509791,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34704,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337136,"statfs":{"total":96636764160,"available":96601227264,"internally_reserved":0,"allocated":3678208,"data_stored":4927655,"data_compressed":341063,"data_compressed_allocated":569344,"data_compressed_original":2035712,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.438},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.438,"15min":0.45200000000000001},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.72099999999999997},"last":0.435}]},{"osd":1,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29199999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60299999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.47599999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":3.2789999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63500000000000001,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.499},{"interface":"front","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.66400000000000003,"5min":0.84599999999999997,"15min":1.4630000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.53400000000000003,"5min":0.93300000000000005,"15min":1.4650000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.35099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64700000000000002,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42299999999999999,"15min":0.44500000000000001},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.628,"5min":0.628,"15min":0.83399999999999996},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44700000000000001,"15min":0.46700000000000003},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52700000000000002,"5min":0.65500000000000003,"15min":0.83299999999999996},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.47299999999999998,"15min":0.498},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63400000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.309},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.51200000000000001},"min":{"1min":0.316,"5min":0.253,"15min":0.253},"max":{"1min":0.60699999999999998,"5min":0.72499999999999998,"15min":0.79700000000000004},"last":0.28299999999999997}]},{"osd":6,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64600000000000002,"5min":0.72599999999999998,"15min":0.86699999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.622,"5min":0.67300000000000004,"15min":0.81399999999999995},"last":0.41899999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509791,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30324,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341516,"statfs":{"total":96636764160,"available":96605712384,"internally_reserved":0,"allocated":3387392,"data_stored":4336399,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41999999999999998,"15min":0.436},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.217},"max":{"1min":0.56000000000000005,"5min":0.61299999999999999,"15min":1.2549999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.25700000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":2.3759999999999999},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.60199999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28699999999999998},"max":{"1min":0.60199999999999998,"5min":2.899,"15min":2.899},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.36499999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59099999999999997,"5min":0.92500000000000004,"15min":2.1789999999999998},"last":0.37},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45400000000000001,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.70299999999999996,"15min":3.4060000000000001},"last":0.44}]},{"osd":3,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.56200000000000006,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.501},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":2.7389999999999999,"15min":5.3810000000000002},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.25800000000000001,"15min":0.23799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.80100000000000005},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.311,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60199999999999998,"5min":0.73399999999999999,"15min":0.81599999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.89500000000000002},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.745,"15min":0.75800000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.38800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575199,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39120,"kb_used_data":3912,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94332720,"statfs":{"total":96636764160,"available":96596705280,"internally_reserved":0,"allocated":4005888,"data_stored":5770865,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":3.7240000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.33800000000000002,"15min":0.34100000000000003},"min":{"1min":0.23000000000000001,"5min":0.214,"15min":0.19900000000000001},"max":{"1min":0.442,"5min":0.71099999999999997,"15min":0.76200000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.313,"15min":0.33300000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":1.49},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.20300000000000001},"max":{"1min":0.57899999999999996,"5min":0.79700000000000004,"15min":0.996},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.60099999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.27300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.51100000000000001,"5min":1.548,"15min":1.548},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.30099999999999999},"max":{"1min":0.79700000000000004,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.41999999999999998,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.76200000000000001,"5min":0.80100000000000005,"15min":1.266},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.36899999999999999,"15min":0.309},"max":{"1min":0.77600000000000002,"5min":0.83299999999999996,"15min":1.2869999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77600000000000002,"5min":0.89300000000000002,"15min":0.92800000000000005},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.34799999999999998,"15min":0.33700000000000002},"max":{"1min":0.75,"5min":1.625,"15min":1.625},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.38,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":1.242},"last":0.502}]},{"osd":7,"last update":"Thu Jul 13 14:20:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59599999999999997},"min":{"1min":0.41799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.95299999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35399999999999998},"max":{"1min":0.748,"5min":1.657,"15min":1.657},"last":0.53900000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542495,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66744,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94305096,"statfs":{"total":96636764160,"available":96568418304,"internally_reserved":0,"allocated":9617408,"data_stored":13490652,"data_compressed":1179065,"data_compressed_allocated":1941504,"data_compressed_original":6012928,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 14:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30299999999999999,"15min":0.307},"min":{"1min":0.215,"5min":0.186,"15min":0.185},"max":{"1min":0.46100000000000002,"5min":0.53600000000000003,"15min":0.64800000000000002},"last":0.188},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.19},"max":{"1min":0.52000000000000002,"5min":0.64400000000000002,"15min":1.6879999999999999},"last":0.22500000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38100000000000001,"15min":0.372},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23000000000000001},"max":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.77200000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.38,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.57599999999999996,"5min":3.4940000000000002,"15min":3.4940000000000002},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22},"max":{"1min":0.69599999999999995,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40500000000000003,"15min":0.41499999999999998},"min":{"1min":0.28199999999999997,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":0.56699999999999995,"5min":1.2230000000000001,"15min":2.5379999999999998},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.29199999999999998},"max":{"1min":0.70999999999999996,"5min":0.85099999999999998,"15min":0.91400000000000003},"last":0.374},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.33400000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.26100000000000001},"max":{"1min":0.74099999999999999,"5min":0.80700000000000005,"15min":0.94299999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.748,"5min":0.76900000000000002,"15min":1.0529999999999999},"last":0.32100000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.33900000000000002},"max":{"1min":0.753,"5min":0.83699999999999997,"15min":0.96599999999999997},"last":0.438},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":0.77600000000000002,"5min":0.83699999999999997,"15min":0.98299999999999998},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Jul 13 14:20:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71999999999999997,"5min":0.81499999999999995,"15min":0.997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.86599999999999999,"15min":1.03},"last":0.40799999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509791,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1228800,"data_stored":1576561,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.31},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.48099999999999998,"5min":0.65200000000000002,"15min":0.751},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.34000000000000002,"15min":0.36099999999999999},"min":{"1min":0.215,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.503,"5min":0.57099999999999995,"15min":3.0939999999999999},"last":0.308}]},{"osd":1,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36099999999999999,"15min":0.36199999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.222},"max":{"1min":0.47199999999999998,"5min":0.749,"15min":1.248},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46400000000000002,"5min":0.94899999999999995,"15min":2.9529999999999998},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34200000000000003,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48099999999999998,"5min":0.53100000000000003,"15min":2.2490000000000001},"last":0.251},{"interface":"front","average":{"1min":0.375,"5min":0.39000000000000001,"15min":0.40500000000000003},"min":{"1min":0.29199999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.51600000000000001,"5min":0.71299999999999997,"15min":1.167},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":0.75700000000000001,"5min":0.79300000000000004,"15min":0.82999999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.82899999999999996,"15min":2.3220000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.86899999999999999,"15min":2.3660000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":1.681},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.34799999999999998},"max":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":1.6970000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69199999999999995,"5min":0.94699999999999995,"15min":0.98999999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.83899999999999997,"15min":2.4020000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":1.6619999999999999},"last":0.61799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509791,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":6184960,"data_stored":8530793,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.21099999999999999,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.39600000000000002,"5min":0.65500000000000003,"15min":0.78300000000000003},"last":0.318},{"interface":"front","average":{"1min":0.311,"5min":0.316,"15min":0.33600000000000002},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.193},"max":{"1min":0.433,"5min":0.59399999999999997,"15min":2.972},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.23499999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.438,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.254,"5min":0.221,"15min":0.218},"max":{"1min":0.54100000000000004,"5min":0.73999999999999999,"15min":2.173},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.375,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23200000000000001},"max":{"1min":0.41999999999999998,"5min":1.6759999999999999,"15min":2.335},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.40500000000000003,"15min":0.41399999999999998},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.71399999999999997,"15min":2.2000000000000002},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.77300000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73799999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.34699999999999998},"max":{"1min":0.78700000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.435}]},{"osd":6,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.33200000000000002},"max":{"1min":0.81299999999999994,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75900000000000001,"5min":0.84299999999999997,"15min":0.84999999999999998},"last":0.38100000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55400000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75,"5min":0.79200000000000004,"15min":0.82299999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.91100000000000003,"15min":0.97599999999999998},"last":0.48899999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509791,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77928,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94293912,"statfs":{"total":96636764160,"available":96556965888,"internally_reserved":0,"allocated":15171584,"data_stored":21289038,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":1781,"internal_metadata":64616715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42899999999999999,"15min":0.437},"min":{"1min":0.33800000000000002,"5min":0.27200000000000002,"15min":0.23400000000000001},"max":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.72399999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.443,"15min":0.435},"min":{"1min":0.33800000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60399999999999998,"5min":0.68100000000000005,"15min":0.68500000000000005},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.44},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.25},"max":{"1min":0.62,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45900000000000002},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.623,"5min":0.69399999999999995,"15min":0.73499999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.46400000000000002},"min":{"1min":0.31,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72899999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.47899999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64100000000000001,"5min":2.266,"15min":2.266},"last":0.443}]},{"osd":3,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57099999999999995,"5min":1.2849999999999999,"15min":1.5620000000000001},"last":0.314},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.29599999999999999},"max":{"1min":0.76800000000000002,"5min":1.4259999999999999,"15min":2.6960000000000002},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.46300000000000002},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.499},{"interface":"front","average":{"1min":0.434,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.73699999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.25600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.28599999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.77500000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80400000000000005},"last":0.51100000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509791,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61820,"kb_used_data":8564,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94310020,"statfs":{"total":96636764160,"available":96573460480,"internally_reserved":0,"allocated":8769536,"data_stored":12725659,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.248,"15min":0.23899999999999999},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":0.72399999999999998},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.35399999999999998,"5min":0.29099999999999998,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.77700000000000002},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.441}]},{"osd":2,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.57099999999999995,"5min":1.2729999999999999,"15min":1.7430000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.312,"5min":0.30299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58299999999999996,"5min":0.66800000000000004,"15min":1.284},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.056},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":0.63300000000000001,"5min":1.3879999999999999,"15min":1.78},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.438,"15min":0.439},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32900000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.77400000000000002},"last":0.312}]},{"osd":7,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73499999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68300000000000005,"5min":1.351,"15min":1.351},"last":0.34499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":12758189,"data_compressed":1146678,"data_compressed_allocated":1896448,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3674112,"data_stored":5628770,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897024,"data_stored":1434466,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5853184,"data_stored":8388698,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":21146943,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":12583564,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3055616,"data_stored":4194304,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":4195192,"data_compressed":308676,"data_compressed_allocated":524288,"data_compressed_original":1462272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T14:21:06.878 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.878 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.879 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.879 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.879 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.879 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.880 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.880 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.880 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.880 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.881 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.881 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.881 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.881 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.882 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.882 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.882 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.882 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.883 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.883 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.883 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.883 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.883 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.884 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.884 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.884 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.884 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.885 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.885 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.885 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.885 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.885 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.886 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.886 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.886 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.886 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.886 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.887 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.887 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.887 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.887 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.888 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.888 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.888 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.888 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.888 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.889 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.889 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.889 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.889 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.890 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.890 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.890 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.890 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.890 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.891 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.891 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.891 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.891 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.892 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.892 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.892 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-13T13:51:58.276344+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.892 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.893 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.893 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.893 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.893 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.894 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.894 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.894 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.894 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.895 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.895 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.895 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.895 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.895 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.896 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.896 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.896 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.896 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.896 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.897 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.897 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.897 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.897 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.898 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.898 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:06.898 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-13T14:21:26.899 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T14:21:27.025 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.033+0000 7fdd92df5700 1 Processor -- start 2023-07-13T14:21:27.025 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.034+0000 7fdd92df5700 1 -- start start 2023-07-13T14:21:27.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.034+0000 7fdd92df5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c070c80 0x7fdd8c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:27.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.034+0000 7fdd92df5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c155c60 con 0x7fdd8c0c5280 2023-07-13T14:21:27.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.034+0000 7fdd92df5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c155f20 con 0x7fdd8c14bf30 2023-07-13T14:21:27.026 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.034+0000 7fdd92df5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0c1fe0 con 0x7fdd8c070c80 2023-07-13T14:21:27.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.035+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c070c80 0x7fdd8c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:27.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.035+0000 7fdd90b91700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdd8c14bf30 0x7fdd8c1553d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:43312/0 (socket says 172.21.15.118:43312) 2023-07-13T14:21:27.027 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.035+0000 7fdd90b91700 1 -- 172.21.15.118:0/3334367103 learned_addr learned my addr 172.21.15.118:0/3334367103 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:21:27.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.038+0000 7fdd8b7fe700 1 -- 172.21.15.118:0/3334367103 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631583808 0 0) 0x7fdd8c155f20 con 0x7fdd8c14bf30 2023-07-13T14:21:27.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.038+0000 7fdd8b7fe700 1 -- 172.21.15.118:0/3334367103 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd7c0035b0 con 0x7fdd8c14bf30 2023-07-13T14:21:27.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.038+0000 7fdd8b7fe700 1 -- 172.21.15.118:0/3334367103 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190276799 0 0) 0x7fdd8c155c60 con 0x7fdd8c0c5280 2023-07-13T14:21:27.030 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.039+0000 7fdd8b7fe700 1 -- 172.21.15.118:0/3334367103 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd8c155f20 con 0x7fdd8c0c5280 2023-07-13T14:21:27.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.039+0000 7fdd8bfff700 1 -- 172.21.15.118:0/3334367103 >> v1:172.21.15.123:6789/0 conn(0x7fdd8c14bf30 legacy=0x7fdd8c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:27.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.039+0000 7fdd8bfff700 1 -- 172.21.15.118:0/3334367103 >> v1:172.21.15.118:6789/0 conn(0x7fdd8c0c5280 legacy=0x7fdd8c06ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:27.031 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.039+0000 7fdd8bfff700 1 -- 172.21.15.118:0/3334367103 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c156200 con 0x7fdd8c070c80 2023-07-13T14:21:27.033 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.042+0000 7fdd8bfff700 1 --2- 172.21.15.118:0/3334367103 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c070c80 0x7fdd8c1594a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009870 tx=0x7fdd78009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8f550db5f4c6c73 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:27.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd8b7fe700 1 -- 172.21.15.118:0/3334367103 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78011830 con 0x7fdd8c070c80 2023-07-13T14:21:27.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd8b7fe700 1 -- 172.21.15.118:0/3334367103 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78011990 con 0x7fdd8c070c80 2023-07-13T14:21:27.038 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd8b7fe700 1 -- 172.21.15.118:0/3334367103 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78011d20 con 0x7fdd8c070c80 2023-07-13T14:21:27.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd92df5700 1 -- 172.21.15.118:0/3334367103 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c070c80 msgr2=0x7fdd8c1594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:27.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd92df5700 1 --2- 172.21.15.118:0/3334367103 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c070c80 0x7fdd8c1594a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009870 tx=0x7fdd78009b80 comp rx=0 tx=0).stop 2023-07-13T14:21:27.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd92df5700 1 -- 172.21.15.118:0/3334367103 shutdown_connections 2023-07-13T14:21:27.039 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd92df5700 1 --2- 172.21.15.118:0/3334367103 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c070c80 0x7fdd8c1594a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:27.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd92df5700 1 -- 172.21.15.118:0/3334367103 >> 172.21.15.118:0/3334367103 conn(0x7fdd8c06d830 msgr2=0x7fdd8c06dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:21:27.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd92df5700 1 -- 172.21.15.118:0/3334367103 shutdown_connections 2023-07-13T14:21:27.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.047+0000 7fdd92df5700 1 -- 172.21.15.118:0/3334367103 wait complete. 2023-07-13T14:21:27.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.049+0000 7fdd92df5700 1 Processor -- start 2023-07-13T14:21:27.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.049+0000 7fdd92df5700 1 -- start start 2023-07-13T14:21:27.041 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.050+0000 7fdd92df5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd8c070c80 0x7fdd8c1ee8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:27.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.050+0000 7fdd92df5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c0c5280 0x7fdd8c153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:27.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.050+0000 7fdd92df5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c14bf30 0x7fdd8c1f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:27.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.050+0000 7fdd92df5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1eee20 con 0x7fdd8c070c80 2023-07-13T14:21:27.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.050+0000 7fdd92df5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1f1750 con 0x7fdd8c14bf30 2023-07-13T14:21:27.042 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.050+0000 7fdd92df5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1dfdc0 con 0x7fdd8c0c5280 2023-07-13T14:21:27.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.051+0000 7fdd90b91700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd8c070c80 0x7fdd8c1ee8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:27.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.051+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c0c5280 0x7fdd8c153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:27.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.051+0000 7fdd90b91700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd8c070c80 0x7fdd8c1ee8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44042/0 (socket says 172.21.15.118:44042) 2023-07-13T14:21:27.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.051+0000 7fdd90b91700 1 -- 172.21.15.118:0/263900597 learned_addr learned my addr 172.21.15.118:0/263900597 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:21:27.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.051+0000 7fdd91392700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c14bf30 0x7fdd8c1f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:27.047 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.056+0000 7fdd90b91700 1 -- 172.21.15.118:0/263900597 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c0c5280 msgr2=0x7fdd8c153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:27.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.056+0000 7fdd90b91700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c0c5280 0x7fdd8c153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:27.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.056+0000 7fdd90b91700 1 -- 172.21.15.118:0/263900597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c14bf30 msgr2=0x7fdd8c1f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:27.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.056+0000 7fdd90b91700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c14bf30 0x7fdd8c1f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:27.048 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.056+0000 7fdd90b91700 1 -- 172.21.15.118:0/263900597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780094a0 con 0x7fdd8c070c80 2023-07-13T14:21:27.050 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.059+0000 7fdd90b91700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd8c070c80 0x7fdd8c1ee8e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000c500 tx=0x7fdd8000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:27.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.063+0000 7fdd897fa700 1 -- 172.21.15.118:0/263900597 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80005d70 con 0x7fdd8c070c80 2023-07-13T14:21:27.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.063+0000 7fdd897fa700 1 -- 172.21.15.118:0/263900597 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8000ce90 con 0x7fdd8c070c80 2023-07-13T14:21:27.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.063+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c1dfb20 con 0x7fdd8c070c80 2023-07-13T14:21:27.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.063+0000 7fdd897fa700 1 -- 172.21.15.118:0/263900597 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800072d0 con 0x7fdd8c070c80 2023-07-13T14:21:27.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.063+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c1f1470 con 0x7fdd8c070c80 2023-07-13T14:21:27.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.064+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c1df8b0 con 0x7fdd8c070c80 2023-07-13T14:21:27.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.084+0000 7fdd897fa700 1 -- 172.21.15.118:0/263900597 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd80007430 con 0x7fdd8c070c80 2023-07-13T14:21:27.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.084+0000 7fdd897fa700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdd7006ad30 0x7fdd7006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:27.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.084+0000 7fdd8bfff700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdd7006ad30 0x7fdd7006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:27.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.085+0000 7fdd8bfff700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdd7006ad30 0x7fdd7006d1e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdd78000c00 tx=0x7fdd78008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.328+0000 7fdd897fa700 1 -- 172.21.15.118:0/263900597 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd8005ba10 con 0x7fdd8c070c80 2023-07-13T14:21:27.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.329+0000 7fdd897fa700 1 -- 172.21.15.118:0/263900597 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd80053e40 con 0x7fdd8c070c80 2023-07-13T14:21:27.503 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.512+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd8c158ca0 con 0x7fdd7006ad30 2023-07-13T14:21:27.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.522+0000 7fdd897fa700 1 -- 172.21.15.118:0/263900597 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+394090 (secure 0 0 0) 0x7fdd78006c60 con 0x7fdd7006ad30 2023-07-13T14:21:27.517 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:21:27.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdd7006ad30 msgr2=0x7fdd7006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:27.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdd7006ad30 0x7fdd7006d1e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdd78000c00 tx=0x7fdd78008030 comp rx=0 tx=0).stop 2023-07-13T14:21:27.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd8c070c80 msgr2=0x7fdd8c1ee8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:27.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd8c070c80 0x7fdd8c1ee8e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000c500 tx=0x7fdd8000c810 comp rx=0 tx=0).stop 2023-07-13T14:21:27.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 shutdown_connections 2023-07-13T14:21:27.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fdd7006ad30 0x7fdd7006d1e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:27.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd8c14bf30 0x7fdd8c1f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:27.520 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdd8c070c80 0x7fdd8c1ee8e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:27.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 --2- 172.21.15.118:0/263900597 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdd8c0c5280 0x7fdd8c153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:27.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 >> 172.21.15.118:0/263900597 conn(0x7fdd8c06d830 msgr2=0x7fdd8c148190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:21:27.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 shutdown_connections 2023-07-13T14:21:27.521 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:27.526+0000 7fdd92df5700 1 -- 172.21.15.118:0/263900597 wait complete. 2023-07-13T14:21:27.521 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T14:21:27.530 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":905,"stamp":"2023-07-13T14:21:27.310919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35755431,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":925,"num_read_kb":952,"num_write":11483,"num_write_kb":323812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13395,"ondisk_log_size":13395,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406344,"kb_used_data":50824,"kb_used_omap":13,"kb_used_meta":355442,"kb_avail":754568376,"statfs":{"total":773094113280,"available":772678017024,"internally_reserved":0,"allocated":52043776,"data_stored":72647622,"data_compressed":6272288,"data_compressed_allocated":9814016,"data_compressed_original":32006144,"omap_allocated":14248,"internal_metadata":363972696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002730"},"pg_stats":[{"pgid":"4.3f","version":"31'26","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.697055+0000","last_change":"2023-07-13T14:20:54.697055+0000","last_active":"2023-07-13T14:20:54.697055+0000","last_peered":"2023-07-13T14:20:54.697055+0000","last_clean":"2023-07-13T14:20:54.697055+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T14:20:54.697055+0000","last_undegraded":"2023-07-13T14:20:54.697055+0000","last_fullsized":"2023-07-13T14:20:54.697055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2023-07-13T14:20:54.696939+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2023-07-13T14:20:54.696939+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.696939+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:29:01.595104+0000","scrub_duration":0.018622025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"31'31","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.133215+0000","last_change":"2023-07-13T14:20:48.133215+0000","last_active":"2023-07-13T14:20:48.133215+0000","last_peered":"2023-07-13T14:20:48.133215+0000","last_clean":"2023-07-13T14:20:48.133215+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T14:20:48.133215+0000","last_undegraded":"2023-07-13T14:20:48.133215+0000","last_fullsized":"2023-07-13T14:20:48.133215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:48.133089+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:48.133089+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.133089+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:26:56.268712+0000","scrub_duration":0.021360286999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"31'36","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:45.472603+0000","last_change":"2023-07-13T14:20:45.472644+0000","last_active":"2023-07-13T14:20:45.472603+0000","last_peered":"2023-07-13T14:20:45.472603+0000","last_clean":"2023-07-13T14:20:45.472603+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T14:20:45.472603+0000","last_undegraded":"2023-07-13T14:20:45.472603+0000","last_fullsized":"2023-07-13T14:20:45.472603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:20:45.472514+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:20:45.472514+0000","last_clean_scrub_stamp":"2023-07-13T14:20:45.472514+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:24.113486+0000","scrub_duration":0.021725029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"31'25","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:53.442661+0000","last_change":"2023-07-13T14:20:53.442722+0000","last_active":"2023-07-13T14:20:53.442661+0000","last_peered":"2023-07-13T14:20:53.442661+0000","last_clean":"2023-07-13T14:20:53.442661+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T14:20:53.442661+0000","last_undegraded":"2023-07-13T14:20:53.442661+0000","last_fullsized":"2023-07-13T14:20:53.442661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2023-07-13T14:20:53.442582+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2023-07-13T14:20:53.442582+0000","last_clean_scrub_stamp":"2023-07-13T14:20:53.442582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:26:25.786899+0000","scrub_duration":0.021817185999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"31'23","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:42.761836+0000","last_change":"2023-07-13T14:20:42.761873+0000","last_active":"2023-07-13T14:20:42.761836+0000","last_peered":"2023-07-13T14:20:42.761836+0000","last_clean":"2023-07-13T14:20:42.761836+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T14:20:42.761836+0000","last_undegraded":"2023-07-13T14:20:42.761836+0000","last_fullsized":"2023-07-13T14:20:42.761836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2023-07-13T14:20:42.761766+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2023-07-13T14:20:42.761766+0000","last_clean_scrub_stamp":"2023-07-13T14:20:42.761766+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:02.865757+0000","scrub_duration":0.026158679000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.541567+0000","last_change":"2023-07-13T14:20:54.541633+0000","last_active":"2023-07-13T14:20:54.541567+0000","last_peered":"2023-07-13T14:20:54.541567+0000","last_clean":"2023-07-13T14:20:54.541567+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T14:20:54.541567+0000","last_undegraded":"2023-07-13T14:20:54.541567+0000","last_fullsized":"2023-07-13T14:20:54.541567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:54.541444+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:54.541444+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.541444+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:14:52.144625+0000","scrub_duration":0.021735659000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.535925+0000","last_change":"2023-07-13T14:21:17.535975+0000","last_active":"2023-07-13T14:21:17.535925+0000","last_peered":"2023-07-13T14:21:17.535925+0000","last_clean":"2023-07-13T14:21:17.535925+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T14:21:17.535925+0000","last_undegraded":"2023-07-13T14:21:17.535925+0000","last_fullsized":"2023-07-13T14:21:17.535925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:17.535835+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:17.535835+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.535835+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:56.176808+0000","scrub_duration":0.022364232000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"31'22","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.040019+0000","last_change":"2023-07-13T13:52:17.943417+0000","last_active":"2023-07-13T14:20:29.040019+0000","last_peered":"2023-07-13T14:20:29.040019+0000","last_clean":"2023-07-13T14:20:29.040019+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T14:20:29.040019+0000","last_undegraded":"2023-07-13T14:20:29.040019+0000","last_fullsized":"2023-07-13T14:20:29.040019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"31'35","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.801365+0000","last_change":"2023-07-13T14:21:14.801365+0000","last_active":"2023-07-13T14:21:14.801365+0000","last_peered":"2023-07-13T14:21:14.801365+0000","last_clean":"2023-07-13T14:21:14.801365+0000","last_became_active":"2023-07-13T13:52:58.032221+0000","last_became_peered":"2023-07-13T13:52:58.032221+0000","last_unstale":"2023-07-13T14:21:14.801365+0000","last_undegraded":"2023-07-13T14:21:14.801365+0000","last_fullsized":"2023-07-13T14:21:14.801365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:21:14.801249+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:21:14.801249+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.801249+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:51.777603+0000","scrub_duration":0.026178751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'37","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.853926+0000","last_change":"2023-07-13T13:52:17.886144+0000","last_active":"2023-07-13T14:20:43.853926+0000","last_peered":"2023-07-13T14:20:43.853926+0000","last_clean":"2023-07-13T14:20:43.853926+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T14:20:43.853926+0000","last_undegraded":"2023-07-13T14:20:43.853926+0000","last_fullsized":"2023-07-13T14:20:43.853926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"31'30","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.023455+0000","last_change":"2023-07-13T13:52:58.431745+0000","last_active":"2023-07-13T14:20:43.023455+0000","last_peered":"2023-07-13T14:20:43.023455+0000","last_clean":"2023-07-13T14:20:43.023455+0000","last_became_active":"2023-07-13T13:52:58.431466+0000","last_became_peered":"2023-07-13T13:52:58.431466+0000","last_unstale":"2023-07-13T14:20:43.023455+0000","last_undegraded":"2023-07-13T14:20:43.023455+0000","last_fullsized":"2023-07-13T14:20:43.023455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"31'22","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:53.729089+0000","last_change":"2023-07-13T14:20:53.729089+0000","last_active":"2023-07-13T14:20:53.729089+0000","last_peered":"2023-07-13T14:20:53.729089+0000","last_clean":"2023-07-13T14:20:53.729089+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T14:20:53.729089+0000","last_undegraded":"2023-07-13T14:20:53.729089+0000","last_fullsized":"2023-07-13T14:20:53.729089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:20:53.728917+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:20:53.728917+0000","last_clean_scrub_stamp":"2023-07-13T14:20:53.728917+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:13:12.259842+0000","scrub_duration":0.018519234999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"31'35","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:49.683702+0000","last_change":"2023-07-13T14:20:49.683702+0000","last_active":"2023-07-13T14:20:49.683702+0000","last_peered":"2023-07-13T14:20:49.683702+0000","last_clean":"2023-07-13T14:20:49.683702+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T14:20:49.683702+0000","last_undegraded":"2023-07-13T14:20:49.683702+0000","last_fullsized":"2023-07-13T14:20:49.683702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:49.683512+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:49.683512+0000","last_clean_scrub_stamp":"2023-07-13T14:20:49.683512+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:17.670520+0000","scrub_duration":0.018508302000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.160281+0000","last_change":"2023-07-13T14:20:51.160322+0000","last_active":"2023-07-13T14:20:51.160281+0000","last_peered":"2023-07-13T14:20:51.160281+0000","last_clean":"2023-07-13T14:20:51.160281+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T14:20:51.160281+0000","last_undegraded":"2023-07-13T14:20:51.160281+0000","last_fullsized":"2023-07-13T14:20:51.160281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:51.160209+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:51.160209+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.160209+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:42:01.494240+0000","scrub_duration":0.021377126999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"31'35","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.071552+0000","last_change":"2023-07-13T13:52:17.952009+0000","last_active":"2023-07-13T14:20:29.071552+0000","last_peered":"2023-07-13T14:20:29.071552+0000","last_clean":"2023-07-13T14:20:29.071552+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T14:20:29.071552+0000","last_undegraded":"2023-07-13T14:20:29.071552+0000","last_fullsized":"2023-07-13T14:20:29.071552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"31'33","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.527797+0000","last_change":"2023-07-13T14:21:04.527845+0000","last_active":"2023-07-13T14:21:04.527797+0000","last_peered":"2023-07-13T14:21:04.527797+0000","last_clean":"2023-07-13T14:21:04.527797+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T14:21:04.527797+0000","last_undegraded":"2023-07-13T14:21:04.527797+0000","last_fullsized":"2023-07-13T14:21:04.527797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:21:04.527716+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:21:04.527716+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.527716+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:49:58.363654+0000","scrub_duration":0.021725926,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.797179+0000","last_change":"2023-07-13T14:21:15.797275+0000","last_active":"2023-07-13T14:21:15.797179+0000","last_peered":"2023-07-13T14:21:15.797179+0000","last_clean":"2023-07-13T14:21:15.797179+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T14:21:15.797179+0000","last_undegraded":"2023-07-13T14:21:15.797179+0000","last_fullsized":"2023-07-13T14:21:15.797179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:21:15.797014+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:21:15.797014+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.797014+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:54:14.772881+0000","scrub_duration":0.026240900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"31'42","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.423055+0000","last_change":"2023-07-13T14:20:43.423153+0000","last_active":"2023-07-13T14:20:43.423055+0000","last_peered":"2023-07-13T14:20:43.423055+0000","last_clean":"2023-07-13T14:20:43.423055+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T14:20:43.423055+0000","last_undegraded":"2023-07-13T14:20:43.423055+0000","last_fullsized":"2023-07-13T14:20:43.423055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:20:43.422890+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:20:43.422890+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.422890+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:18.209416+0000","scrub_duration":0.021729281999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"31'31","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.700194+0000","last_change":"2023-07-13T14:20:52.700259+0000","last_active":"2023-07-13T14:20:52.700194+0000","last_peered":"2023-07-13T14:20:52.700194+0000","last_clean":"2023-07-13T14:20:52.700194+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T14:20:52.700194+0000","last_undegraded":"2023-07-13T14:20:52.700194+0000","last_fullsized":"2023-07-13T14:20:52.700194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:52.700065+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:52.700065+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.700065+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:50:47.705198+0000","scrub_duration":0.018490046999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"31'36","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.053082+0000","last_change":"2023-07-13T13:52:17.947070+0000","last_active":"2023-07-13T14:20:29.053082+0000","last_peered":"2023-07-13T14:20:29.053082+0000","last_clean":"2023-07-13T14:20:29.053082+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T14:20:29.053082+0000","last_undegraded":"2023-07-13T14:20:29.053082+0000","last_fullsized":"2023-07-13T14:20:29.053082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"31'46","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.508083+0000","last_change":"2023-07-13T14:21:20.508160+0000","last_active":"2023-07-13T14:21:20.508083+0000","last_peered":"2023-07-13T14:21:20.508083+0000","last_clean":"2023-07-13T14:21:20.508083+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T14:21:20.508083+0000","last_undegraded":"2023-07-13T14:21:20.508083+0000","last_fullsized":"2023-07-13T14:21:20.508083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-07-13T14:21:20.507957+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-07-13T14:21:20.507957+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.507957+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:27.331400+0000","scrub_duration":0.022308759000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"31'34","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:13.808106+0000","last_change":"2023-07-13T14:21:13.808172+0000","last_active":"2023-07-13T14:21:13.808106+0000","last_peered":"2023-07-13T14:21:13.808106+0000","last_clean":"2023-07-13T14:21:13.808106+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T14:21:13.808106+0000","last_undegraded":"2023-07-13T14:21:13.808106+0000","last_fullsized":"2023-07-13T14:21:13.808106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-07-13T14:21:13.808022+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-07-13T14:21:13.808022+0000","last_clean_scrub_stamp":"2023-07-13T14:21:13.808022+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:48.923447+0000","scrub_duration":0.026269797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"31'37","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.066257+0000","last_change":"2023-07-13T13:52:17.885722+0000","last_active":"2023-07-13T14:20:29.066257+0000","last_peered":"2023-07-13T14:20:29.066257+0000","last_clean":"2023-07-13T14:20:29.066257+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T14:20:29.066257+0000","last_undegraded":"2023-07-13T14:20:29.066257+0000","last_fullsized":"2023-07-13T14:20:29.066257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"31'27","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.520935+0000","last_change":"2023-07-13T14:21:24.520982+0000","last_active":"2023-07-13T14:21:24.520935+0000","last_peered":"2023-07-13T14:21:24.520935+0000","last_clean":"2023-07-13T14:21:24.520935+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T14:21:24.520935+0000","last_undegraded":"2023-07-13T14:21:24.520935+0000","last_fullsized":"2023-07-13T14:21:24.520935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:24.520845+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:24.520845+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.520845+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:20:20.865660+0000","scrub_duration":0.022271132999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"31'27","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.315400+0000","last_change":"2023-07-13T14:20:43.315464+0000","last_active":"2023-07-13T14:20:43.315400+0000","last_peered":"2023-07-13T14:20:43.315400+0000","last_clean":"2023-07-13T14:20:43.315400+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T14:20:43.315400+0000","last_undegraded":"2023-07-13T14:20:43.315400+0000","last_fullsized":"2023-07-13T14:20:43.315400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:20:43.315283+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:20:43.315283+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.315283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:20:32.602676+0000","scrub_duration":0.019068186000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"31'39","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.143444+0000","last_change":"2023-07-13T14:21:04.143551+0000","last_active":"2023-07-13T14:21:04.143444+0000","last_peered":"2023-07-13T14:21:04.143444+0000","last_clean":"2023-07-13T14:21:04.143444+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T14:21:04.143444+0000","last_undegraded":"2023-07-13T14:21:04.143444+0000","last_fullsized":"2023-07-13T14:21:04.143444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-07-13T14:21:04.143279+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-07-13T14:21:04.143279+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.143279+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:15:59.993894+0000","scrub_duration":0.019113529000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"31'23","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.037902+0000","last_change":"2023-07-13T13:52:17.838732+0000","last_active":"2023-07-13T14:20:29.037902+0000","last_peered":"2023-07-13T14:20:29.037902+0000","last_clean":"2023-07-13T14:20:29.037902+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T14:20:29.037902+0000","last_undegraded":"2023-07-13T14:20:29.037902+0000","last_fullsized":"2023-07-13T14:20:29.037902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"31'82","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:56.962208+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T14:19:56.962208+0000","last_peered":"2023-07-13T14:19:56.962208+0000","last_clean":"2023-07-13T14:19:56.962208+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T14:19:56.962208+0000","last_undegraded":"2023-07-13T14:19:56.962208+0000","last_fullsized":"2023-07-13T14:19:56.962208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"31'646","reported_seq":693,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:11.551318+0000","last_change":"2023-07-13T14:21:11.551370+0000","last_active":"2023-07-13T14:21:11.551318+0000","last_peered":"2023-07-13T14:21:11.551318+0000","last_clean":"2023-07-13T14:21:11.551318+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T14:21:11.551318+0000","last_undegraded":"2023-07-13T14:21:11.551318+0000","last_fullsized":"2023-07-13T14:21:11.551318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'646","last_scrub_stamp":"2023-07-13T14:21:11.551230+0000","last_deep_scrub":"31'646","last_deep_scrub_stamp":"2023-07-13T14:21:11.551230+0000","last_clean_scrub_stamp":"2023-07-13T14:21:11.551230+0000","objects_scrubbed":1,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:37.312929+0000","scrub_duration":0.060728402000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'42","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.145466+0000","last_change":"2023-07-13T14:20:51.145520+0000","last_active":"2023-07-13T14:20:51.145466+0000","last_peered":"2023-07-13T14:20:51.145466+0000","last_clean":"2023-07-13T14:20:51.145466+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T14:20:51.145466+0000","last_undegraded":"2023-07-13T14:20:51.145466+0000","last_fullsized":"2023-07-13T14:20:51.145466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:20:51.145400+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:20:51.145400+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.145400+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:47:22.361088+0000","scrub_duration":0.018685159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'125","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:01.236205+0000","last_change":"2023-07-13T14:21:01.236275+0000","last_active":"2023-07-13T14:21:01.236205+0000","last_peered":"2023-07-13T14:21:01.236205+0000","last_clean":"2023-07-13T14:21:01.236205+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T14:21:01.236205+0000","last_undegraded":"2023-07-13T14:21:01.236205+0000","last_fullsized":"2023-07-13T14:21:01.236205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'125","last_scrub_stamp":"2023-07-13T14:21:01.236103+0000","last_deep_scrub":"31'125","last_deep_scrub_stamp":"2023-07-13T14:21:01.236103+0000","last_clean_scrub_stamp":"2023-07-13T14:21:01.236103+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:12:45.305574+0000","scrub_duration":0.021819373999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":11569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.246199+0000","last_change":"2023-07-13T14:20:51.246199+0000","last_active":"2023-07-13T14:20:51.246199+0000","last_peered":"2023-07-13T14:20:51.246199+0000","last_clean":"2023-07-13T14:20:51.246199+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T14:20:51.246199+0000","last_undegraded":"2023-07-13T14:20:51.246199+0000","last_fullsized":"2023-07-13T14:20:51.246199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:20:51.246065+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:20:51.246065+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.246065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:11.350056+0000","scrub_duration":0.019069163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'20","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.772093+0000","last_change":"2023-07-13T14:21:17.772134+0000","last_active":"2023-07-13T14:21:17.772093+0000","last_peered":"2023-07-13T14:21:17.772093+0000","last_clean":"2023-07-13T14:21:17.772093+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T14:21:17.772093+0000","last_undegraded":"2023-07-13T14:21:17.772093+0000","last_fullsized":"2023-07-13T14:21:17.772093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2023-07-13T14:21:17.771947+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2023-07-13T14:21:17.771947+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.771947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:21:46.504818+0000","scrub_duration":0.026258467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"31'103","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:26.877408+0000","last_change":"2023-07-13T14:21:26.877482+0000","last_active":"2023-07-13T14:21:26.877408+0000","last_peered":"2023-07-13T14:21:26.877408+0000","last_clean":"2023-07-13T14:21:26.877408+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T14:21:26.877408+0000","last_undegraded":"2023-07-13T14:21:26.877408+0000","last_fullsized":"2023-07-13T14:21:26.877408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'103","last_scrub_stamp":"2023-07-13T14:21:26.877311+0000","last_deep_scrub":"31'103","last_deep_scrub_stamp":"2023-07-13T14:21:26.877311+0000","last_clean_scrub_stamp":"2023-07-13T14:21:26.877311+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:20:59.860554+0000","scrub_duration":0.026184144999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'5","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:00.291754+0000","last_change":"2023-07-13T14:21:00.291754+0000","last_active":"2023-07-13T14:21:00.291754+0000","last_peered":"2023-07-13T14:21:00.291754+0000","last_clean":"2023-07-13T14:21:00.291754+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T14:21:00.291754+0000","last_undegraded":"2023-07-13T14:21:00.291754+0000","last_fullsized":"2023-07-13T14:21:00.291754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:00.291634+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:00.291634+0000","last_clean_scrub_stamp":"2023-07-13T14:21:00.291634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:14:46.956921+0000","scrub_duration":0.018782136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'33","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.429841+0000","last_change":"2023-07-13T14:20:54.429841+0000","last_active":"2023-07-13T14:20:54.429841+0000","last_peered":"2023-07-13T14:20:54.429841+0000","last_clean":"2023-07-13T14:20:54.429841+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T14:20:54.429841+0000","last_undegraded":"2023-07-13T14:20:54.429841+0000","last_fullsized":"2023-07-13T14:20:54.429841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:20:54.429670+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:20:54.429670+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.429670+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:42:05.035579+0000","scrub_duration":0.021817006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"31'138","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.136451+0000","last_change":"2023-07-13T14:21:06.136507+0000","last_active":"2023-07-13T14:21:06.136451+0000","last_peered":"2023-07-13T14:21:06.136451+0000","last_clean":"2023-07-13T14:21:06.136451+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T14:21:06.136451+0000","last_undegraded":"2023-07-13T14:21:06.136451+0000","last_fullsized":"2023-07-13T14:21:06.136451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2023-07-13T14:21:06.136370+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2023-07-13T14:21:06.136370+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.136370+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:21:06.038112+0000","scrub_duration":0.021842811,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.826568+0000","last_change":"2023-07-13T14:20:55.826568+0000","last_active":"2023-07-13T14:20:55.826568+0000","last_peered":"2023-07-13T14:20:55.826568+0000","last_clean":"2023-07-13T14:20:55.826568+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T14:20:55.826568+0000","last_undegraded":"2023-07-13T14:20:55.826568+0000","last_fullsized":"2023-07-13T14:20:55.826568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:20:55.826367+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:20:55.826367+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.826367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:34:15.274393+0000","scrub_duration":0.026266379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'25","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.354725+0000","last_change":"2023-07-13T14:21:22.354769+0000","last_active":"2023-07-13T14:21:22.354725+0000","last_peered":"2023-07-13T14:21:22.354725+0000","last_clean":"2023-07-13T14:21:22.354725+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T14:21:22.354725+0000","last_undegraded":"2023-07-13T14:21:22.354725+0000","last_fullsized":"2023-07-13T14:21:22.354725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2023-07-13T14:21:22.354661+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2023-07-13T14:21:22.354661+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.354661+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:03:56.296165+0000","scrub_duration":0.018806537000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'89","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:27.098233+0000","last_change":"2023-07-13T13:52:23.976107+0000","last_active":"2023-07-13T14:20:27.098233+0000","last_peered":"2023-07-13T14:20:27.098233+0000","last_clean":"2023-07-13T14:20:27.098233+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T14:20:27.098233+0000","last_undegraded":"2023-07-13T14:20:27.098233+0000","last_fullsized":"2023-07-13T14:20:27.098233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":9189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'5","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.215028+0000","last_change":"2023-07-13T14:21:20.215066+0000","last_active":"2023-07-13T14:21:20.215028+0000","last_peered":"2023-07-13T14:21:20.215028+0000","last_clean":"2023-07-13T14:21:20.215028+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T14:21:20.215028+0000","last_undegraded":"2023-07-13T14:21:20.215028+0000","last_fullsized":"2023-07-13T14:21:20.215028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:20.214953+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:20.214953+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.214953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:15:17.818133+0000","scrub_duration":0.02134776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"31'28","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.066141+0000","last_change":"2023-07-13T13:52:17.838475+0000","last_active":"2023-07-13T14:20:29.066141+0000","last_peered":"2023-07-13T14:20:29.066141+0000","last_clean":"2023-07-13T14:20:29.066141+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T14:20:29.066141+0000","last_undegraded":"2023-07-13T14:20:29.066141+0000","last_fullsized":"2023-07-13T14:20:29.066141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"31'148","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.914524+0000","last_change":"2023-07-13T13:52:23.989534+0000","last_active":"2023-07-13T14:20:26.914524+0000","last_peered":"2023-07-13T14:20:26.914524+0000","last_clean":"2023-07-13T14:20:26.914524+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T14:20:26.914524+0000","last_undegraded":"2023-07-13T14:20:26.914524+0000","last_fullsized":"2023-07-13T14:20:26.914524+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":18843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'537","reported_seq":585,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.566013+0000","last_change":"2023-07-13T14:21:06.566013+0000","last_active":"2023-07-13T14:21:06.566013+0000","last_peered":"2023-07-13T14:21:06.566013+0000","last_clean":"2023-07-13T14:21:06.566013+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T14:21:06.566013+0000","last_undegraded":"2023-07-13T14:21:06.566013+0000","last_fullsized":"2023-07-13T14:21:06.566013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'537","last_scrub_stamp":"2023-07-13T14:21:06.565893+0000","last_deep_scrub":"31'537","last_deep_scrub_stamp":"2023-07-13T14:21:06.565893+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.565893+0000","objects_scrubbed":2,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:47:37.781581+0000","scrub_duration":0.031191707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"31'35","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:16.101485+0000","last_change":"2023-07-13T14:21:16.101562+0000","last_active":"2023-07-13T14:21:16.101485+0000","last_peered":"2023-07-13T14:21:16.101485+0000","last_clean":"2023-07-13T14:21:16.101485+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T14:21:16.101485+0000","last_undegraded":"2023-07-13T14:21:16.101485+0000","last_fullsized":"2023-07-13T14:21:16.101485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:21:16.101342+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:21:16.101342+0000","last_clean_scrub_stamp":"2023-07-13T14:21:16.101342+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:35:27.568107+0000","scrub_duration":0.019133585000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'132","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:25.086756+0000","last_change":"2023-07-13T14:21:25.086907+0000","last_active":"2023-07-13T14:21:25.086756+0000","last_peered":"2023-07-13T14:21:25.086756+0000","last_clean":"2023-07-13T14:21:25.086756+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T14:21:25.086756+0000","last_undegraded":"2023-07-13T14:21:25.086756+0000","last_fullsized":"2023-07-13T14:21:25.086756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2023-07-13T14:21:25.086576+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2023-07-13T14:21:25.086576+0000","last_clean_scrub_stamp":"2023-07-13T14:21:25.086576+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:21:53.819446+0000","scrub_duration":0.019060541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":15927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'849","reported_seq":897,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:19.596346+0000","last_change":"2023-07-13T14:21:19.596430+0000","last_active":"2023-07-13T14:21:19.596346+0000","last_peered":"2023-07-13T14:21:19.596346+0000","last_clean":"2023-07-13T14:21:19.596346+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T14:21:19.596346+0000","last_undegraded":"2023-07-13T14:21:19.596346+0000","last_fullsized":"2023-07-13T14:21:19.596346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'849","last_scrub_stamp":"2023-07-13T14:21:19.596255+0000","last_deep_scrub":"31'849","last_deep_scrub_stamp":"2023-07-13T14:21:19.596255+0000","last_clean_scrub_stamp":"2023-07-13T14:21:19.596255+0000","objects_scrubbed":4,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:38:48.253897+0000","scrub_duration":0.065532147999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"31'43","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.552757+0000","last_change":"2023-07-13T14:21:06.552817+0000","last_active":"2023-07-13T14:21:06.552757+0000","last_peered":"2023-07-13T14:21:06.552757+0000","last_clean":"2023-07-13T14:21:06.552757+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T14:21:06.552757+0000","last_undegraded":"2023-07-13T14:21:06.552757+0000","last_fullsized":"2023-07-13T14:21:06.552757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-07-13T14:21:06.552623+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-07-13T14:21:06.552623+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.552623+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:03:40.494128+0000","scrub_duration":0.021820767000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"31'113","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.853977+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T14:20:43.853977+0000","last_peered":"2023-07-13T14:20:43.853977+0000","last_clean":"2023-07-13T14:20:43.853977+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T14:20:43.853977+0000","last_undegraded":"2023-07-13T14:20:43.853977+0000","last_fullsized":"2023-07-13T14:20:43.853977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":11208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'10","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:10.564980+0000","last_change":"2023-07-13T14:21:10.565038+0000","last_active":"2023-07-13T14:21:10.564980+0000","last_peered":"2023-07-13T14:21:10.564980+0000","last_clean":"2023-07-13T14:21:10.564980+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T14:21:10.564980+0000","last_undegraded":"2023-07-13T14:21:10.564980+0000","last_fullsized":"2023-07-13T14:21:10.564980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-07-13T14:21:10.564908+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-07-13T14:21:10.564908+0000","last_clean_scrub_stamp":"2023-07-13T14:21:10.564908+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:32.202876+0000","scrub_duration":0.031257395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'27","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:26.426145+0000","last_change":"2023-07-13T14:21:26.426225+0000","last_active":"2023-07-13T14:21:26.426145+0000","last_peered":"2023-07-13T14:21:26.426145+0000","last_clean":"2023-07-13T14:21:26.426145+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T14:21:26.426145+0000","last_undegraded":"2023-07-13T14:21:26.426145+0000","last_fullsized":"2023-07-13T14:21:26.426145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:26.426058+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:26.426058+0000","last_clean_scrub_stamp":"2023-07-13T14:21:26.426058+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:39.253015+0000","scrub_duration":0.018757216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'88","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.914537+0000","last_change":"2023-07-13T13:52:23.993040+0000","last_active":"2023-07-13T14:20:26.914537+0000","last_peered":"2023-07-13T14:20:26.914537+0000","last_clean":"2023-07-13T14:20:26.914537+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T14:20:26.914537+0000","last_undegraded":"2023-07-13T14:20:26.914537+0000","last_fullsized":"2023-07-13T14:20:26.914537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.785349+0000","last_change":"2023-07-13T14:20:43.785391+0000","last_active":"2023-07-13T14:20:43.785349+0000","last_peered":"2023-07-13T14:20:43.785349+0000","last_clean":"2023-07-13T14:20:43.785349+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T14:20:43.785349+0000","last_undegraded":"2023-07-13T14:20:43.785349+0000","last_fullsized":"2023-07-13T14:20:43.785349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:20:43.785283+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:20:43.785283+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.785283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:08:06.382987+0000","scrub_duration":0.026179840999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'29","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.853915+0000","last_change":"2023-07-13T13:52:17.842974+0000","last_active":"2023-07-13T14:20:43.853915+0000","last_peered":"2023-07-13T14:20:43.853915+0000","last_clean":"2023-07-13T14:20:43.853915+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T14:20:43.853915+0000","last_undegraded":"2023-07-13T14:20:43.853915+0000","last_fullsized":"2023-07-13T14:20:43.853915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"31'107","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:42.160524+0000","last_change":"2023-07-13T13:52:23.989018+0000","last_active":"2023-07-13T14:20:42.160524+0000","last_peered":"2023-07-13T14:20:42.160524+0000","last_clean":"2023-07-13T14:20:42.160524+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T14:20:42.160524+0000","last_undegraded":"2023-07-13T14:20:42.160524+0000","last_fullsized":"2023-07-13T14:20:42.160524+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.470947+0000","last_change":"2023-07-13T14:21:14.470983+0000","last_active":"2023-07-13T14:21:14.470947+0000","last_peered":"2023-07-13T14:21:14.470947+0000","last_clean":"2023-07-13T14:21:14.470947+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T14:21:14.470947+0000","last_undegraded":"2023-07-13T14:21:14.470947+0000","last_fullsized":"2023-07-13T14:21:14.470947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:14.470809+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:14.470809+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.470809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:50.802085+0000","scrub_duration":0.022385644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"31'37","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:19.866372+0000","last_change":"2023-07-13T14:21:19.866463+0000","last_active":"2023-07-13T14:21:19.866372+0000","last_peered":"2023-07-13T14:21:19.866372+0000","last_clean":"2023-07-13T14:21:19.866372+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T14:21:19.866372+0000","last_undegraded":"2023-07-13T14:21:19.866372+0000","last_fullsized":"2023-07-13T14:21:19.866372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:19.866258+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:19.866258+0000","last_clean_scrub_stamp":"2023-07-13T14:21:19.866258+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:15:25.513288+0000","scrub_duration":0.026200731000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'128","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.854019+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T14:20:43.854019+0000","last_peered":"2023-07-13T14:20:43.854019+0000","last_clean":"2023-07-13T14:20:43.854019+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T14:20:43.854019+0000","last_undegraded":"2023-07-13T14:20:43.854019+0000","last_fullsized":"2023-07-13T14:20:43.854019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'18","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.559346+0000","last_change":"2023-07-13T14:20:48.559393+0000","last_active":"2023-07-13T14:20:48.559346+0000","last_peered":"2023-07-13T14:20:48.559346+0000","last_clean":"2023-07-13T14:20:48.559346+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T14:20:48.559346+0000","last_undegraded":"2023-07-13T14:20:48.559346+0000","last_fullsized":"2023-07-13T14:20:48.559346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2023-07-13T14:20:48.559269+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2023-07-13T14:20:48.559269+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.559269+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:31:48.936886+0000","scrub_duration":0.030617008000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'32","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.214449+0000","last_change":"2023-07-13T14:20:43.214449+0000","last_active":"2023-07-13T14:20:43.214449+0000","last_peered":"2023-07-13T14:20:43.214449+0000","last_clean":"2023-07-13T14:20:43.214449+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T14:20:43.214449+0000","last_undegraded":"2023-07-13T14:20:43.214449+0000","last_fullsized":"2023-07-13T14:20:43.214449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:43.214310+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:43.214310+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.214310+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:41:53.548341+0000","scrub_duration":0.018645834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"31'122","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:37.099564+0000","last_change":"2023-07-13T13:52:23.977854+0000","last_active":"2023-07-13T14:20:37.099564+0000","last_peered":"2023-07-13T14:20:37.099564+0000","last_clean":"2023-07-13T14:20:37.099564+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T14:20:37.099564+0000","last_undegraded":"2023-07-13T14:20:37.099564+0000","last_fullsized":"2023-07-13T14:20:37.099564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.629229+0000","last_change":"2023-07-13T14:20:48.629275+0000","last_active":"2023-07-13T14:20:48.629229+0000","last_peered":"2023-07-13T14:20:48.629229+0000","last_clean":"2023-07-13T14:20:48.629229+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T14:20:48.629229+0000","last_undegraded":"2023-07-13T14:20:48.629229+0000","last_fullsized":"2023-07-13T14:20:48.629229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:20:48.629154+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:20:48.629154+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.629154+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:08:43.034204+0000","scrub_duration":0.031242654000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"31'31","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:46.079615+0000","last_change":"2023-07-13T14:20:46.079652+0000","last_active":"2023-07-13T14:20:46.079615+0000","last_peered":"2023-07-13T14:20:46.079615+0000","last_clean":"2023-07-13T14:20:46.079615+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T14:20:46.079615+0000","last_undegraded":"2023-07-13T14:20:46.079615+0000","last_fullsized":"2023-07-13T14:20:46.079615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:46.079455+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:46.079455+0000","last_clean_scrub_stamp":"2023-07-13T14:20:46.079455+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:36:54.890046+0000","scrub_duration":0.021429993000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'99","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:00.640773+0000","last_change":"2023-07-13T14:21:00.640860+0000","last_active":"2023-07-13T14:21:00.640773+0000","last_peered":"2023-07-13T14:21:00.640773+0000","last_clean":"2023-07-13T14:21:00.640773+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T14:21:00.640773+0000","last_undegraded":"2023-07-13T14:21:00.640773+0000","last_fullsized":"2023-07-13T14:21:00.640773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2023-07-13T14:21:00.640670+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2023-07-13T14:21:00.640670+0000","last_clean_scrub_stamp":"2023-07-13T14:21:00.640670+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:26:32.984986+0000","scrub_duration":0.018598401000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'8","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:12.485183+0000","last_change":"2023-07-13T14:21:12.485227+0000","last_active":"2023-07-13T14:21:12.485183+0000","last_peered":"2023-07-13T14:21:12.485183+0000","last_clean":"2023-07-13T14:21:12.485183+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T14:21:12.485183+0000","last_undegraded":"2023-07-13T14:21:12.485183+0000","last_fullsized":"2023-07-13T14:21:12.485183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-07-13T14:21:12.485090+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-07-13T14:21:12.485090+0000","last_clean_scrub_stamp":"2023-07-13T14:21:12.485090+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:36:08.834249+0000","scrub_duration":0.031224683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"31'27","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.539150+0000","last_change":"2023-07-13T14:21:08.539193+0000","last_active":"2023-07-13T14:21:08.539150+0000","last_peered":"2023-07-13T14:21:08.539150+0000","last_clean":"2023-07-13T14:21:08.539150+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T14:21:08.539150+0000","last_undegraded":"2023-07-13T14:21:08.539150+0000","last_fullsized":"2023-07-13T14:21:08.539150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:08.539028+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:08.539028+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.539028+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:16.140163+0000","scrub_duration":0.021778479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"31'154","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.713795+0000","last_change":"2023-07-13T14:20:55.713847+0000","last_active":"2023-07-13T14:20:55.713795+0000","last_peered":"2023-07-13T14:20:55.713795+0000","last_clean":"2023-07-13T14:20:55.713795+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T14:20:55.713795+0000","last_undegraded":"2023-07-13T14:20:55.713795+0000","last_fullsized":"2023-07-13T14:20:55.713795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-07-13T14:20:55.713721+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-07-13T14:20:55.713721+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.713721+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:03:36.441089+0000","scrub_duration":0.018574487000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.481747+0000","last_change":"2023-07-13T14:21:15.481788+0000","last_active":"2023-07-13T14:21:15.481747+0000","last_peered":"2023-07-13T14:21:15.481747+0000","last_clean":"2023-07-13T14:21:15.481747+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T14:21:15.481747+0000","last_undegraded":"2023-07-13T14:21:15.481747+0000","last_fullsized":"2023-07-13T14:21:15.481747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:15.481684+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:15.481684+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.481684+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:15:02.146971+0000","scrub_duration":0.031206836000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"31'24","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.273574+0000","last_change":"2023-07-13T14:20:59.273634+0000","last_active":"2023-07-13T14:20:59.273574+0000","last_peered":"2023-07-13T14:20:59.273574+0000","last_clean":"2023-07-13T14:20:59.273574+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T14:20:59.273574+0000","last_undegraded":"2023-07-13T14:20:59.273574+0000","last_fullsized":"2023-07-13T14:20:59.273574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2023-07-13T14:20:59.273490+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2023-07-13T14:20:59.273490+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.273490+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:09:45.879482+0000","scrub_duration":0.021897019,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'113","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:03.664593+0000","last_change":"2023-07-13T14:21:03.664668+0000","last_active":"2023-07-13T14:21:03.664593+0000","last_peered":"2023-07-13T14:21:03.664593+0000","last_clean":"2023-07-13T14:21:03.664593+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T14:21:03.664593+0000","last_undegraded":"2023-07-13T14:21:03.664593+0000","last_fullsized":"2023-07-13T14:21:03.664593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'113","last_scrub_stamp":"2023-07-13T14:21:03.664506+0000","last_deep_scrub":"31'113","last_deep_scrub_stamp":"2023-07-13T14:21:03.664506+0000","last_clean_scrub_stamp":"2023-07-13T14:21:03.664506+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:06:43.199058+0000","scrub_duration":0.018497283999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'3","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:19.052624+0000","last_change":"2023-07-13T13:52:16.667895+0000","last_active":"2023-07-13T14:20:19.052624+0000","last_peered":"2023-07-13T14:20:19.052624+0000","last_clean":"2023-07-13T14:20:19.052624+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T14:20:19.052624+0000","last_undegraded":"2023-07-13T14:20:19.052624+0000","last_fullsized":"2023-07-13T14:20:19.052624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:15.318351+0000","last_clean_scrub_stamp":"2023-07-13T13:52:15.318351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:40.804765+0000","last_change":"2023-07-13T14:20:40.804835+0000","last_active":"2023-07-13T14:20:40.804765+0000","last_peered":"2023-07-13T14:20:40.804765+0000","last_clean":"2023-07-13T14:20:40.804765+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T14:20:40.804765+0000","last_undegraded":"2023-07-13T14:20:40.804765+0000","last_fullsized":"2023-07-13T14:20:40.804765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_clean_scrub_stamp":"2023-07-13T14:20:40.804640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:21.603330+0000","scrub_duration":0.026215853000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'94","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.659702+0000","last_change":"2023-07-13T14:20:59.659758+0000","last_active":"2023-07-13T14:20:59.659702+0000","last_peered":"2023-07-13T14:20:59.659702+0000","last_clean":"2023-07-13T14:20:59.659702+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T14:20:59.659702+0000","last_undegraded":"2023-07-13T14:20:59.659702+0000","last_fullsized":"2023-07-13T14:20:59.659702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'94","last_scrub_stamp":"2023-07-13T14:20:59.659593+0000","last_deep_scrub":"31'94","last_deep_scrub_stamp":"2023-07-13T14:20:59.659593+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.659593+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:03:44.402498+0000","scrub_duration":0.018527055000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'582","reported_seq":630,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.321603+0000","last_change":"2023-07-13T14:20:59.321647+0000","last_active":"2023-07-13T14:20:59.321603+0000","last_peered":"2023-07-13T14:20:59.321603+0000","last_clean":"2023-07-13T14:20:59.321603+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T14:20:59.321603+0000","last_undegraded":"2023-07-13T14:20:59.321603+0000","last_fullsized":"2023-07-13T14:20:59.321603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'582","last_scrub_stamp":"2023-07-13T14:20:59.321528+0000","last_deep_scrub":"31'582","last_deep_scrub_stamp":"2023-07-13T14:20:59.321528+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.321528+0000","objects_scrubbed":2,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:35.652804+0000","scrub_duration":0.066498466000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"31'30","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056266+0000","last_change":"2023-07-13T13:52:17.942953+0000","last_active":"2023-07-13T14:20:29.056266+0000","last_peered":"2023-07-13T14:20:29.056266+0000","last_clean":"2023-07-13T14:20:29.056266+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T14:20:29.056266+0000","last_undegraded":"2023-07-13T14:20:29.056266+0000","last_fullsized":"2023-07-13T14:20:29.056266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'157","reported_seq":195,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:23.143703+0000","last_change":"2023-07-13T14:21:23.143800+0000","last_active":"2023-07-13T14:21:23.143703+0000","last_peered":"2023-07-13T14:21:23.143703+0000","last_clean":"2023-07-13T14:21:23.143703+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T14:21:23.143703+0000","last_undegraded":"2023-07-13T14:21:23.143703+0000","last_fullsized":"2023-07-13T14:21:23.143703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'157","last_scrub_stamp":"2023-07-13T14:21:23.143535+0000","last_deep_scrub":"31'157","last_deep_scrub_stamp":"2023-07-13T14:21:23.143535+0000","last_clean_scrub_stamp":"2023-07-13T14:21:23.143535+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:54:22.119402+0000","scrub_duration":0.019107764999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":13657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.537406+0000","last_change":"2023-07-13T14:20:47.537449+0000","last_active":"2023-07-13T14:20:47.537406+0000","last_peered":"2023-07-13T14:20:47.537406+0000","last_clean":"2023-07-13T14:20:47.537406+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T14:20:47.537406+0000","last_undegraded":"2023-07-13T14:20:47.537406+0000","last_fullsized":"2023-07-13T14:20:47.537406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-07-13T14:20:47.537321+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-07-13T14:20:47.537321+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.537321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:28:54.435486+0000","scrub_duration":0.021817349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"31'28","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.552781+0000","last_change":"2023-07-13T14:20:48.552823+0000","last_active":"2023-07-13T14:20:48.552781+0000","last_peered":"2023-07-13T14:20:48.552781+0000","last_clean":"2023-07-13T14:20:48.552781+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T14:20:48.552781+0000","last_undegraded":"2023-07-13T14:20:48.552781+0000","last_fullsized":"2023-07-13T14:20:48.552781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:20:48.552706+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:20:48.552706+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.552706+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:08:55.376149+0000","scrub_duration":0.021718227999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'108","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.576338+0000","last_change":"2023-07-13T13:52:23.988052+0000","last_active":"2023-07-13T14:19:53.576338+0000","last_peered":"2023-07-13T14:19:53.576338+0000","last_clean":"2023-07-13T14:19:53.576338+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T14:19:53.576338+0000","last_undegraded":"2023-07-13T14:19:53.576338+0000","last_fullsized":"2023-07-13T14:19:53.576338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":8018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.584862+0000","last_change":"2023-07-13T14:21:22.584927+0000","last_active":"2023-07-13T14:21:22.584862+0000","last_peered":"2023-07-13T14:21:22.584862+0000","last_clean":"2023-07-13T14:21:22.584862+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T14:21:22.584862+0000","last_undegraded":"2023-07-13T14:21:22.584862+0000","last_fullsized":"2023-07-13T14:21:22.584862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-07-13T14:21:22.584760+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-07-13T14:21:22.584760+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.584760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:25:52.988554+0000","scrub_duration":0.021702089000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"31'17","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.053228+0000","last_change":"2023-07-13T13:52:17.945935+0000","last_active":"2023-07-13T14:20:29.053228+0000","last_peered":"2023-07-13T14:20:29.053228+0000","last_clean":"2023-07-13T14:20:29.053228+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T14:20:29.053228+0000","last_undegraded":"2023-07-13T14:20:29.053228+0000","last_fullsized":"2023-07-13T14:20:29.053228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'97","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:51.776725+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T14:19:51.776725+0000","last_peered":"2023-07-13T14:19:51.776725+0000","last_clean":"2023-07-13T14:19:51.776725+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T14:19:51.776725+0000","last_undegraded":"2023-07-13T14:19:51.776725+0000","last_fullsized":"2023-07-13T14:19:51.776725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:13.404244+0000","last_change":"2023-07-13T14:21:13.404287+0000","last_active":"2023-07-13T14:21:13.404244+0000","last_peered":"2023-07-13T14:21:13.404244+0000","last_clean":"2023-07-13T14:21:13.404244+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T14:21:13.404244+0000","last_undegraded":"2023-07-13T14:21:13.404244+0000","last_fullsized":"2023-07-13T14:21:13.404244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:21:13.404167+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:21:13.404167+0000","last_clean_scrub_stamp":"2023-07-13T14:21:13.404167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:19:22.688047+0000","scrub_duration":0.018715822999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'31","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:01.167043+0000","last_change":"2023-07-13T14:21:01.167106+0000","last_active":"2023-07-13T14:21:01.167043+0000","last_peered":"2023-07-13T14:21:01.167043+0000","last_clean":"2023-07-13T14:21:01.167043+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T14:21:01.167043+0000","last_undegraded":"2023-07-13T14:21:01.167043+0000","last_fullsized":"2023-07-13T14:21:01.167043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:01.166959+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:01.166959+0000","last_clean_scrub_stamp":"2023-07-13T14:21:01.166959+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:55.302665+0000","scrub_duration":0.019059868000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"31'114","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:23.861858+0000","last_change":"2023-07-13T14:21:23.861964+0000","last_active":"2023-07-13T14:21:23.861858+0000","last_peered":"2023-07-13T14:21:23.861858+0000","last_clean":"2023-07-13T14:21:23.861858+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T14:21:23.861858+0000","last_undegraded":"2023-07-13T14:21:23.861858+0000","last_fullsized":"2023-07-13T14:21:23.861858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'114","last_scrub_stamp":"2023-07-13T14:21:23.861696+0000","last_deep_scrub":"31'114","last_deep_scrub_stamp":"2023-07-13T14:21:23.861696+0000","last_clean_scrub_stamp":"2023-07-13T14:21:23.861696+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:14.235446+0000","scrub_duration":0.026254771999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.250142+0000","last_change":"2023-07-13T14:20:47.250142+0000","last_active":"2023-07-13T14:20:47.250142+0000","last_peered":"2023-07-13T14:20:47.250142+0000","last_clean":"2023-07-13T14:20:47.250142+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T14:20:47.250142+0000","last_undegraded":"2023-07-13T14:20:47.250142+0000","last_fullsized":"2023-07-13T14:20:47.250142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:47.250012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:47.250012+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.250012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:52.091091+0000","scrub_duration":0.019134366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:11.180189+0000","last_change":"2023-07-13T14:21:11.180189+0000","last_active":"2023-07-13T14:21:11.180189+0000","last_peered":"2023-07-13T14:21:11.180189+0000","last_clean":"2023-07-13T14:21:11.180189+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T14:21:11.180189+0000","last_undegraded":"2023-07-13T14:21:11.180189+0000","last_fullsized":"2023-07-13T14:21:11.180189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:21:11.179942+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:21:11.179942+0000","last_clean_scrub_stamp":"2023-07-13T14:21:11.179942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:49.820915+0000","scrub_duration":0.021406162999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'29","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.076940+0000","last_change":"2023-07-13T14:21:15.076940+0000","last_active":"2023-07-13T14:21:15.076940+0000","last_peered":"2023-07-13T14:21:15.076940+0000","last_clean":"2023-07-13T14:21:15.076940+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T14:21:15.076940+0000","last_undegraded":"2023-07-13T14:21:15.076940+0000","last_fullsized":"2023-07-13T14:21:15.076940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:21:15.076823+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:21:15.076823+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.076823+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:33:22.436034+0000","scrub_duration":0.019056437999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'128","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.879194+0000","last_change":"2023-07-13T14:21:24.879246+0000","last_active":"2023-07-13T14:21:24.879194+0000","last_peered":"2023-07-13T14:21:24.879194+0000","last_clean":"2023-07-13T14:21:24.879194+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T14:21:24.879194+0000","last_undegraded":"2023-07-13T14:21:24.879194+0000","last_fullsized":"2023-07-13T14:21:24.879194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-07-13T14:21:24.879124+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-07-13T14:21:24.879124+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.879124+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:48:07.345233+0000","scrub_duration":0.026230526000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":10905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.171511+0000","last_change":"2023-07-13T14:21:08.171511+0000","last_active":"2023-07-13T14:21:08.171511+0000","last_peered":"2023-07-13T14:21:08.171511+0000","last_clean":"2023-07-13T14:21:08.171511+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T14:21:08.171511+0000","last_undegraded":"2023-07-13T14:21:08.171511+0000","last_fullsized":"2023-07-13T14:21:08.171511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:21:08.171304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:21:08.171304+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.171304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:59.908974+0000","scrub_duration":0.021390960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.532611+0000","last_change":"2023-07-13T14:21:17.532611+0000","last_active":"2023-07-13T14:21:17.532611+0000","last_peered":"2023-07-13T14:21:17.532611+0000","last_clean":"2023-07-13T14:21:17.532611+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T14:21:17.532611+0000","last_undegraded":"2023-07-13T14:21:17.532611+0000","last_fullsized":"2023-07-13T14:21:17.532611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:17.532465+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:17.532465+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.532465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:20:38.756488+0000","scrub_duration":0.021709974999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"31'27","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.148473+0000","last_change":"2023-07-13T14:20:59.148473+0000","last_active":"2023-07-13T14:20:59.148473+0000","last_peered":"2023-07-13T14:20:59.148473+0000","last_clean":"2023-07-13T14:20:59.148473+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T14:20:59.148473+0000","last_undegraded":"2023-07-13T14:20:59.148473+0000","last_fullsized":"2023-07-13T14:20:59.148473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:20:59.148355+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:20:59.148355+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.148355+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:16:31.674123+0000","scrub_duration":0.019042481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'124","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.583944+0000","last_change":"2023-07-13T14:21:08.584065+0000","last_active":"2023-07-13T14:21:08.583944+0000","last_peered":"2023-07-13T14:21:08.583944+0000","last_clean":"2023-07-13T14:21:08.583944+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T14:21:08.583944+0000","last_undegraded":"2023-07-13T14:21:08.583944+0000","last_fullsized":"2023-07-13T14:21:08.583944+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'124","last_scrub_stamp":"2023-07-13T14:21:08.583835+0000","last_deep_scrub":"31'124","last_deep_scrub_stamp":"2023-07-13T14:21:08.583835+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.583835+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:09:55.189827+0000","scrub_duration":0.018560810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:46.643875+0000","last_change":"2023-07-13T14:20:46.643875+0000","last_active":"2023-07-13T14:20:46.643875+0000","last_peered":"2023-07-13T14:20:46.643875+0000","last_clean":"2023-07-13T14:20:46.643875+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T14:20:46.643875+0000","last_undegraded":"2023-07-13T14:20:46.643875+0000","last_fullsized":"2023-07-13T14:20:46.643875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:46.643707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:46.643707+0000","last_clean_scrub_stamp":"2023-07-13T14:20:46.643707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:27:19.450339+0000","scrub_duration":0.018539291999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'185","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.217415+0000","last_change":"2023-07-13T14:20:52.217479+0000","last_active":"2023-07-13T14:20:52.217415+0000","last_peered":"2023-07-13T14:20:52.217415+0000","last_clean":"2023-07-13T14:20:52.217415+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T14:20:52.217415+0000","last_undegraded":"2023-07-13T14:20:52.217415+0000","last_fullsized":"2023-07-13T14:20:52.217415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'185","last_scrub_stamp":"2023-07-13T14:20:52.217273+0000","last_deep_scrub":"31'185","last_deep_scrub_stamp":"2023-07-13T14:20:52.217273+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.217273+0000","objects_scrubbed":1,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:08:14.814977+0000","scrub_duration":0.030479297999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1434466,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:03.181921+0000","last_change":"2023-07-13T14:21:03.181976+0000","last_active":"2023-07-13T14:21:03.181921+0000","last_peered":"2023-07-13T14:21:03.181921+0000","last_clean":"2023-07-13T14:21:03.181921+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T14:21:03.181921+0000","last_undegraded":"2023-07-13T14:21:03.181921+0000","last_fullsized":"2023-07-13T14:21:03.181921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:03.181750+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:03.181750+0000","last_clean_scrub_stamp":"2023-07-13T14:21:03.181750+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:34:22.629776+0000","scrub_duration":0.019039165,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'87","reported_seq":118,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:52.462810+0000","last_change":"2023-07-13T13:52:23.987103+0000","last_active":"2023-07-13T14:19:52.462810+0000","last_peered":"2023-07-13T14:19:52.462810+0000","last_clean":"2023-07-13T14:19:52.462810+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T14:19:52.462810+0000","last_undegraded":"2023-07-13T14:19:52.462810+0000","last_fullsized":"2023-07-13T14:19:52.462810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.225755+0000","last_change":"2023-07-13T14:21:04.225755+0000","last_active":"2023-07-13T14:21:04.225755+0000","last_peered":"2023-07-13T14:21:04.225755+0000","last_clean":"2023-07-13T14:21:04.225755+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T14:21:04.225755+0000","last_undegraded":"2023-07-13T14:21:04.225755+0000","last_fullsized":"2023-07-13T14:21:04.225755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:21:04.225469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:21:04.225469+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.225469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:25.863437+0000","scrub_duration":0.021427478999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.541331+0000","last_change":"2023-07-13T14:20:55.541461+0000","last_active":"2023-07-13T14:20:55.541331+0000","last_peered":"2023-07-13T14:20:55.541331+0000","last_clean":"2023-07-13T14:20:55.541331+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T14:20:55.541331+0000","last_undegraded":"2023-07-13T14:20:55.541331+0000","last_fullsized":"2023-07-13T14:20:55.541331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-07-13T14:20:55.541167+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-07-13T14:20:55.541167+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.541167+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:27:03.676791+0000","scrub_duration":0.031242277999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:02.326661+0000","last_change":"2023-07-13T14:21:02.326661+0000","last_active":"2023-07-13T14:21:02.326661+0000","last_peered":"2023-07-13T14:21:02.326661+0000","last_clean":"2023-07-13T14:21:02.326661+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T14:21:02.326661+0000","last_undegraded":"2023-07-13T14:21:02.326661+0000","last_fullsized":"2023-07-13T14:21:02.326661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-07-13T14:21:02.326478+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-07-13T14:21:02.326478+0000","last_clean_scrub_stamp":"2023-07-13T14:21:02.326478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:40.967451+0000","scrub_duration":0.018713678000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"31'29","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.398775+0000","last_change":"2023-07-13T14:20:55.398775+0000","last_active":"2023-07-13T14:20:55.398775+0000","last_peered":"2023-07-13T14:20:55.398775+0000","last_clean":"2023-07-13T14:20:55.398775+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T14:20:55.398775+0000","last_undegraded":"2023-07-13T14:20:55.398775+0000","last_fullsized":"2023-07-13T14:20:55.398775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:20:55.398507+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:20:55.398507+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.398507+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:34:38.158480+0000","scrub_duration":0.021835706999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"31'125","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:37.050287+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T14:20:37.050287+0000","last_peered":"2023-07-13T14:20:37.050287+0000","last_clean":"2023-07-13T14:20:37.050287+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T14:20:37.050287+0000","last_undegraded":"2023-07-13T14:20:37.050287+0000","last_fullsized":"2023-07-13T14:20:37.050287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.532628+0000","last_change":"2023-07-13T14:20:57.532718+0000","last_active":"2023-07-13T14:20:57.532628+0000","last_peered":"2023-07-13T14:20:57.532628+0000","last_clean":"2023-07-13T14:20:57.532628+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T14:20:57.532628+0000","last_undegraded":"2023-07-13T14:20:57.532628+0000","last_fullsized":"2023-07-13T14:20:57.532628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:57.532508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:57.532508+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.532508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:33.635034+0000","scrub_duration":0.022295781000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"31'816","reported_seq":1673,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.872773+0000","last_change":"2023-07-13T14:20:52.872773+0000","last_active":"2023-07-13T14:20:52.872773+0000","last_peered":"2023-07-13T14:20:52.872773+0000","last_clean":"2023-07-13T14:20:52.872773+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T14:20:52.872773+0000","last_undegraded":"2023-07-13T14:20:52.872773+0000","last_fullsized":"2023-07-13T14:20:52.872773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'816","last_scrub_stamp":"2023-07-13T14:20:52.872671+0000","last_deep_scrub":"31'816","last_deep_scrub_stamp":"2023-07-13T14:20:52.872671+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.872671+0000","objects_scrubbed":1,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:47.008377+0000","scrub_duration":0.031418862999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174695,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":810,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"31'38","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.880340+0000","last_change":"2023-07-13T14:21:20.880382+0000","last_active":"2023-07-13T14:21:20.880340+0000","last_peered":"2023-07-13T14:21:20.880340+0000","last_clean":"2023-07-13T14:21:20.880340+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T14:21:20.880340+0000","last_undegraded":"2023-07-13T14:21:20.880340+0000","last_fullsized":"2023-07-13T14:21:20.880340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-07-13T14:21:20.880256+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-07-13T14:21:20.880256+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.880256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:27:33.886477+0000","scrub_duration":0.026224425999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"31'163","reported_seq":202,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.202270+0000","last_change":"2023-07-13T14:21:15.202326+0000","last_active":"2023-07-13T14:21:15.202270+0000","last_peered":"2023-07-13T14:21:15.202270+0000","last_clean":"2023-07-13T14:21:15.202270+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T14:21:15.202270+0000","last_undegraded":"2023-07-13T14:21:15.202270+0000","last_fullsized":"2023-07-13T14:21:15.202270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-07-13T14:21:15.202204+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-07-13T14:21:15.202204+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.202204+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:37:24.012794+0000","scrub_duration":0.021845495999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":7667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:58.535405+0000","last_change":"2023-07-13T14:20:58.535405+0000","last_active":"2023-07-13T14:20:58.535405+0000","last_peered":"2023-07-13T14:20:58.535405+0000","last_clean":"2023-07-13T14:20:58.535405+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T14:20:58.535405+0000","last_undegraded":"2023-07-13T14:20:58.535405+0000","last_fullsized":"2023-07-13T14:20:58.535405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:58.535275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:58.535275+0000","last_clean_scrub_stamp":"2023-07-13T14:20:58.535275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:42:08.869306+0000","scrub_duration":0.022332606000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:58.126314+0000","last_change":"2023-07-13T14:20:58.126314+0000","last_active":"2023-07-13T14:20:58.126314+0000","last_peered":"2023-07-13T14:20:58.126314+0000","last_clean":"2023-07-13T14:20:58.126314+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T14:20:58.126314+0000","last_undegraded":"2023-07-13T14:20:58.126314+0000","last_fullsized":"2023-07-13T14:20:58.126314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:20:58.126153+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:20:58.126153+0000","last_clean_scrub_stamp":"2023-07-13T14:20:58.126153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:56:38.869235+0000","scrub_duration":0.019046782000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"31'29","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.839289+0000","last_change":"2023-07-13T14:21:08.839289+0000","last_active":"2023-07-13T14:21:08.839289+0000","last_peered":"2023-07-13T14:21:08.839289+0000","last_clean":"2023-07-13T14:21:08.839289+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T14:21:08.839289+0000","last_undegraded":"2023-07-13T14:21:08.839289+0000","last_fullsized":"2023-07-13T14:21:08.839289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:21:08.839132+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:21:08.839132+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.839132+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:35:20.305896+0000","scrub_duration":0.02620055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"31'90","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:53.573360+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T14:19:53.573360+0000","last_peered":"2023-07-13T14:19:53.573360+0000","last_clean":"2023-07-13T14:19:53.573360+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T14:19:53.573360+0000","last_undegraded":"2023-07-13T14:19:53.573360+0000","last_fullsized":"2023-07-13T14:19:53.573360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:09.344291+0000","last_change":"2023-07-13T14:21:09.344334+0000","last_active":"2023-07-13T14:21:09.344291+0000","last_peered":"2023-07-13T14:21:09.344291+0000","last_clean":"2023-07-13T14:21:09.344291+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T14:21:09.344291+0000","last_undegraded":"2023-07-13T14:21:09.344291+0000","last_fullsized":"2023-07-13T14:21:09.344291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-07-13T14:21:09.344224+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-07-13T14:21:09.344224+0000","last_clean_scrub_stamp":"2023-07-13T14:21:09.344224+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:20:05.689039+0000","scrub_duration":0.026165491999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:44.296225+0000","last_change":"2023-07-13T14:20:44.296281+0000","last_active":"2023-07-13T14:20:44.296225+0000","last_peered":"2023-07-13T14:20:44.296225+0000","last_clean":"2023-07-13T14:20:44.296225+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T14:20:44.296225+0000","last_undegraded":"2023-07-13T14:20:44.296225+0000","last_fullsized":"2023-07-13T14:20:44.296225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:44.296110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:44.296110+0000","last_clean_scrub_stamp":"2023-07-13T14:20:44.296110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:40:36.078817+0000","scrub_duration":0.019097020999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'30","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.382223+0000","last_change":"2023-07-13T14:21:24.382263+0000","last_active":"2023-07-13T14:21:24.382223+0000","last_peered":"2023-07-13T14:21:24.382223+0000","last_clean":"2023-07-13T14:21:24.382223+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T14:21:24.382223+0000","last_undegraded":"2023-07-13T14:21:24.382223+0000","last_fullsized":"2023-07-13T14:21:24.382223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:24.382046+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:24.382046+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.382046+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:31.983181+0000","scrub_duration":0.018755054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"31'139","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:26.914401+0000","last_change":"2023-07-13T13:52:23.987019+0000","last_active":"2023-07-13T14:20:26.914401+0000","last_peered":"2023-07-13T14:20:26.914401+0000","last_clean":"2023-07-13T14:20:26.914401+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T14:20:26.914401+0000","last_undegraded":"2023-07-13T14:20:26.914401+0000","last_fullsized":"2023-07-13T14:20:26.914401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":9717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:45.540863+0000","last_change":"2023-07-13T14:20:45.540898+0000","last_active":"2023-07-13T14:20:45.540863+0000","last_peered":"2023-07-13T14:20:45.540863+0000","last_clean":"2023-07-13T14:20:45.540863+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T14:20:45.540863+0000","last_undegraded":"2023-07-13T14:20:45.540863+0000","last_fullsized":"2023-07-13T14:20:45.540863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:45.540787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:45.540787+0000","last_clean_scrub_stamp":"2023-07-13T14:20:45.540787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:13:04.071711+0000","scrub_duration":0.021879480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'315","reported_seq":362,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.857667+0000","last_change":"2023-07-13T14:20:57.857749+0000","last_active":"2023-07-13T14:20:57.857667+0000","last_peered":"2023-07-13T14:20:57.857667+0000","last_clean":"2023-07-13T14:20:57.857667+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T14:20:57.857667+0000","last_undegraded":"2023-07-13T14:20:57.857667+0000","last_fullsized":"2023-07-13T14:20:57.857667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'315","last_scrub_stamp":"2023-07-13T14:20:57.857551+0000","last_deep_scrub":"31'315","last_deep_scrub_stamp":"2023-07-13T14:20:57.857551+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.857551+0000","objects_scrubbed":1,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:28:59.718479+0000","scrub_duration":0.036700948999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"31'21","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:25.564102+0000","last_change":"2023-07-13T14:21:25.564162+0000","last_active":"2023-07-13T14:21:25.564102+0000","last_peered":"2023-07-13T14:21:25.564102+0000","last_clean":"2023-07-13T14:21:25.564102+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T14:21:25.564102+0000","last_undegraded":"2023-07-13T14:21:25.564102+0000","last_fullsized":"2023-07-13T14:21:25.564102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2023-07-13T14:21:25.564010+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2023-07-13T14:21:25.564010+0000","last_clean_scrub_stamp":"2023-07-13T14:21:25.564010+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:10:48.598731+0000","scrub_duration":0.021775233000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'134","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:21.148835+0000","last_change":"2023-07-13T14:21:21.148888+0000","last_active":"2023-07-13T14:21:21.148835+0000","last_peered":"2023-07-13T14:21:21.148835+0000","last_clean":"2023-07-13T14:21:21.148835+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T14:21:21.148835+0000","last_undegraded":"2023-07-13T14:21:21.148835+0000","last_fullsized":"2023-07-13T14:21:21.148835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'134","last_scrub_stamp":"2023-07-13T14:21:21.148680+0000","last_deep_scrub":"31'134","last_deep_scrub_stamp":"2023-07-13T14:21:21.148680+0000","last_clean_scrub_stamp":"2023-07-13T14:21:21.148680+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:56.264106+0000","scrub_duration":0.019123204000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'714","reported_seq":759,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.883967+0000","last_change":"2023-07-13T14:20:51.884018+0000","last_active":"2023-07-13T14:20:51.883967+0000","last_peered":"2023-07-13T14:20:51.883967+0000","last_clean":"2023-07-13T14:20:51.883967+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T14:20:51.883967+0000","last_undegraded":"2023-07-13T14:20:51.883967+0000","last_fullsized":"2023-07-13T14:20:51.883967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'714","last_scrub_stamp":"2023-07-13T14:20:51.883901+0000","last_deep_scrub":"31'714","last_deep_scrub_stamp":"2023-07-13T14:20:51.883901+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.883901+0000","objects_scrubbed":1,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:16:24.409670+0000","scrub_duration":0.073239398999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'26","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.681270+0000","last_change":"2023-07-13T14:20:47.681332+0000","last_active":"2023-07-13T14:20:47.681270+0000","last_peered":"2023-07-13T14:20:47.681270+0000","last_clean":"2023-07-13T14:20:47.681270+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T14:20:47.681270+0000","last_undegraded":"2023-07-13T14:20:47.681270+0000","last_fullsized":"2023-07-13T14:20:47.681270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2023-07-13T14:20:47.681178+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2023-07-13T14:20:47.681178+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.681178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:54:56.528327+0000","scrub_duration":0.018502169999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"31'117","reported_seq":146,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.094545+0000","last_change":"2023-07-13T13:52:23.996886+0000","last_active":"2023-07-13T14:19:57.094545+0000","last_peered":"2023-07-13T14:19:57.094545+0000","last_clean":"2023-07-13T14:19:57.094545+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T14:19:57.094545+0000","last_undegraded":"2023-07-13T14:19:57.094545+0000","last_fullsized":"2023-07-13T14:19:57.094545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":13476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'5","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:09.160197+0000","last_change":"2023-07-13T14:21:09.160240+0000","last_active":"2023-07-13T14:21:09.160197+0000","last_peered":"2023-07-13T14:21:09.160197+0000","last_clean":"2023-07-13T14:21:09.160197+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T14:21:09.160197+0000","last_undegraded":"2023-07-13T14:21:09.160197+0000","last_fullsized":"2023-07-13T14:21:09.160197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:09.160120+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:09.160120+0000","last_clean_scrub_stamp":"2023-07-13T14:21:09.160120+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:43.946646+0000","scrub_duration":0.029922359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'33","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056538+0000","last_change":"2023-07-13T13:52:17.943596+0000","last_active":"2023-07-13T14:20:29.056538+0000","last_peered":"2023-07-13T14:20:29.056538+0000","last_clean":"2023-07-13T14:20:29.056538+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T14:20:29.056538+0000","last_undegraded":"2023-07-13T14:20:29.056538+0000","last_fullsized":"2023-07-13T14:20:29.056538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'97","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:57.045531+0000","last_change":"2023-07-13T13:52:23.988080+0000","last_active":"2023-07-13T14:19:57.045531+0000","last_peered":"2023-07-13T14:19:57.045531+0000","last_clean":"2023-07-13T14:19:57.045531+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T14:19:57.045531+0000","last_undegraded":"2023-07-13T14:19:57.045531+0000","last_fullsized":"2023-07-13T14:19:57.045531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":9809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"31'1260","reported_seq":1307,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.288637+0000","last_change":"2023-07-13T14:21:14.288681+0000","last_active":"2023-07-13T14:21:14.288637+0000","last_peered":"2023-07-13T14:21:14.288637+0000","last_clean":"2023-07-13T14:21:14.288637+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T14:21:14.288637+0000","last_undegraded":"2023-07-13T14:21:14.288637+0000","last_fullsized":"2023-07-13T14:21:14.288637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1260","last_scrub_stamp":"2023-07-13T14:21:14.288525+0000","last_deep_scrub":"31'1260","last_deep_scrub_stamp":"2023-07-13T14:21:14.288525+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.288525+0000","objects_scrubbed":3,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:21.111968+0000","scrub_duration":0.098002016999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'30","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:29.056470+0000","last_change":"2023-07-13T13:52:17.942112+0000","last_active":"2023-07-13T14:20:29.056470+0000","last_peered":"2023-07-13T14:20:29.056470+0000","last_clean":"2023-07-13T14:20:29.056470+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T14:20:29.056470+0000","last_undegraded":"2023-07-13T14:20:29.056470+0000","last_fullsized":"2023-07-13T14:20:29.056470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"31'115","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.023630+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T14:20:43.023630+0000","last_peered":"2023-07-13T14:20:43.023630+0000","last_clean":"2023-07-13T14:20:43.023630+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T14:20:43.023630+0000","last_undegraded":"2023-07-13T14:20:43.023630+0000","last_fullsized":"2023-07-13T14:20:43.023630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'764","reported_seq":814,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:05.409170+0000","last_change":"2023-07-13T14:21:05.409213+0000","last_active":"2023-07-13T14:21:05.409170+0000","last_peered":"2023-07-13T14:21:05.409170+0000","last_clean":"2023-07-13T14:21:05.409170+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T14:21:05.409170+0000","last_undegraded":"2023-07-13T14:21:05.409170+0000","last_fullsized":"2023-07-13T14:21:05.409170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'764","last_scrub_stamp":"2023-07-13T14:21:05.409053+0000","last_deep_scrub":"31'764","last_deep_scrub_stamp":"2023-07-13T14:21:05.409053+0000","last_clean_scrub_stamp":"2023-07-13T14:21:05.409053+0000","objects_scrubbed":1,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:12.232496+0000","scrub_duration":0.058883059000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":4555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.170407+0000","last_change":"2023-07-13T14:20:55.170407+0000","last_active":"2023-07-13T14:20:55.170407+0000","last_peered":"2023-07-13T14:20:55.170407+0000","last_clean":"2023-07-13T14:20:55.170407+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T14:20:55.170407+0000","last_undegraded":"2023-07-13T14:20:55.170407+0000","last_fullsized":"2023-07-13T14:20:55.170407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:55.170275+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:55.170275+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.170275+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:16.808243+0000","scrub_duration":0.018752201999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'135","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.143163+0000","last_change":"2023-07-13T14:21:22.143163+0000","last_active":"2023-07-13T14:21:22.143163+0000","last_peered":"2023-07-13T14:21:22.143163+0000","last_clean":"2023-07-13T14:21:22.143163+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T14:21:22.143163+0000","last_undegraded":"2023-07-13T14:21:22.143163+0000","last_fullsized":"2023-07-13T14:21:22.143163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2023-07-13T14:21:22.143026+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2023-07-13T14:21:22.143026+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.143026+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:59.119380+0000","scrub_duration":0.019092520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":6623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"31'736","reported_seq":784,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:07.933127+0000","last_change":"2023-07-13T14:21:07.933127+0000","last_active":"2023-07-13T14:21:07.933127+0000","last_peered":"2023-07-13T14:21:07.933127+0000","last_clean":"2023-07-13T14:21:07.933127+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T14:21:07.933127+0000","last_undegraded":"2023-07-13T14:21:07.933127+0000","last_fullsized":"2023-07-13T14:21:07.933127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'736","last_scrub_stamp":"2023-07-13T14:21:07.932955+0000","last_deep_scrub":"31'736","last_deep_scrub_stamp":"2023-07-13T14:21:07.932955+0000","last_clean_scrub_stamp":"2023-07-13T14:21:07.932955+0000","objects_scrubbed":3,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:33:15.292167+0000","scrub_duration":0.073400576999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'37","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.023513+0000","last_change":"2023-07-13T13:52:17.946275+0000","last_active":"2023-07-13T14:20:43.023513+0000","last_peered":"2023-07-13T14:20:43.023513+0000","last_clean":"2023-07-13T14:20:43.023513+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T14:20:43.023513+0000","last_undegraded":"2023-07-13T14:20:43.023513+0000","last_fullsized":"2023-07-13T14:20:43.023513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:16.464402+0000","last_clean_scrub_stamp":"2023-07-13T13:52:16.464402+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"31'43","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.494451+0000","last_change":"2023-07-13T14:20:51.494451+0000","last_active":"2023-07-13T14:20:51.494451+0000","last_peered":"2023-07-13T14:20:51.494451+0000","last_clean":"2023-07-13T14:20:51.494451+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T14:20:51.494451+0000","last_undegraded":"2023-07-13T14:20:51.494451+0000","last_fullsized":"2023-07-13T14:20:51.494451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-07-13T14:20:51.494264+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-07-13T14:20:51.494264+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.494264+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:19:20.845976+0000","scrub_duration":0.021866048999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"31'36","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.338438+0000","last_change":"2023-07-13T14:21:20.338438+0000","last_active":"2023-07-13T14:21:20.338438+0000","last_peered":"2023-07-13T14:21:20.338438+0000","last_clean":"2023-07-13T14:21:20.338438+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T14:21:20.338438+0000","last_undegraded":"2023-07-13T14:21:20.338438+0000","last_fullsized":"2023-07-13T14:21:20.338438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:21:20.338174+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:21:20.338174+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.338174+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:50:14.174112+0000","scrub_duration":0.018797963000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"31'42","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:10.506636+0000","last_change":"2023-07-13T14:21:10.506676+0000","last_active":"2023-07-13T14:21:10.506636+0000","last_peered":"2023-07-13T14:21:10.506636+0000","last_clean":"2023-07-13T14:21:10.506636+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T14:21:10.506636+0000","last_undegraded":"2023-07-13T14:21:10.506636+0000","last_fullsized":"2023-07-13T14:21:10.506636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:21:10.506562+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:21:10.506562+0000","last_clean_scrub_stamp":"2023-07-13T14:21:10.506562+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:23.333519+0000","scrub_duration":0.021720092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"31'28","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.231458+0000","last_change":"2023-07-13T14:20:57.231458+0000","last_active":"2023-07-13T14:20:57.231458+0000","last_peered":"2023-07-13T14:20:57.231458+0000","last_clean":"2023-07-13T14:20:57.231458+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T14:20:57.231458+0000","last_undegraded":"2023-07-13T14:20:57.231458+0000","last_fullsized":"2023-07-13T14:20:57.231458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:20:57.231265+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:20:57.231265+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.231265+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:35:53.580424+0000","scrub_duration":0.018638647000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'22","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:05.117156+0000","last_change":"2023-07-13T14:21:05.117192+0000","last_active":"2023-07-13T14:21:05.117156+0000","last_peered":"2023-07-13T14:21:05.117156+0000","last_clean":"2023-07-13T14:21:05.117156+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T14:21:05.117156+0000","last_undegraded":"2023-07-13T14:21:05.117156+0000","last_fullsized":"2023-07-13T14:21:05.117156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:21:05.117076+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:21:05.117076+0000","last_clean_scrub_stamp":"2023-07-13T14:21:05.117076+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:29:06.978004+0000","scrub_duration":0.019054194999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3402,"num_write_kb":282366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3765,"ondisk_log_size":3765,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":35165063,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":7922,"num_write_kb":39030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49258496,"data_stored":70330126,"data_compressed":6207514,"data_compressed_allocated":9723904,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":0},"log_size":7513,"ondisk_log_size":7513,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509796,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34704,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337136,"statfs":{"total":96636764160,"available":96601227264,"internally_reserved":0,"allocated":3678208,"data_stored":4927655,"data_compressed":341063,"data_compressed_allocated":569344,"data_compressed_original":2035712,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.438},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.499},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.438,"15min":0.45200000000000001},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.72099999999999997},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29199999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60299999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.47599999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":3.2789999999999999},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63500000000000001,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.66400000000000003,"5min":0.84599999999999997,"15min":1.4630000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.53400000000000003,"5min":0.93300000000000005,"15min":1.4650000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.35099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64700000000000002,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42299999999999999,"15min":0.44500000000000001},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.628,"5min":0.628,"15min":0.83399999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44700000000000001,"15min":0.46700000000000003},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52700000000000002,"5min":0.65500000000000003,"15min":0.83299999999999996},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.47299999999999998,"15min":0.498},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63400000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.51200000000000001},"min":{"1min":0.316,"5min":0.253,"15min":0.253},"max":{"1min":0.60699999999999998,"5min":0.72499999999999998,"15min":0.79700000000000004},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64600000000000002,"5min":0.72599999999999998,"15min":0.86699999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.622,"5min":0.67300000000000004,"15min":0.81399999999999995},"last":0.52700000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509796,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30324,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341516,"statfs":{"total":96636764160,"available":96605712384,"internally_reserved":0,"allocated":3387392,"data_stored":4336399,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41999999999999998,"15min":0.436},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.217},"max":{"1min":0.56000000000000005,"5min":0.61299999999999999,"15min":1.2549999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.25700000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":2.3759999999999999},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.60199999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44},{"interface":"front","average":{"1min":0.44,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28699999999999998},"max":{"1min":0.60199999999999998,"5min":2.899,"15min":2.899},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.36499999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59099999999999997,"5min":0.92500000000000004,"15min":2.1789999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45400000000000001,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.70299999999999996,"15min":3.4060000000000001},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.56200000000000006,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":2.7389999999999999,"15min":5.3810000000000002},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.25800000000000001,"15min":0.23799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.80100000000000005},"last":0.28000000000000003}]},{"osd":5,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.311,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60199999999999998,"5min":0.73399999999999999,"15min":0.81599999999999995},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.89500000000000002},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.745,"15min":0.75800000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.375}]}]},{"osd":1,"up_from":13,"seq":55834575204,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39120,"kb_used_data":3912,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94332720,"statfs":{"total":96636764160,"available":96596705280,"internally_reserved":0,"allocated":4005888,"data_stored":5770865,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33100000000000002,"15min":0.33800000000000002},"min":{"1min":0.20399999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.435,"5min":0.61599999999999999,"15min":3.7240000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.216,"5min":0.214,"15min":0.214},"max":{"1min":0.42099999999999999,"5min":0.71099999999999997,"15min":0.76200000000000001},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.314,"15min":0.33000000000000002},"min":{"1min":0.218,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.38400000000000001,"5min":0.52100000000000002,"15min":1.49},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.375},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.20300000000000001},"max":{"1min":0.52100000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.311}]},{"osd":3,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47899999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.29499999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.48999999999999999,"5min":1.548,"15min":1.548},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.70499999999999996,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.80100000000000005,"15min":0.83099999999999996},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.309},"max":{"1min":0.746,"5min":0.83299999999999996,"15min":0.89700000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.92800000000000005},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":1.625,"15min":1.625},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.81999999999999995,"15min":0.92200000000000004},"last":0.39600000000000002}]},{"osd":7,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58099999999999996,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73399999999999999,"5min":0.94299999999999995,"15min":0.95299999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68400000000000005,"5min":1.657,"15min":1.657},"last":0.434}]}]},{"osd":0,"up_from":14,"seq":60129542500,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66744,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94305096,"statfs":{"total":96636764160,"available":96568418304,"internally_reserved":0,"allocated":9617408,"data_stored":13490652,"data_compressed":1179065,"data_compressed_allocated":1941504,"data_compressed_original":6012928,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 14:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30299999999999999,"15min":0.307},"min":{"1min":0.215,"5min":0.186,"15min":0.185},"max":{"1min":0.46100000000000002,"5min":0.53600000000000003,"15min":0.64800000000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.19},"max":{"1min":0.52000000000000002,"5min":0.64400000000000002,"15min":1.6879999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48199999999999998,"5min":0.59499999999999997,"15min":0.77200000000000002},"last":0.38},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.374,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.42799999999999999,"5min":3.4940000000000002,"15min":3.4940000000000002},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38,"15min":0.377},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.67500000000000004,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38800000000000001,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.26400000000000001,"15min":0.26300000000000001},"max":{"1min":0.51300000000000001,"5min":0.76500000000000001,"15min":2.5379999999999998},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65500000000000003,"5min":0.85099999999999998,"15min":0.91400000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28699999999999998},"max":{"1min":0.753,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.505}]},{"osd":5,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52300000000000002,"15min":0.54100000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.73599999999999999,"5min":0.80700000000000005,"15min":0.94299999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.629,"5min":0.76900000000000002,"15min":1.0529999999999999},"last":0.443}]},{"osd":6,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55500000000000005,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.96599999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.83699999999999997,"15min":0.98299999999999998},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81499999999999995,"15min":0.997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73099999999999998,"5min":0.86599999999999999,"15min":1.03},"last":0.46200000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509796,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1228800,"data_stored":1576561,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.31},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.48099999999999998,"5min":0.65200000000000002,"15min":0.751},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.34000000000000002,"15min":0.36099999999999999},"min":{"1min":0.215,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.503,"5min":0.57099999999999995,"15min":3.0939999999999999},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36099999999999999,"15min":0.36199999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.222},"max":{"1min":0.47199999999999998,"5min":0.749,"15min":1.248},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46400000000000002,"5min":0.94899999999999995,"15min":2.9529999999999998},"last":0.502}]},{"osd":3,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34200000000000003,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48099999999999998,"5min":0.53100000000000003,"15min":2.2490000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.39000000000000001,"15min":0.40500000000000003},"min":{"1min":0.29199999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.51600000000000001,"5min":0.71299999999999997,"15min":1.167},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":0.75700000000000001,"5min":0.79300000000000004,"15min":0.82999999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.82899999999999996,"15min":2.3220000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.86899999999999999,"15min":2.3660000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":1.681},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.34799999999999998},"max":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":1.6970000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69199999999999995,"5min":0.94699999999999995,"15min":0.98999999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.83899999999999997,"15min":2.4020000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":1.6619999999999999},"last":0.63100000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509796,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":6184960,"data_stored":8530793,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.21099999999999999,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.39600000000000002,"5min":0.65500000000000003,"15min":0.78300000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.316,"15min":0.33600000000000002},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.193},"max":{"1min":0.433,"5min":0.59399999999999997,"15min":2.972},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.37,"15min":0.35399999999999998},"min":{"1min":0.23499999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.438,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.376,"15min":0.378},"min":{"1min":0.254,"5min":0.221,"15min":0.218},"max":{"1min":0.54100000000000004,"5min":0.73999999999999999,"15min":2.173},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.375,"15min":0.378},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23200000000000001},"max":{"1min":0.41999999999999998,"5min":1.6759999999999999,"15min":2.335},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.377,"5min":0.40500000000000003,"15min":0.41399999999999998},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.71399999999999997,"15min":2.2000000000000002},"last":0.376}]},{"osd":4,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.77300000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73799999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57199999999999995,"15min":0.57099999999999995},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.34699999999999998},"max":{"1min":0.78700000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.42599999999999999,"5min":0.38800000000000001,"15min":0.33200000000000002},"max":{"1min":0.81299999999999994,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75900000000000001,"5min":0.84299999999999997,"15min":0.84999999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jul 13 14:20:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55400000000000005,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75,"5min":0.79200000000000004,"15min":0.82299999999999995},"last":0.752},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.91100000000000003,"15min":0.97599999999999998},"last":0.52000000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509796,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77928,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94293912,"statfs":{"total":96636764160,"available":96556965888,"internally_reserved":0,"allocated":15171584,"data_stored":21289038,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":1781,"internal_metadata":64616715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42899999999999999,"15min":0.437},"min":{"1min":0.33800000000000002,"5min":0.27200000000000002,"15min":0.23400000000000001},"max":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.72399999999999998},"last":0.753},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.443,"15min":0.435},"min":{"1min":0.33800000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60399999999999998,"5min":0.68100000000000005,"15min":0.68500000000000005},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.44},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.25},"max":{"1min":0.62,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.628},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45900000000000002},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.623,"5min":0.69399999999999995,"15min":0.73499999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.46400000000000002},"min":{"1min":0.31,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72899999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.47899999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64100000000000001,"5min":2.266,"15min":2.266},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57099999999999995,"5min":1.2849999999999999,"15min":1.5620000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.29599999999999999},"max":{"1min":0.76800000000000002,"5min":1.4259999999999999,"15min":2.6960000000000002},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.46300000000000002},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.73699999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.25600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.28599999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.77500000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80400000000000005},"last":0.69099999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509796,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61820,"kb_used_data":8564,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94310020,"statfs":{"total":96636764160,"available":96573460480,"internally_reserved":0,"allocated":8769536,"data_stored":12725659,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.248,"15min":0.23899999999999999},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":0.72399999999999998},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.35399999999999998,"5min":0.29099999999999998,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.77700000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.30299999999999999,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63800000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.442}]},{"osd":2,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.57099999999999995,"5min":1.2729999999999999,"15min":1.7430000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.442,"15min":0.45000000000000001},"min":{"1min":0.312,"5min":0.30299999999999999,"15min":0.24299999999999999},"max":{"1min":0.58299999999999996,"5min":0.66800000000000004,"15min":1.284},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.056},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":0.63300000000000001,"5min":1.3879999999999999,"15min":1.78},"last":0.501}]},{"osd":4,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.438,"15min":0.439},"min":{"1min":0.29799999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64500000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.27200000000000002,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.63300000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.498},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.77400000000000002},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jul 13 14:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73499999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68300000000000005,"5min":1.351,"15min":1.351},"last":0.74399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":12758189,"data_compressed":1146678,"data_compressed_allocated":1896448,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3674112,"data_stored":5628770,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897024,"data_stored":1434466,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5853184,"data_stored":8388698,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":21146943,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":12583564,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3055616,"data_stored":4194304,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":4195192,"data_compressed":308676,"data_compressed_allocated":524288,"data_compressed_original":1462272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T14:21:27.539 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.539 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.539 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.540 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.540 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.540 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.540 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.541 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.541 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.541 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.541 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.542 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.542 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.542 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.542 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.543 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.543 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.543 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-07-13T13:52:15.318351+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=15, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.543 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.544 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.544 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.544 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.545 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.545 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.545 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.545 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.546 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.546 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.546 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.546 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.547 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.547 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-07-13T13:52:16.464402+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=16, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:27.547 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-13T14:21:28.220 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:21:28.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:21:35.778 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:30:10.294 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:35.784 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:30:10.300 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:35.796 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:30:10.278 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:35.798 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:30:10.280 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:35.800 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:30:10.282 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:35.800 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:30:10.283 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:35.881 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:30:10.397 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:35.898 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:30:10.380 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:35.899 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:30:10.381 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:21:47.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T14:21:47.670 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.679+0000 7fbf6761e700 1 Processor -- start 2023-07-13T14:21:47.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.679+0000 7fbf6761e700 1 -- start start 2023-07-13T14:21:47.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.680+0000 7fbf6761e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf601588a0 0x7fbf60158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:47.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.680+0000 7fbf6761e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600709d0 con 0x7fbf600c5130 2023-07-13T14:21:47.671 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.680+0000 7fbf6761e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600714c0 con 0x7fbf60152660 2023-07-13T14:21:47.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.680+0000 7fbf6761e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf600cae10 con 0x7fbf601588a0 2023-07-13T14:21:47.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.680+0000 7fbf64bb9700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbf600c5130 0x7fbf600c5830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:44618/0 (socket says 172.21.15.118:44618) 2023-07-13T14:21:47.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.680+0000 7fbf64bb9700 1 -- 172.21.15.118:0/2345531526 learned_addr learned my addr 172.21.15.118:0/2345531526 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:21:47.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.681+0000 7fbf65bbb700 1 --2- 172.21.15.118:0/2345531526 >> v2:172.21.15.123:3300/0 conn(0x7fbf601588a0 0x7fbf60158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:47.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.684+0000 7fbf57fff700 1 -- 172.21.15.118:0/2345531526 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677624855 0 0) 0x7fbf600709d0 con 0x7fbf600c5130 2023-07-13T14:21:47.675 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.684+0000 7fbf57fff700 1 -- 172.21.15.118:0/2345531526 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf4c0035b0 con 0x7fbf600c5130 2023-07-13T14:21:47.677 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.686+0000 7fbf65bbb700 1 -- 172.21.15.118:0/2345531526 >> v1:172.21.15.123:6789/0 conn(0x7fbf60152660 legacy=0x7fbf600ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:21:47.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.686+0000 7fbf65bbb700 1 -- 172.21.15.118:0/2345531526 >> v1:172.21.15.118:6789/0 conn(0x7fbf600c5130 legacy=0x7fbf600c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:47.678 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.686+0000 7fbf65bbb700 1 -- 172.21.15.118:0/2345531526 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60159220 con 0x7fbf601588a0 2023-07-13T14:21:47.680 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.689+0000 7fbf65bbb700 1 --2- 172.21.15.118:0/2345531526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf601588a0 0x7fbf60158ce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009d90 tx=0x7fbf5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc3c42753faade4 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:47.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.694+0000 7fbf57fff700 1 -- 172.21.15.118:0/2345531526 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800e070 con 0x7fbf601588a0 2023-07-13T14:21:47.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.694+0000 7fbf57fff700 1 -- 172.21.15.118:0/2345531526 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5800bae0 con 0x7fbf601588a0 2023-07-13T14:21:47.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.694+0000 7fbf57fff700 1 -- 172.21.15.118:0/2345531526 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800be90 con 0x7fbf601588a0 2023-07-13T14:21:47.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.695+0000 7fbf6761e700 1 -- 172.21.15.118:0/2345531526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf601588a0 msgr2=0x7fbf60158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:47.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.695+0000 7fbf6761e700 1 --2- 172.21.15.118:0/2345531526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf601588a0 0x7fbf60158ce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009d90 tx=0x7fbf5800b330 comp rx=0 tx=0).stop 2023-07-13T14:21:47.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.695+0000 7fbf6761e700 1 -- 172.21.15.118:0/2345531526 shutdown_connections 2023-07-13T14:21:47.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.695+0000 7fbf6761e700 1 --2- 172.21.15.118:0/2345531526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf601588a0 0x7fbf60158ce0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:47.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.695+0000 7fbf6761e700 1 -- 172.21.15.118:0/2345531526 >> 172.21.15.118:0/2345531526 conn(0x7fbf60069f30 msgr2=0x7fbf6006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:21:47.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.695+0000 7fbf6761e700 1 -- 172.21.15.118:0/2345531526 shutdown_connections 2023-07-13T14:21:47.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.695+0000 7fbf6761e700 1 -- 172.21.15.118:0/2345531526 wait complete. 2023-07-13T14:21:47.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.696+0000 7fbf6761e700 1 Processor -- start 2023-07-13T14:21:47.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.696+0000 7fbf6761e700 1 -- start start 2023-07-13T14:21:47.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.697+0000 7fbf6761e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf600c5130 0x7fbf6014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:47.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.697+0000 7fbf6761e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf60152660 0x7fbf601dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:47.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.697+0000 7fbf6761e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbf601588a0 0x7fbf601de810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:47.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.697+0000 7fbf6761e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601e1d90 con 0x7fbf600c5130 2023-07-13T14:21:47.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.697+0000 7fbf6761e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601eedb0 con 0x7fbf60152660 2023-07-13T14:21:47.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.697+0000 7fbf6761e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601e0cf0 con 0x7fbf601588a0 2023-07-13T14:21:47.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.697+0000 7fbf653ba700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf600c5130 0x7fbf6014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:47.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.698+0000 7fbf64bb9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf60152660 0x7fbf601dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:47.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.698+0000 7fbf65bbb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbf601588a0 0x7fbf601de810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:47.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.698+0000 7fbf653ba700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf600c5130 0x7fbf6014f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50930/0 (socket says 172.21.15.118:50930) 2023-07-13T14:21:47.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.698+0000 7fbf653ba700 1 -- 172.21.15.118:0/2335942781 learned_addr learned my addr 172.21.15.118:0/2335942781 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:21:47.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.702+0000 7fbf64bb9700 1 -- 172.21.15.118:0/2335942781 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbf601588a0 msgr2=0x7fbf601de810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:47.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.702+0000 7fbf64bb9700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbf601588a0 0x7fbf601de810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:47.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.702+0000 7fbf64bb9700 1 -- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf600c5130 msgr2=0x7fbf6014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:47.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.702+0000 7fbf64bb9700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf600c5130 0x7fbf6014f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:47.696 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.703+0000 7fbf64bb9700 1 -- 172.21.15.118:0/2335942781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58009a70 con 0x7fbf60152660 2023-07-13T14:21:47.698 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.705+0000 7fbf64bb9700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf60152660 0x7fbf601dfa30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000c420 tx=0x7fbf5000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:47.700 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.708+0000 7fbf55ffb700 1 -- 172.21.15.118:0/2335942781 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50005d70 con 0x7fbf60152660 2023-07-13T14:21:47.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.708+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf601e0fd0 con 0x7fbf60152660 2023-07-13T14:21:47.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.708+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf601e1590 con 0x7fbf60152660 2023-07-13T14:21:47.701 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.709+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf60072010 con 0x7fbf60152660 2023-07-13T14:21:47.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.710+0000 7fbf55ffb700 1 -- 172.21.15.118:0/2335942781 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5000ce30 con 0x7fbf60152660 2023-07-13T14:21:47.702 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.710+0000 7fbf55ffb700 1 -- 172.21.15.118:0/2335942781 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500072d0 con 0x7fbf60152660 2023-07-13T14:21:47.953 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.961+0000 7fbf55ffb700 1 -- 172.21.15.118:0/2335942781 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf50007430 con 0x7fbf60152660 2023-07-13T14:21:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.961+0000 7fbf55ffb700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbf4406ad10 0x7fbf4406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:21:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.961+0000 7fbf653ba700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbf4406ad10 0x7fbf4406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:21:47.954 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.962+0000 7fbf653ba700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbf4406ad10 0x7fbf4406d1c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c003ac0 tx=0x7fbf5c003a50 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:21:47.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.966+0000 7fbf55ffb700 1 -- 172.21.15.118:0/2335942781 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbf50057d10 con 0x7fbf60152660 2023-07-13T14:21:47.968 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:47.975+0000 7fbf55ffb700 1 -- 172.21.15.118:0/2335942781 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf50054050 con 0x7fbf60152660 2023-07-13T14:21:48.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.159+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf60070c20 con 0x7fbf4406ad10 2023-07-13T14:21:48.164 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.171+0000 7fbf55ffb700 1 -- 172.21.15.118:0/2335942781 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+395578 (secure 0 0 0) 0x7fbf5c00f640 con 0x7fbf4406ad10 2023-07-13T14:21:48.168 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:21:48.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbf4406ad10 msgr2=0x7fbf4406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:48.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbf4406ad10 0x7fbf4406d1c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c003ac0 tx=0x7fbf5c003a50 comp rx=0 tx=0).stop 2023-07-13T14:21:48.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf60152660 msgr2=0x7fbf601dfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:21:48.170 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf60152660 0x7fbf601dfa30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000c420 tx=0x7fbf5000c730 comp rx=0 tx=0).stop 2023-07-13T14:21:48.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 shutdown_connections 2023-07-13T14:21:48.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fbf4406ad10 0x7fbf4406d1c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:48.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbf601588a0 0x7fbf601de810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:48.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbf600c5130 0x7fbf6014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:48.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 --2- 172.21.15.118:0/2335942781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf60152660 0x7fbf601dfa30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:21:48.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 >> 172.21.15.118:0/2335942781 conn(0x7fbf60069f30 msgr2=0x7fbf60150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:21:48.171 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 shutdown_connections 2023-07-13T14:21:48.172 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:21:48.175+0000 7fbf6761e700 1 -- 172.21.15.118:0/2335942781 wait complete. 2023-07-13T14:21:48.172 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T14:21:48.180 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":915,"stamp":"2023-07-13T14:21:47.316114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35755431,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":925,"num_read_kb":952,"num_write":11483,"num_write_kb":323812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13395,"ondisk_log_size":13395,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406344,"kb_used_data":50824,"kb_used_omap":13,"kb_used_meta":355442,"kb_avail":754568376,"statfs":{"total":773094113280,"available":772678017024,"internally_reserved":0,"allocated":52043776,"data_stored":72647622,"data_compressed":6272288,"data_compressed_allocated":9814016,"data_compressed_original":32006144,"omap_allocated":14248,"internal_metadata":363972696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002823"},"pg_stats":[{"pgid":"4.3f","version":"31'26","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.697055+0000","last_change":"2023-07-13T14:20:54.697055+0000","last_active":"2023-07-13T14:20:54.697055+0000","last_peered":"2023-07-13T14:20:54.697055+0000","last_clean":"2023-07-13T14:20:54.697055+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T14:20:54.697055+0000","last_undegraded":"2023-07-13T14:20:54.697055+0000","last_fullsized":"2023-07-13T14:20:54.697055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2023-07-13T14:20:54.696939+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2023-07-13T14:20:54.696939+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.696939+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:29:01.595104+0000","scrub_duration":0.018622025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"31'31","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.133215+0000","last_change":"2023-07-13T14:20:48.133215+0000","last_active":"2023-07-13T14:20:48.133215+0000","last_peered":"2023-07-13T14:20:48.133215+0000","last_clean":"2023-07-13T14:20:48.133215+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T14:20:48.133215+0000","last_undegraded":"2023-07-13T14:20:48.133215+0000","last_fullsized":"2023-07-13T14:20:48.133215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:48.133089+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:48.133089+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.133089+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:26:56.268712+0000","scrub_duration":0.021360286999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"31'36","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:45.472644+0000","last_change":"2023-07-13T14:20:45.472644+0000","last_active":"2023-07-13T14:20:45.472644+0000","last_peered":"2023-07-13T14:20:45.472644+0000","last_clean":"2023-07-13T14:20:45.472644+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T14:20:45.472644+0000","last_undegraded":"2023-07-13T14:20:45.472644+0000","last_fullsized":"2023-07-13T14:20:45.472644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:20:45.472514+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:20:45.472514+0000","last_clean_scrub_stamp":"2023-07-13T14:20:45.472514+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:24.113486+0000","scrub_duration":0.021725029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"31'25","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:53.442661+0000","last_change":"2023-07-13T14:20:53.442722+0000","last_active":"2023-07-13T14:20:53.442661+0000","last_peered":"2023-07-13T14:20:53.442661+0000","last_clean":"2023-07-13T14:20:53.442661+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T14:20:53.442661+0000","last_undegraded":"2023-07-13T14:20:53.442661+0000","last_fullsized":"2023-07-13T14:20:53.442661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2023-07-13T14:20:53.442582+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2023-07-13T14:20:53.442582+0000","last_clean_scrub_stamp":"2023-07-13T14:20:53.442582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:26:25.786899+0000","scrub_duration":0.021817185999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"31'23","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:42.761836+0000","last_change":"2023-07-13T14:20:42.761873+0000","last_active":"2023-07-13T14:20:42.761836+0000","last_peered":"2023-07-13T14:20:42.761836+0000","last_clean":"2023-07-13T14:20:42.761836+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T14:20:42.761836+0000","last_undegraded":"2023-07-13T14:20:42.761836+0000","last_fullsized":"2023-07-13T14:20:42.761836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2023-07-13T14:20:42.761766+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2023-07-13T14:20:42.761766+0000","last_clean_scrub_stamp":"2023-07-13T14:20:42.761766+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:02.865757+0000","scrub_duration":0.026158679000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.541567+0000","last_change":"2023-07-13T14:20:54.541633+0000","last_active":"2023-07-13T14:20:54.541567+0000","last_peered":"2023-07-13T14:20:54.541567+0000","last_clean":"2023-07-13T14:20:54.541567+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T14:20:54.541567+0000","last_undegraded":"2023-07-13T14:20:54.541567+0000","last_fullsized":"2023-07-13T14:20:54.541567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:54.541444+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:54.541444+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.541444+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:14:52.144625+0000","scrub_duration":0.021735659000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.535925+0000","last_change":"2023-07-13T14:21:17.535975+0000","last_active":"2023-07-13T14:21:17.535925+0000","last_peered":"2023-07-13T14:21:17.535925+0000","last_clean":"2023-07-13T14:21:17.535925+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T14:21:17.535925+0000","last_undegraded":"2023-07-13T14:21:17.535925+0000","last_fullsized":"2023-07-13T14:21:17.535925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:17.535835+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:17.535835+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.535835+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:56.176808+0000","scrub_duration":0.022364232000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"31'22","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:32.183454+0000","last_change":"2023-07-13T14:21:32.183545+0000","last_active":"2023-07-13T14:21:32.183454+0000","last_peered":"2023-07-13T14:21:32.183454+0000","last_clean":"2023-07-13T14:21:32.183454+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T14:21:32.183454+0000","last_undegraded":"2023-07-13T14:21:32.183454+0000","last_fullsized":"2023-07-13T14:21:32.183454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:21:32.183338+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:21:32.183338+0000","last_clean_scrub_stamp":"2023-07-13T14:21:32.183338+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:04:06.124842+0000","scrub_duration":0.021369658999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"31'35","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.801365+0000","last_change":"2023-07-13T14:21:14.801365+0000","last_active":"2023-07-13T14:21:14.801365+0000","last_peered":"2023-07-13T14:21:14.801365+0000","last_clean":"2023-07-13T14:21:14.801365+0000","last_became_active":"2023-07-13T13:52:58.032221+0000","last_became_peered":"2023-07-13T13:52:58.032221+0000","last_unstale":"2023-07-13T14:21:14.801365+0000","last_undegraded":"2023-07-13T14:21:14.801365+0000","last_fullsized":"2023-07-13T14:21:14.801365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:21:14.801249+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:21:14.801249+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.801249+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:51.777603+0000","scrub_duration":0.026178751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'37","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:37.065365+0000","last_change":"2023-07-13T14:21:37.065426+0000","last_active":"2023-07-13T14:21:37.065365+0000","last_peered":"2023-07-13T14:21:37.065365+0000","last_clean":"2023-07-13T14:21:37.065365+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T14:21:37.065365+0000","last_undegraded":"2023-07-13T14:21:37.065365+0000","last_fullsized":"2023-07-13T14:21:37.065365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:37.065265+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:37.065265+0000","last_clean_scrub_stamp":"2023-07-13T14:21:37.065265+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:14:02.826964+0000","scrub_duration":0.021431605999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"31'30","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:41.577870+0000","last_change":"2023-07-13T14:21:41.577908+0000","last_active":"2023-07-13T14:21:41.577870+0000","last_peered":"2023-07-13T14:21:41.577870+0000","last_clean":"2023-07-13T14:21:41.577870+0000","last_became_active":"2023-07-13T13:52:58.431466+0000","last_became_peered":"2023-07-13T13:52:58.431466+0000","last_unstale":"2023-07-13T14:21:41.577870+0000","last_undegraded":"2023-07-13T14:21:41.577870+0000","last_fullsized":"2023-07-13T14:21:41.577870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:41.577806+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:41.577806+0000","last_clean_scrub_stamp":"2023-07-13T14:21:41.577806+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.059622+0000","scrub_duration":0.021748400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"31'22","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:53.729089+0000","last_change":"2023-07-13T14:20:53.729089+0000","last_active":"2023-07-13T14:20:53.729089+0000","last_peered":"2023-07-13T14:20:53.729089+0000","last_clean":"2023-07-13T14:20:53.729089+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T14:20:53.729089+0000","last_undegraded":"2023-07-13T14:20:53.729089+0000","last_fullsized":"2023-07-13T14:20:53.729089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:20:53.728917+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:20:53.728917+0000","last_clean_scrub_stamp":"2023-07-13T14:20:53.728917+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:13:12.259842+0000","scrub_duration":0.018519234999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"31'35","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:49.683702+0000","last_change":"2023-07-13T14:20:49.683702+0000","last_active":"2023-07-13T14:20:49.683702+0000","last_peered":"2023-07-13T14:20:49.683702+0000","last_clean":"2023-07-13T14:20:49.683702+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T14:20:49.683702+0000","last_undegraded":"2023-07-13T14:20:49.683702+0000","last_fullsized":"2023-07-13T14:20:49.683702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:49.683512+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:49.683512+0000","last_clean_scrub_stamp":"2023-07-13T14:20:49.683512+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:17.670520+0000","scrub_duration":0.018508302000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.160281+0000","last_change":"2023-07-13T14:20:51.160322+0000","last_active":"2023-07-13T14:20:51.160281+0000","last_peered":"2023-07-13T14:20:51.160281+0000","last_clean":"2023-07-13T14:20:51.160281+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T14:20:51.160281+0000","last_undegraded":"2023-07-13T14:20:51.160281+0000","last_fullsized":"2023-07-13T14:20:51.160281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:51.160209+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:51.160209+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.160209+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:42:01.494240+0000","scrub_duration":0.021377126999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:28.510184+0000","last_change":"2023-07-13T14:21:28.510229+0000","last_active":"2023-07-13T14:21:28.510184+0000","last_peered":"2023-07-13T14:21:28.510184+0000","last_clean":"2023-07-13T14:21:28.510184+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T14:21:28.510184+0000","last_undegraded":"2023-07-13T14:21:28.510184+0000","last_fullsized":"2023-07-13T14:21:28.510184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:21:28.510107+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:21:28.510107+0000","last_clean_scrub_stamp":"2023-07-13T14:21:28.510107+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:19:37.793987+0000","scrub_duration":0.022328363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"31'33","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.527797+0000","last_change":"2023-07-13T14:21:04.527845+0000","last_active":"2023-07-13T14:21:04.527797+0000","last_peered":"2023-07-13T14:21:04.527797+0000","last_clean":"2023-07-13T14:21:04.527797+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T14:21:04.527797+0000","last_undegraded":"2023-07-13T14:21:04.527797+0000","last_fullsized":"2023-07-13T14:21:04.527797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:21:04.527716+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:21:04.527716+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.527716+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:49:58.363654+0000","scrub_duration":0.021725926,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.797179+0000","last_change":"2023-07-13T14:21:15.797275+0000","last_active":"2023-07-13T14:21:15.797179+0000","last_peered":"2023-07-13T14:21:15.797179+0000","last_clean":"2023-07-13T14:21:15.797179+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T14:21:15.797179+0000","last_undegraded":"2023-07-13T14:21:15.797179+0000","last_fullsized":"2023-07-13T14:21:15.797179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:21:15.797014+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:21:15.797014+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.797014+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:54:14.772881+0000","scrub_duration":0.026240900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"31'42","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.423055+0000","last_change":"2023-07-13T14:20:43.423153+0000","last_active":"2023-07-13T14:20:43.423055+0000","last_peered":"2023-07-13T14:20:43.423055+0000","last_clean":"2023-07-13T14:20:43.423055+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T14:20:43.423055+0000","last_undegraded":"2023-07-13T14:20:43.423055+0000","last_fullsized":"2023-07-13T14:20:43.423055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:20:43.422890+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:20:43.422890+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.422890+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:18.209416+0000","scrub_duration":0.021729281999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.700259+0000","last_change":"2023-07-13T14:20:52.700259+0000","last_active":"2023-07-13T14:20:52.700259+0000","last_peered":"2023-07-13T14:20:52.700259+0000","last_clean":"2023-07-13T14:20:52.700259+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T14:20:52.700259+0000","last_undegraded":"2023-07-13T14:20:52.700259+0000","last_fullsized":"2023-07-13T14:20:52.700259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:52.700065+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:52.700065+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.700065+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:50:47.705198+0000","scrub_duration":0.018490046999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"31'36","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:44.593534+0000","last_change":"2023-07-13T14:21:44.593580+0000","last_active":"2023-07-13T14:21:44.593534+0000","last_peered":"2023-07-13T14:21:44.593534+0000","last_clean":"2023-07-13T14:21:44.593534+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T14:21:44.593534+0000","last_undegraded":"2023-07-13T14:21:44.593534+0000","last_fullsized":"2023-07-13T14:21:44.593534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:21:44.593441+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:21:44.593441+0000","last_clean_scrub_stamp":"2023-07-13T14:21:44.593441+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:49:01.629493+0000","scrub_duration":0.021685374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"31'46","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.508160+0000","last_change":"2023-07-13T14:21:20.508160+0000","last_active":"2023-07-13T14:21:20.508160+0000","last_peered":"2023-07-13T14:21:20.508160+0000","last_clean":"2023-07-13T14:21:20.508160+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T14:21:20.508160+0000","last_undegraded":"2023-07-13T14:21:20.508160+0000","last_fullsized":"2023-07-13T14:21:20.508160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-07-13T14:21:20.507957+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-07-13T14:21:20.507957+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.507957+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:27.331400+0000","scrub_duration":0.022308759000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"31'34","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:13.808172+0000","last_change":"2023-07-13T14:21:13.808172+0000","last_active":"2023-07-13T14:21:13.808172+0000","last_peered":"2023-07-13T14:21:13.808172+0000","last_clean":"2023-07-13T14:21:13.808172+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T14:21:13.808172+0000","last_undegraded":"2023-07-13T14:21:13.808172+0000","last_fullsized":"2023-07-13T14:21:13.808172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-07-13T14:21:13.808022+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-07-13T14:21:13.808022+0000","last_clean_scrub_stamp":"2023-07-13T14:21:13.808022+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:48.923447+0000","scrub_duration":0.026269797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"31'37","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:27.378465+0000","last_change":"2023-07-13T14:21:27.378465+0000","last_active":"2023-07-13T14:21:27.378465+0000","last_peered":"2023-07-13T14:21:27.378465+0000","last_clean":"2023-07-13T14:21:27.378465+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T14:21:27.378465+0000","last_undegraded":"2023-07-13T14:21:27.378465+0000","last_fullsized":"2023-07-13T14:21:27.378465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:27.378345+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:27.378345+0000","last_clean_scrub_stamp":"2023-07-13T14:21:27.378345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:53.140044+0000","scrub_duration":0.018693382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"31'27","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.520935+0000","last_change":"2023-07-13T14:21:24.520982+0000","last_active":"2023-07-13T14:21:24.520935+0000","last_peered":"2023-07-13T14:21:24.520935+0000","last_clean":"2023-07-13T14:21:24.520935+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T14:21:24.520935+0000","last_undegraded":"2023-07-13T14:21:24.520935+0000","last_fullsized":"2023-07-13T14:21:24.520935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:24.520845+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:24.520845+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.520845+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:20:20.865660+0000","scrub_duration":0.022271132999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"31'27","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.315400+0000","last_change":"2023-07-13T14:20:43.315464+0000","last_active":"2023-07-13T14:20:43.315400+0000","last_peered":"2023-07-13T14:20:43.315400+0000","last_clean":"2023-07-13T14:20:43.315400+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T14:20:43.315400+0000","last_undegraded":"2023-07-13T14:20:43.315400+0000","last_fullsized":"2023-07-13T14:20:43.315400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:20:43.315283+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:20:43.315283+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.315283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:20:32.602676+0000","scrub_duration":0.019068186000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"31'39","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.143444+0000","last_change":"2023-07-13T14:21:04.143551+0000","last_active":"2023-07-13T14:21:04.143444+0000","last_peered":"2023-07-13T14:21:04.143444+0000","last_clean":"2023-07-13T14:21:04.143444+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T14:21:04.143444+0000","last_undegraded":"2023-07-13T14:21:04.143444+0000","last_fullsized":"2023-07-13T14:21:04.143444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-07-13T14:21:04.143279+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-07-13T14:21:04.143279+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.143279+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:15:59.993894+0000","scrub_duration":0.019113529000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"31'23","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:36.094296+0000","last_change":"2023-07-13T14:21:36.094346+0000","last_active":"2023-07-13T14:21:36.094296+0000","last_peered":"2023-07-13T14:21:36.094296+0000","last_clean":"2023-07-13T14:21:36.094296+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T14:21:36.094296+0000","last_undegraded":"2023-07-13T14:21:36.094296+0000","last_fullsized":"2023-07-13T14:21:36.094296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2023-07-13T14:21:36.094207+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2023-07-13T14:21:36.094207+0000","last_clean_scrub_stamp":"2023-07-13T14:21:36.094207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:48.921164+0000","scrub_duration":0.021343738000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"31'82","reported_seq":111,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:19:56.962208+0000","last_change":"2023-07-13T13:52:23.963291+0000","last_active":"2023-07-13T14:19:56.962208+0000","last_peered":"2023-07-13T14:19:56.962208+0000","last_clean":"2023-07-13T14:19:56.962208+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T14:19:56.962208+0000","last_undegraded":"2023-07-13T14:19:56.962208+0000","last_fullsized":"2023-07-13T14:19:56.962208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"31'646","reported_seq":693,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:11.551318+0000","last_change":"2023-07-13T14:21:11.551370+0000","last_active":"2023-07-13T14:21:11.551318+0000","last_peered":"2023-07-13T14:21:11.551318+0000","last_clean":"2023-07-13T14:21:11.551318+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T14:21:11.551318+0000","last_undegraded":"2023-07-13T14:21:11.551318+0000","last_fullsized":"2023-07-13T14:21:11.551318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'646","last_scrub_stamp":"2023-07-13T14:21:11.551230+0000","last_deep_scrub":"31'646","last_deep_scrub_stamp":"2023-07-13T14:21:11.551230+0000","last_clean_scrub_stamp":"2023-07-13T14:21:11.551230+0000","objects_scrubbed":1,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:37.312929+0000","scrub_duration":0.060728402000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'42","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.145466+0000","last_change":"2023-07-13T14:20:51.145520+0000","last_active":"2023-07-13T14:20:51.145466+0000","last_peered":"2023-07-13T14:20:51.145466+0000","last_clean":"2023-07-13T14:20:51.145466+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T14:20:51.145466+0000","last_undegraded":"2023-07-13T14:20:51.145466+0000","last_fullsized":"2023-07-13T14:20:51.145466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:20:51.145400+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:20:51.145400+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.145400+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:47:22.361088+0000","scrub_duration":0.018685159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'125","reported_seq":165,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:01.236275+0000","last_change":"2023-07-13T14:21:01.236275+0000","last_active":"2023-07-13T14:21:01.236275+0000","last_peered":"2023-07-13T14:21:01.236275+0000","last_clean":"2023-07-13T14:21:01.236275+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T14:21:01.236275+0000","last_undegraded":"2023-07-13T14:21:01.236275+0000","last_fullsized":"2023-07-13T14:21:01.236275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'125","last_scrub_stamp":"2023-07-13T14:21:01.236103+0000","last_deep_scrub":"31'125","last_deep_scrub_stamp":"2023-07-13T14:21:01.236103+0000","last_clean_scrub_stamp":"2023-07-13T14:21:01.236103+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:12:45.305574+0000","scrub_duration":0.021819373999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":11569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.246199+0000","last_change":"2023-07-13T14:20:51.246199+0000","last_active":"2023-07-13T14:20:51.246199+0000","last_peered":"2023-07-13T14:20:51.246199+0000","last_clean":"2023-07-13T14:20:51.246199+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T14:20:51.246199+0000","last_undegraded":"2023-07-13T14:20:51.246199+0000","last_fullsized":"2023-07-13T14:20:51.246199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:20:51.246065+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:20:51.246065+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.246065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:11.350056+0000","scrub_duration":0.019069163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'20","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.772093+0000","last_change":"2023-07-13T14:21:17.772134+0000","last_active":"2023-07-13T14:21:17.772093+0000","last_peered":"2023-07-13T14:21:17.772093+0000","last_clean":"2023-07-13T14:21:17.772093+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T14:21:17.772093+0000","last_undegraded":"2023-07-13T14:21:17.772093+0000","last_fullsized":"2023-07-13T14:21:17.772093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2023-07-13T14:21:17.771947+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2023-07-13T14:21:17.771947+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.771947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:21:46.504818+0000","scrub_duration":0.026258467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"31'103","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:26.877408+0000","last_change":"2023-07-13T14:21:26.877482+0000","last_active":"2023-07-13T14:21:26.877408+0000","last_peered":"2023-07-13T14:21:26.877408+0000","last_clean":"2023-07-13T14:21:26.877408+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T14:21:26.877408+0000","last_undegraded":"2023-07-13T14:21:26.877408+0000","last_fullsized":"2023-07-13T14:21:26.877408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'103","last_scrub_stamp":"2023-07-13T14:21:26.877311+0000","last_deep_scrub":"31'103","last_deep_scrub_stamp":"2023-07-13T14:21:26.877311+0000","last_clean_scrub_stamp":"2023-07-13T14:21:26.877311+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:20:59.860554+0000","scrub_duration":0.026184144999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'5","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:00.291754+0000","last_change":"2023-07-13T14:21:00.291754+0000","last_active":"2023-07-13T14:21:00.291754+0000","last_peered":"2023-07-13T14:21:00.291754+0000","last_clean":"2023-07-13T14:21:00.291754+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T14:21:00.291754+0000","last_undegraded":"2023-07-13T14:21:00.291754+0000","last_fullsized":"2023-07-13T14:21:00.291754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:00.291634+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:00.291634+0000","last_clean_scrub_stamp":"2023-07-13T14:21:00.291634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:14:46.956921+0000","scrub_duration":0.018782136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'33","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.429841+0000","last_change":"2023-07-13T14:20:54.429841+0000","last_active":"2023-07-13T14:20:54.429841+0000","last_peered":"2023-07-13T14:20:54.429841+0000","last_clean":"2023-07-13T14:20:54.429841+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T14:20:54.429841+0000","last_undegraded":"2023-07-13T14:20:54.429841+0000","last_fullsized":"2023-07-13T14:20:54.429841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:20:54.429670+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:20:54.429670+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.429670+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:42:05.035579+0000","scrub_duration":0.021817006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"31'138","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.136451+0000","last_change":"2023-07-13T14:21:06.136507+0000","last_active":"2023-07-13T14:21:06.136451+0000","last_peered":"2023-07-13T14:21:06.136451+0000","last_clean":"2023-07-13T14:21:06.136451+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T14:21:06.136451+0000","last_undegraded":"2023-07-13T14:21:06.136451+0000","last_fullsized":"2023-07-13T14:21:06.136451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2023-07-13T14:21:06.136370+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2023-07-13T14:21:06.136370+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.136370+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:21:06.038112+0000","scrub_duration":0.021842811,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.826568+0000","last_change":"2023-07-13T14:20:55.826568+0000","last_active":"2023-07-13T14:20:55.826568+0000","last_peered":"2023-07-13T14:20:55.826568+0000","last_clean":"2023-07-13T14:20:55.826568+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T14:20:55.826568+0000","last_undegraded":"2023-07-13T14:20:55.826568+0000","last_fullsized":"2023-07-13T14:20:55.826568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:20:55.826367+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:20:55.826367+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.826367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:34:15.274393+0000","scrub_duration":0.026266379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'25","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.354725+0000","last_change":"2023-07-13T14:21:22.354769+0000","last_active":"2023-07-13T14:21:22.354725+0000","last_peered":"2023-07-13T14:21:22.354725+0000","last_clean":"2023-07-13T14:21:22.354725+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T14:21:22.354725+0000","last_undegraded":"2023-07-13T14:21:22.354725+0000","last_fullsized":"2023-07-13T14:21:22.354725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2023-07-13T14:21:22.354661+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2023-07-13T14:21:22.354661+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.354661+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:03:56.296165+0000","scrub_duration":0.018806537000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'89","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:35.445782+0000","last_change":"2023-07-13T14:21:35.445895+0000","last_active":"2023-07-13T14:21:35.445782+0000","last_peered":"2023-07-13T14:21:35.445782+0000","last_clean":"2023-07-13T14:21:35.445782+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T14:21:35.445782+0000","last_undegraded":"2023-07-13T14:21:35.445782+0000","last_fullsized":"2023-07-13T14:21:35.445782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-07-13T14:21:35.445663+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-07-13T14:21:35.445663+0000","last_clean_scrub_stamp":"2023-07-13T14:21:35.445663+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:50:29.281601+0000","scrub_duration":0.022346844000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":9189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'5","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.215028+0000","last_change":"2023-07-13T14:21:20.215066+0000","last_active":"2023-07-13T14:21:20.215028+0000","last_peered":"2023-07-13T14:21:20.215028+0000","last_clean":"2023-07-13T14:21:20.215028+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T14:21:20.215028+0000","last_undegraded":"2023-07-13T14:21:20.215028+0000","last_fullsized":"2023-07-13T14:21:20.215028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:20.214953+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:20.214953+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.214953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:15:17.818133+0000","scrub_duration":0.02134776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"31'28","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:33.424806+0000","last_change":"2023-07-13T14:21:33.424863+0000","last_active":"2023-07-13T14:21:33.424806+0000","last_peered":"2023-07-13T14:21:33.424806+0000","last_clean":"2023-07-13T14:21:33.424806+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T14:21:33.424806+0000","last_undegraded":"2023-07-13T14:21:33.424806+0000","last_fullsized":"2023-07-13T14:21:33.424806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:21:33.424567+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:21:33.424567+0000","last_clean_scrub_stamp":"2023-07-13T14:21:33.424567+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:20:54.648591+0000","scrub_duration":0.018805460999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"31'148","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:38.371285+0000","last_change":"2023-07-13T14:21:38.371390+0000","last_active":"2023-07-13T14:21:38.371285+0000","last_peered":"2023-07-13T14:21:38.371285+0000","last_clean":"2023-07-13T14:21:38.371285+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T14:21:38.371285+0000","last_undegraded":"2023-07-13T14:21:38.371285+0000","last_fullsized":"2023-07-13T14:21:38.371285+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-07-13T14:21:38.371168+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-07-13T14:21:38.371168+0000","last_clean_scrub_stamp":"2023-07-13T14:21:38.371168+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:26:08.774961+0000","scrub_duration":0.018748753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":18843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'537","reported_seq":585,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.566013+0000","last_change":"2023-07-13T14:21:06.566013+0000","last_active":"2023-07-13T14:21:06.566013+0000","last_peered":"2023-07-13T14:21:06.566013+0000","last_clean":"2023-07-13T14:21:06.566013+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T14:21:06.566013+0000","last_undegraded":"2023-07-13T14:21:06.566013+0000","last_fullsized":"2023-07-13T14:21:06.566013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'537","last_scrub_stamp":"2023-07-13T14:21:06.565893+0000","last_deep_scrub":"31'537","last_deep_scrub_stamp":"2023-07-13T14:21:06.565893+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.565893+0000","objects_scrubbed":2,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:47:37.781581+0000","scrub_duration":0.031191707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"31'35","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:16.101485+0000","last_change":"2023-07-13T14:21:16.101562+0000","last_active":"2023-07-13T14:21:16.101485+0000","last_peered":"2023-07-13T14:21:16.101485+0000","last_clean":"2023-07-13T14:21:16.101485+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T14:21:16.101485+0000","last_undegraded":"2023-07-13T14:21:16.101485+0000","last_fullsized":"2023-07-13T14:21:16.101485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:21:16.101342+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:21:16.101342+0000","last_clean_scrub_stamp":"2023-07-13T14:21:16.101342+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:35:27.568107+0000","scrub_duration":0.019133585000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'132","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:25.086756+0000","last_change":"2023-07-13T14:21:25.086907+0000","last_active":"2023-07-13T14:21:25.086756+0000","last_peered":"2023-07-13T14:21:25.086756+0000","last_clean":"2023-07-13T14:21:25.086756+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T14:21:25.086756+0000","last_undegraded":"2023-07-13T14:21:25.086756+0000","last_fullsized":"2023-07-13T14:21:25.086756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2023-07-13T14:21:25.086576+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2023-07-13T14:21:25.086576+0000","last_clean_scrub_stamp":"2023-07-13T14:21:25.086576+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:21:53.819446+0000","scrub_duration":0.019060541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":15927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'849","reported_seq":897,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:19.596346+0000","last_change":"2023-07-13T14:21:19.596430+0000","last_active":"2023-07-13T14:21:19.596346+0000","last_peered":"2023-07-13T14:21:19.596346+0000","last_clean":"2023-07-13T14:21:19.596346+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T14:21:19.596346+0000","last_undegraded":"2023-07-13T14:21:19.596346+0000","last_fullsized":"2023-07-13T14:21:19.596346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'849","last_scrub_stamp":"2023-07-13T14:21:19.596255+0000","last_deep_scrub":"31'849","last_deep_scrub_stamp":"2023-07-13T14:21:19.596255+0000","last_clean_scrub_stamp":"2023-07-13T14:21:19.596255+0000","objects_scrubbed":4,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:38:48.253897+0000","scrub_duration":0.065532147999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"31'43","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.552757+0000","last_change":"2023-07-13T14:21:06.552817+0000","last_active":"2023-07-13T14:21:06.552757+0000","last_peered":"2023-07-13T14:21:06.552757+0000","last_clean":"2023-07-13T14:21:06.552757+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T14:21:06.552757+0000","last_undegraded":"2023-07-13T14:21:06.552757+0000","last_fullsized":"2023-07-13T14:21:06.552757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-07-13T14:21:06.552623+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-07-13T14:21:06.552623+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.552623+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:03:40.494128+0000","scrub_duration":0.021820767000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"31'113","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.853977+0000","last_change":"2023-07-13T13:52:23.998229+0000","last_active":"2023-07-13T14:20:43.853977+0000","last_peered":"2023-07-13T14:20:43.853977+0000","last_clean":"2023-07-13T14:20:43.853977+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T14:20:43.853977+0000","last_undegraded":"2023-07-13T14:20:43.853977+0000","last_fullsized":"2023-07-13T14:20:43.853977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":11208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'10","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:10.564980+0000","last_change":"2023-07-13T14:21:10.565038+0000","last_active":"2023-07-13T14:21:10.564980+0000","last_peered":"2023-07-13T14:21:10.564980+0000","last_clean":"2023-07-13T14:21:10.564980+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T14:21:10.564980+0000","last_undegraded":"2023-07-13T14:21:10.564980+0000","last_fullsized":"2023-07-13T14:21:10.564980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-07-13T14:21:10.564908+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-07-13T14:21:10.564908+0000","last_clean_scrub_stamp":"2023-07-13T14:21:10.564908+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:32.202876+0000","scrub_duration":0.031257395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'27","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:26.426145+0000","last_change":"2023-07-13T14:21:26.426225+0000","last_active":"2023-07-13T14:21:26.426145+0000","last_peered":"2023-07-13T14:21:26.426145+0000","last_clean":"2023-07-13T14:21:26.426145+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T14:21:26.426145+0000","last_undegraded":"2023-07-13T14:21:26.426145+0000","last_fullsized":"2023-07-13T14:21:26.426145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:26.426058+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:26.426058+0000","last_clean_scrub_stamp":"2023-07-13T14:21:26.426058+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:39.253015+0000","scrub_duration":0.018757216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'88","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:45.389930+0000","last_change":"2023-07-13T14:21:45.389992+0000","last_active":"2023-07-13T14:21:45.389930+0000","last_peered":"2023-07-13T14:21:45.389930+0000","last_clean":"2023-07-13T14:21:45.389930+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T14:21:45.389930+0000","last_undegraded":"2023-07-13T14:21:45.389930+0000","last_fullsized":"2023-07-13T14:21:45.389930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-07-13T14:21:45.389854+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-07-13T14:21:45.389854+0000","last_clean_scrub_stamp":"2023-07-13T14:21:45.389854+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:53:17.533634+0000","scrub_duration":0.018702909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.785349+0000","last_change":"2023-07-13T14:20:43.785391+0000","last_active":"2023-07-13T14:20:43.785349+0000","last_peered":"2023-07-13T14:20:43.785349+0000","last_clean":"2023-07-13T14:20:43.785349+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T14:20:43.785349+0000","last_undegraded":"2023-07-13T14:20:43.785349+0000","last_fullsized":"2023-07-13T14:20:43.785349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:20:43.785283+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:20:43.785283+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.785283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:08:06.382987+0000","scrub_duration":0.026179840999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'29","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:34.152886+0000","last_change":"2023-07-13T14:21:34.152986+0000","last_active":"2023-07-13T14:21:34.152886+0000","last_peered":"2023-07-13T14:21:34.152886+0000","last_clean":"2023-07-13T14:21:34.152886+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T14:21:34.152886+0000","last_undegraded":"2023-07-13T14:21:34.152886+0000","last_fullsized":"2023-07-13T14:21:34.152886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:21:34.152718+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:21:34.152718+0000","last_clean_scrub_stamp":"2023-07-13T14:21:34.152718+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:41.753853+0000","scrub_duration":0.021409747999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"31'107","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:46.374189+0000","last_change":"2023-07-13T14:21:46.374247+0000","last_active":"2023-07-13T14:21:46.374189+0000","last_peered":"2023-07-13T14:21:46.374189+0000","last_clean":"2023-07-13T14:21:46.374189+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T14:21:46.374189+0000","last_undegraded":"2023-07-13T14:21:46.374189+0000","last_fullsized":"2023-07-13T14:21:46.374189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'107","last_scrub_stamp":"2023-07-13T14:21:46.374101+0000","last_deep_scrub":"31'107","last_deep_scrub_stamp":"2023-07-13T14:21:46.374101+0000","last_clean_scrub_stamp":"2023-07-13T14:21:46.374101+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:25:35.838418+0000","scrub_duration":0.018691466,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.470947+0000","last_change":"2023-07-13T14:21:14.470983+0000","last_active":"2023-07-13T14:21:14.470947+0000","last_peered":"2023-07-13T14:21:14.470947+0000","last_clean":"2023-07-13T14:21:14.470947+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T14:21:14.470947+0000","last_undegraded":"2023-07-13T14:21:14.470947+0000","last_fullsized":"2023-07-13T14:21:14.470947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:14.470809+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:14.470809+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.470809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:50.802085+0000","scrub_duration":0.022385644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"31'37","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:19.866372+0000","last_change":"2023-07-13T14:21:19.866463+0000","last_active":"2023-07-13T14:21:19.866372+0000","last_peered":"2023-07-13T14:21:19.866372+0000","last_clean":"2023-07-13T14:21:19.866372+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T14:21:19.866372+0000","last_undegraded":"2023-07-13T14:21:19.866372+0000","last_fullsized":"2023-07-13T14:21:19.866372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:19.866258+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:19.866258+0000","last_clean_scrub_stamp":"2023-07-13T14:21:19.866258+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:15:25.513288+0000","scrub_duration":0.026200731000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'128","reported_seq":158,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.854019+0000","last_change":"2023-07-13T13:52:23.997461+0000","last_active":"2023-07-13T14:20:43.854019+0000","last_peered":"2023-07-13T14:20:43.854019+0000","last_clean":"2023-07-13T14:20:43.854019+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T14:20:43.854019+0000","last_undegraded":"2023-07-13T14:20:43.854019+0000","last_fullsized":"2023-07-13T14:20:43.854019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'18","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.559346+0000","last_change":"2023-07-13T14:20:48.559393+0000","last_active":"2023-07-13T14:20:48.559346+0000","last_peered":"2023-07-13T14:20:48.559346+0000","last_clean":"2023-07-13T14:20:48.559346+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T14:20:48.559346+0000","last_undegraded":"2023-07-13T14:20:48.559346+0000","last_fullsized":"2023-07-13T14:20:48.559346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2023-07-13T14:20:48.559269+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2023-07-13T14:20:48.559269+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.559269+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:31:48.936886+0000","scrub_duration":0.030617008000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'32","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.214449+0000","last_change":"2023-07-13T14:20:43.214449+0000","last_active":"2023-07-13T14:20:43.214449+0000","last_peered":"2023-07-13T14:20:43.214449+0000","last_clean":"2023-07-13T14:20:43.214449+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T14:20:43.214449+0000","last_undegraded":"2023-07-13T14:20:43.214449+0000","last_fullsized":"2023-07-13T14:20:43.214449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:43.214310+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:43.214310+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.214310+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:41:53.548341+0000","scrub_duration":0.018645834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"31'122","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:41.414126+0000","last_change":"2023-07-13T14:21:41.414192+0000","last_active":"2023-07-13T14:21:41.414126+0000","last_peered":"2023-07-13T14:21:41.414126+0000","last_clean":"2023-07-13T14:21:41.414126+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T14:21:41.414126+0000","last_undegraded":"2023-07-13T14:21:41.414126+0000","last_fullsized":"2023-07-13T14:21:41.414126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'122","last_scrub_stamp":"2023-07-13T14:21:41.414052+0000","last_deep_scrub":"31'122","last_deep_scrub_stamp":"2023-07-13T14:21:41.414052+0000","last_clean_scrub_stamp":"2023-07-13T14:21:41.414052+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:54.241009+0000","scrub_duration":0.022284814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.629275+0000","last_change":"2023-07-13T14:20:48.629275+0000","last_active":"2023-07-13T14:20:48.629275+0000","last_peered":"2023-07-13T14:20:48.629275+0000","last_clean":"2023-07-13T14:20:48.629275+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T14:20:48.629275+0000","last_undegraded":"2023-07-13T14:20:48.629275+0000","last_fullsized":"2023-07-13T14:20:48.629275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:20:48.629154+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:20:48.629154+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.629154+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:08:43.034204+0000","scrub_duration":0.031242654000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"31'31","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:46.079615+0000","last_change":"2023-07-13T14:20:46.079652+0000","last_active":"2023-07-13T14:20:46.079615+0000","last_peered":"2023-07-13T14:20:46.079615+0000","last_clean":"2023-07-13T14:20:46.079615+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T14:20:46.079615+0000","last_undegraded":"2023-07-13T14:20:46.079615+0000","last_fullsized":"2023-07-13T14:20:46.079615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:46.079455+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:46.079455+0000","last_clean_scrub_stamp":"2023-07-13T14:20:46.079455+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:36:54.890046+0000","scrub_duration":0.021429993000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'99","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:00.640773+0000","last_change":"2023-07-13T14:21:00.640860+0000","last_active":"2023-07-13T14:21:00.640773+0000","last_peered":"2023-07-13T14:21:00.640773+0000","last_clean":"2023-07-13T14:21:00.640773+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T14:21:00.640773+0000","last_undegraded":"2023-07-13T14:21:00.640773+0000","last_fullsized":"2023-07-13T14:21:00.640773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2023-07-13T14:21:00.640670+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2023-07-13T14:21:00.640670+0000","last_clean_scrub_stamp":"2023-07-13T14:21:00.640670+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:26:32.984986+0000","scrub_duration":0.018598401000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:12.485227+0000","last_change":"2023-07-13T14:21:12.485227+0000","last_active":"2023-07-13T14:21:12.485227+0000","last_peered":"2023-07-13T14:21:12.485227+0000","last_clean":"2023-07-13T14:21:12.485227+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T14:21:12.485227+0000","last_undegraded":"2023-07-13T14:21:12.485227+0000","last_fullsized":"2023-07-13T14:21:12.485227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-07-13T14:21:12.485090+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-07-13T14:21:12.485090+0000","last_clean_scrub_stamp":"2023-07-13T14:21:12.485090+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:36:08.834249+0000","scrub_duration":0.031224683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"31'27","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.539150+0000","last_change":"2023-07-13T14:21:08.539193+0000","last_active":"2023-07-13T14:21:08.539150+0000","last_peered":"2023-07-13T14:21:08.539150+0000","last_clean":"2023-07-13T14:21:08.539150+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T14:21:08.539150+0000","last_undegraded":"2023-07-13T14:21:08.539150+0000","last_fullsized":"2023-07-13T14:21:08.539150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:08.539028+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:08.539028+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.539028+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:16.140163+0000","scrub_duration":0.021778479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.713847+0000","last_change":"2023-07-13T14:20:55.713847+0000","last_active":"2023-07-13T14:20:55.713847+0000","last_peered":"2023-07-13T14:20:55.713847+0000","last_clean":"2023-07-13T14:20:55.713847+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T14:20:55.713847+0000","last_undegraded":"2023-07-13T14:20:55.713847+0000","last_fullsized":"2023-07-13T14:20:55.713847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-07-13T14:20:55.713721+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-07-13T14:20:55.713721+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.713721+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:03:36.441089+0000","scrub_duration":0.018574487000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.481788+0000","last_change":"2023-07-13T14:21:15.481788+0000","last_active":"2023-07-13T14:21:15.481788+0000","last_peered":"2023-07-13T14:21:15.481788+0000","last_clean":"2023-07-13T14:21:15.481788+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T14:21:15.481788+0000","last_undegraded":"2023-07-13T14:21:15.481788+0000","last_fullsized":"2023-07-13T14:21:15.481788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:15.481684+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:15.481684+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.481684+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:15:02.146971+0000","scrub_duration":0.031206836000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"31'24","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.273574+0000","last_change":"2023-07-13T14:20:59.273634+0000","last_active":"2023-07-13T14:20:59.273574+0000","last_peered":"2023-07-13T14:20:59.273574+0000","last_clean":"2023-07-13T14:20:59.273574+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T14:20:59.273574+0000","last_undegraded":"2023-07-13T14:20:59.273574+0000","last_fullsized":"2023-07-13T14:20:59.273574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2023-07-13T14:20:59.273490+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2023-07-13T14:20:59.273490+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.273490+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:09:45.879482+0000","scrub_duration":0.021897019,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'113","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:03.664593+0000","last_change":"2023-07-13T14:21:03.664668+0000","last_active":"2023-07-13T14:21:03.664593+0000","last_peered":"2023-07-13T14:21:03.664593+0000","last_clean":"2023-07-13T14:21:03.664593+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T14:21:03.664593+0000","last_undegraded":"2023-07-13T14:21:03.664593+0000","last_fullsized":"2023-07-13T14:21:03.664593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'113","last_scrub_stamp":"2023-07-13T14:21:03.664506+0000","last_deep_scrub":"31'113","last_deep_scrub_stamp":"2023-07-13T14:21:03.664506+0000","last_clean_scrub_stamp":"2023-07-13T14:21:03.664506+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:06:43.199058+0000","scrub_duration":0.018497283999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'3","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:30.210083+0000","last_change":"2023-07-13T14:21:30.210083+0000","last_active":"2023-07-13T14:21:30.210083+0000","last_peered":"2023-07-13T14:21:30.210083+0000","last_clean":"2023-07-13T14:21:30.210083+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T14:21:30.210083+0000","last_undegraded":"2023-07-13T14:21:30.210083+0000","last_fullsized":"2023-07-13T14:21:30.210083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-07-13T14:21:30.209764+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-07-13T14:21:30.209764+0000","last_clean_scrub_stamp":"2023-07-13T14:21:30.209764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:50:24.045701+0000","scrub_duration":0.021434170999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'32","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:40.804835+0000","last_change":"2023-07-13T14:20:40.804835+0000","last_active":"2023-07-13T14:20:40.804835+0000","last_peered":"2023-07-13T14:20:40.804835+0000","last_clean":"2023-07-13T14:20:40.804835+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T14:20:40.804835+0000","last_undegraded":"2023-07-13T14:20:40.804835+0000","last_fullsized":"2023-07-13T14:20:40.804835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_clean_scrub_stamp":"2023-07-13T14:20:40.804640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:21.603330+0000","scrub_duration":0.026215853000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'94","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.659758+0000","last_change":"2023-07-13T14:20:59.659758+0000","last_active":"2023-07-13T14:20:59.659758+0000","last_peered":"2023-07-13T14:20:59.659758+0000","last_clean":"2023-07-13T14:20:59.659758+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T14:20:59.659758+0000","last_undegraded":"2023-07-13T14:20:59.659758+0000","last_fullsized":"2023-07-13T14:20:59.659758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'94","last_scrub_stamp":"2023-07-13T14:20:59.659593+0000","last_deep_scrub":"31'94","last_deep_scrub_stamp":"2023-07-13T14:20:59.659593+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.659593+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:03:44.402498+0000","scrub_duration":0.018527055000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'582","reported_seq":631,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.321647+0000","last_change":"2023-07-13T14:20:59.321647+0000","last_active":"2023-07-13T14:20:59.321647+0000","last_peered":"2023-07-13T14:20:59.321647+0000","last_clean":"2023-07-13T14:20:59.321647+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T14:20:59.321647+0000","last_undegraded":"2023-07-13T14:20:59.321647+0000","last_fullsized":"2023-07-13T14:20:59.321647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'582","last_scrub_stamp":"2023-07-13T14:20:59.321528+0000","last_deep_scrub":"31'582","last_deep_scrub_stamp":"2023-07-13T14:20:59.321528+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.321528+0000","objects_scrubbed":2,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:35.652804+0000","scrub_duration":0.066498466000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"31'30","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:43.621408+0000","last_change":"2023-07-13T14:21:43.621490+0000","last_active":"2023-07-13T14:21:43.621408+0000","last_peered":"2023-07-13T14:21:43.621408+0000","last_clean":"2023-07-13T14:21:43.621408+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T14:21:43.621408+0000","last_undegraded":"2023-07-13T14:21:43.621408+0000","last_fullsized":"2023-07-13T14:21:43.621408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:43.621219+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:43.621219+0000","last_clean_scrub_stamp":"2023-07-13T14:21:43.621219+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:23:25.969413+0000","scrub_duration":0.021831811999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'157","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:23.143800+0000","last_change":"2023-07-13T14:21:23.143800+0000","last_active":"2023-07-13T14:21:23.143800+0000","last_peered":"2023-07-13T14:21:23.143800+0000","last_clean":"2023-07-13T14:21:23.143800+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T14:21:23.143800+0000","last_undegraded":"2023-07-13T14:21:23.143800+0000","last_fullsized":"2023-07-13T14:21:23.143800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'157","last_scrub_stamp":"2023-07-13T14:21:23.143535+0000","last_deep_scrub":"31'157","last_deep_scrub_stamp":"2023-07-13T14:21:23.143535+0000","last_clean_scrub_stamp":"2023-07-13T14:21:23.143535+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:54:22.119402+0000","scrub_duration":0.019107764999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":13657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.537406+0000","last_change":"2023-07-13T14:20:47.537449+0000","last_active":"2023-07-13T14:20:47.537406+0000","last_peered":"2023-07-13T14:20:47.537406+0000","last_clean":"2023-07-13T14:20:47.537406+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T14:20:47.537406+0000","last_undegraded":"2023-07-13T14:20:47.537406+0000","last_fullsized":"2023-07-13T14:20:47.537406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-07-13T14:20:47.537321+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-07-13T14:20:47.537321+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.537321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:28:54.435486+0000","scrub_duration":0.021817349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"31'28","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.552823+0000","last_change":"2023-07-13T14:20:48.552823+0000","last_active":"2023-07-13T14:20:48.552823+0000","last_peered":"2023-07-13T14:20:48.552823+0000","last_clean":"2023-07-13T14:20:48.552823+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T14:20:48.552823+0000","last_undegraded":"2023-07-13T14:20:48.552823+0000","last_fullsized":"2023-07-13T14:20:48.552823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:20:48.552706+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:20:48.552706+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.552706+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:08:55.376149+0000","scrub_duration":0.021718227999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'108","reported_seq":147,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:43.125376+0000","last_change":"2023-07-13T14:21:43.125448+0000","last_active":"2023-07-13T14:21:43.125376+0000","last_peered":"2023-07-13T14:21:43.125376+0000","last_clean":"2023-07-13T14:21:43.125376+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T14:21:43.125376+0000","last_undegraded":"2023-07-13T14:21:43.125376+0000","last_fullsized":"2023-07-13T14:21:43.125376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'108","last_scrub_stamp":"2023-07-13T14:21:43.125287+0000","last_deep_scrub":"31'108","last_deep_scrub_stamp":"2023-07-13T14:21:43.125287+0000","last_clean_scrub_stamp":"2023-07-13T14:21:43.125287+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:21:04.349311+0000","scrub_duration":0.021296369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":8018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.584862+0000","last_change":"2023-07-13T14:21:22.584927+0000","last_active":"2023-07-13T14:21:22.584862+0000","last_peered":"2023-07-13T14:21:22.584862+0000","last_clean":"2023-07-13T14:21:22.584862+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T14:21:22.584862+0000","last_undegraded":"2023-07-13T14:21:22.584862+0000","last_fullsized":"2023-07-13T14:21:22.584862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-07-13T14:21:22.584760+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-07-13T14:21:22.584760+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.584760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:25:52.988554+0000","scrub_duration":0.021702089000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"31'17","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:32.550026+0000","last_change":"2023-07-13T14:21:32.550026+0000","last_active":"2023-07-13T14:21:32.550026+0000","last_peered":"2023-07-13T14:21:32.550026+0000","last_clean":"2023-07-13T14:21:32.550026+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T14:21:32.550026+0000","last_undegraded":"2023-07-13T14:21:32.550026+0000","last_fullsized":"2023-07-13T14:21:32.550026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'17","last_scrub_stamp":"2023-07-13T14:21:32.549866+0000","last_deep_scrub":"31'17","last_deep_scrub_stamp":"2023-07-13T14:21:32.549866+0000","last_clean_scrub_stamp":"2023-07-13T14:21:32.549866+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:54:56.396186+0000","scrub_duration":0.021730441999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'97","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.023603+0000","last_change":"2023-07-13T13:52:23.987378+0000","last_active":"2023-07-13T14:20:43.023603+0000","last_peered":"2023-07-13T14:20:43.023603+0000","last_clean":"2023-07-13T14:20:43.023603+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T14:20:43.023603+0000","last_undegraded":"2023-07-13T14:20:43.023603+0000","last_fullsized":"2023-07-13T14:20:43.023603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:13.404244+0000","last_change":"2023-07-13T14:21:13.404287+0000","last_active":"2023-07-13T14:21:13.404244+0000","last_peered":"2023-07-13T14:21:13.404244+0000","last_clean":"2023-07-13T14:21:13.404244+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T14:21:13.404244+0000","last_undegraded":"2023-07-13T14:21:13.404244+0000","last_fullsized":"2023-07-13T14:21:13.404244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:21:13.404167+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:21:13.404167+0000","last_clean_scrub_stamp":"2023-07-13T14:21:13.404167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:19:22.688047+0000","scrub_duration":0.018715822999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:01.167106+0000","last_change":"2023-07-13T14:21:01.167106+0000","last_active":"2023-07-13T14:21:01.167106+0000","last_peered":"2023-07-13T14:21:01.167106+0000","last_clean":"2023-07-13T14:21:01.167106+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T14:21:01.167106+0000","last_undegraded":"2023-07-13T14:21:01.167106+0000","last_fullsized":"2023-07-13T14:21:01.167106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:01.166959+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:01.166959+0000","last_clean_scrub_stamp":"2023-07-13T14:21:01.166959+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:55.302665+0000","scrub_duration":0.019059868000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"31'114","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:23.861964+0000","last_change":"2023-07-13T14:21:23.861964+0000","last_active":"2023-07-13T14:21:23.861964+0000","last_peered":"2023-07-13T14:21:23.861964+0000","last_clean":"2023-07-13T14:21:23.861964+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T14:21:23.861964+0000","last_undegraded":"2023-07-13T14:21:23.861964+0000","last_fullsized":"2023-07-13T14:21:23.861964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'114","last_scrub_stamp":"2023-07-13T14:21:23.861696+0000","last_deep_scrub":"31'114","last_deep_scrub_stamp":"2023-07-13T14:21:23.861696+0000","last_clean_scrub_stamp":"2023-07-13T14:21:23.861696+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:14.235446+0000","scrub_duration":0.026254771999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.250142+0000","last_change":"2023-07-13T14:20:47.250142+0000","last_active":"2023-07-13T14:20:47.250142+0000","last_peered":"2023-07-13T14:20:47.250142+0000","last_clean":"2023-07-13T14:20:47.250142+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T14:20:47.250142+0000","last_undegraded":"2023-07-13T14:20:47.250142+0000","last_fullsized":"2023-07-13T14:20:47.250142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:47.250012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:47.250012+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.250012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:52.091091+0000","scrub_duration":0.019134366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:11.180189+0000","last_change":"2023-07-13T14:21:11.180189+0000","last_active":"2023-07-13T14:21:11.180189+0000","last_peered":"2023-07-13T14:21:11.180189+0000","last_clean":"2023-07-13T14:21:11.180189+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T14:21:11.180189+0000","last_undegraded":"2023-07-13T14:21:11.180189+0000","last_fullsized":"2023-07-13T14:21:11.180189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:21:11.179942+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:21:11.179942+0000","last_clean_scrub_stamp":"2023-07-13T14:21:11.179942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:49.820915+0000","scrub_duration":0.021406162999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'29","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.076940+0000","last_change":"2023-07-13T14:21:15.076940+0000","last_active":"2023-07-13T14:21:15.076940+0000","last_peered":"2023-07-13T14:21:15.076940+0000","last_clean":"2023-07-13T14:21:15.076940+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T14:21:15.076940+0000","last_undegraded":"2023-07-13T14:21:15.076940+0000","last_fullsized":"2023-07-13T14:21:15.076940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:21:15.076823+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:21:15.076823+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.076823+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:33:22.436034+0000","scrub_duration":0.019056437999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'128","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.879246+0000","last_change":"2023-07-13T14:21:24.879246+0000","last_active":"2023-07-13T14:21:24.879246+0000","last_peered":"2023-07-13T14:21:24.879246+0000","last_clean":"2023-07-13T14:21:24.879246+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T14:21:24.879246+0000","last_undegraded":"2023-07-13T14:21:24.879246+0000","last_fullsized":"2023-07-13T14:21:24.879246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-07-13T14:21:24.879124+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-07-13T14:21:24.879124+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.879124+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:48:07.345233+0000","scrub_duration":0.026230526000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":10905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.171511+0000","last_change":"2023-07-13T14:21:08.171511+0000","last_active":"2023-07-13T14:21:08.171511+0000","last_peered":"2023-07-13T14:21:08.171511+0000","last_clean":"2023-07-13T14:21:08.171511+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T14:21:08.171511+0000","last_undegraded":"2023-07-13T14:21:08.171511+0000","last_fullsized":"2023-07-13T14:21:08.171511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:21:08.171304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:21:08.171304+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.171304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:59.908974+0000","scrub_duration":0.021390960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.532611+0000","last_change":"2023-07-13T14:21:17.532611+0000","last_active":"2023-07-13T14:21:17.532611+0000","last_peered":"2023-07-13T14:21:17.532611+0000","last_clean":"2023-07-13T14:21:17.532611+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T14:21:17.532611+0000","last_undegraded":"2023-07-13T14:21:17.532611+0000","last_fullsized":"2023-07-13T14:21:17.532611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:17.532465+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:17.532465+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.532465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:20:38.756488+0000","scrub_duration":0.021709974999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"31'27","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.148473+0000","last_change":"2023-07-13T14:20:59.148473+0000","last_active":"2023-07-13T14:20:59.148473+0000","last_peered":"2023-07-13T14:20:59.148473+0000","last_clean":"2023-07-13T14:20:59.148473+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T14:20:59.148473+0000","last_undegraded":"2023-07-13T14:20:59.148473+0000","last_fullsized":"2023-07-13T14:20:59.148473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:20:59.148355+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:20:59.148355+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.148355+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:16:31.674123+0000","scrub_duration":0.019042481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'124","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.583944+0000","last_change":"2023-07-13T14:21:08.584065+0000","last_active":"2023-07-13T14:21:08.583944+0000","last_peered":"2023-07-13T14:21:08.583944+0000","last_clean":"2023-07-13T14:21:08.583944+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T14:21:08.583944+0000","last_undegraded":"2023-07-13T14:21:08.583944+0000","last_fullsized":"2023-07-13T14:21:08.583944+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'124","last_scrub_stamp":"2023-07-13T14:21:08.583835+0000","last_deep_scrub":"31'124","last_deep_scrub_stamp":"2023-07-13T14:21:08.583835+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.583835+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:09:55.189827+0000","scrub_duration":0.018560810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:46.643875+0000","last_change":"2023-07-13T14:20:46.643875+0000","last_active":"2023-07-13T14:20:46.643875+0000","last_peered":"2023-07-13T14:20:46.643875+0000","last_clean":"2023-07-13T14:20:46.643875+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T14:20:46.643875+0000","last_undegraded":"2023-07-13T14:20:46.643875+0000","last_fullsized":"2023-07-13T14:20:46.643875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:46.643707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:46.643707+0000","last_clean_scrub_stamp":"2023-07-13T14:20:46.643707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:27:19.450339+0000","scrub_duration":0.018539291999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'185","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.217415+0000","last_change":"2023-07-13T14:20:52.217479+0000","last_active":"2023-07-13T14:20:52.217415+0000","last_peered":"2023-07-13T14:20:52.217415+0000","last_clean":"2023-07-13T14:20:52.217415+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T14:20:52.217415+0000","last_undegraded":"2023-07-13T14:20:52.217415+0000","last_fullsized":"2023-07-13T14:20:52.217415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'185","last_scrub_stamp":"2023-07-13T14:20:52.217273+0000","last_deep_scrub":"31'185","last_deep_scrub_stamp":"2023-07-13T14:20:52.217273+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.217273+0000","objects_scrubbed":1,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:08:14.814977+0000","scrub_duration":0.030479297999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1434466,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:03.181921+0000","last_change":"2023-07-13T14:21:03.181976+0000","last_active":"2023-07-13T14:21:03.181921+0000","last_peered":"2023-07-13T14:21:03.181921+0000","last_clean":"2023-07-13T14:21:03.181921+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T14:21:03.181921+0000","last_undegraded":"2023-07-13T14:21:03.181921+0000","last_fullsized":"2023-07-13T14:21:03.181921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:03.181750+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:03.181750+0000","last_clean_scrub_stamp":"2023-07-13T14:21:03.181750+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:34:22.629776+0000","scrub_duration":0.019039165,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'87","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:39.417867+0000","last_change":"2023-07-13T14:21:39.417944+0000","last_active":"2023-07-13T14:21:39.417867+0000","last_peered":"2023-07-13T14:21:39.417867+0000","last_clean":"2023-07-13T14:21:39.417867+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T14:21:39.417867+0000","last_undegraded":"2023-07-13T14:21:39.417867+0000","last_fullsized":"2023-07-13T14:21:39.417867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-07-13T14:21:39.417788+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-07-13T14:21:39.417788+0000","last_clean_scrub_stamp":"2023-07-13T14:21:39.417788+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:47.018922+0000","scrub_duration":0.022273528000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.225755+0000","last_change":"2023-07-13T14:21:04.225755+0000","last_active":"2023-07-13T14:21:04.225755+0000","last_peered":"2023-07-13T14:21:04.225755+0000","last_clean":"2023-07-13T14:21:04.225755+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T14:21:04.225755+0000","last_undegraded":"2023-07-13T14:21:04.225755+0000","last_fullsized":"2023-07-13T14:21:04.225755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:21:04.225469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:21:04.225469+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.225469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:25.863437+0000","scrub_duration":0.021427478999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.541331+0000","last_change":"2023-07-13T14:20:55.541461+0000","last_active":"2023-07-13T14:20:55.541331+0000","last_peered":"2023-07-13T14:20:55.541331+0000","last_clean":"2023-07-13T14:20:55.541331+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T14:20:55.541331+0000","last_undegraded":"2023-07-13T14:20:55.541331+0000","last_fullsized":"2023-07-13T14:20:55.541331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-07-13T14:20:55.541167+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-07-13T14:20:55.541167+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.541167+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:27:03.676791+0000","scrub_duration":0.031242277999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:02.326661+0000","last_change":"2023-07-13T14:21:02.326661+0000","last_active":"2023-07-13T14:21:02.326661+0000","last_peered":"2023-07-13T14:21:02.326661+0000","last_clean":"2023-07-13T14:21:02.326661+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T14:21:02.326661+0000","last_undegraded":"2023-07-13T14:21:02.326661+0000","last_fullsized":"2023-07-13T14:21:02.326661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-07-13T14:21:02.326478+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-07-13T14:21:02.326478+0000","last_clean_scrub_stamp":"2023-07-13T14:21:02.326478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:40.967451+0000","scrub_duration":0.018713678000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"31'29","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.398775+0000","last_change":"2023-07-13T14:20:55.398775+0000","last_active":"2023-07-13T14:20:55.398775+0000","last_peered":"2023-07-13T14:20:55.398775+0000","last_clean":"2023-07-13T14:20:55.398775+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T14:20:55.398775+0000","last_undegraded":"2023-07-13T14:20:55.398775+0000","last_fullsized":"2023-07-13T14:20:55.398775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:20:55.398507+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:20:55.398507+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.398507+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:34:38.158480+0000","scrub_duration":0.021835706999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"31'125","reported_seq":156,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:37.050287+0000","last_change":"2023-07-13T13:52:23.991167+0000","last_active":"2023-07-13T14:20:37.050287+0000","last_peered":"2023-07-13T14:20:37.050287+0000","last_clean":"2023-07-13T14:20:37.050287+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T14:20:37.050287+0000","last_undegraded":"2023-07-13T14:20:37.050287+0000","last_fullsized":"2023-07-13T14:20:37.050287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.532628+0000","last_change":"2023-07-13T14:20:57.532718+0000","last_active":"2023-07-13T14:20:57.532628+0000","last_peered":"2023-07-13T14:20:57.532628+0000","last_clean":"2023-07-13T14:20:57.532628+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T14:20:57.532628+0000","last_undegraded":"2023-07-13T14:20:57.532628+0000","last_fullsized":"2023-07-13T14:20:57.532628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:57.532508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:57.532508+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.532508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:33.635034+0000","scrub_duration":0.022295781000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"31'816","reported_seq":1673,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.872773+0000","last_change":"2023-07-13T14:20:52.872773+0000","last_active":"2023-07-13T14:20:52.872773+0000","last_peered":"2023-07-13T14:20:52.872773+0000","last_clean":"2023-07-13T14:20:52.872773+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T14:20:52.872773+0000","last_undegraded":"2023-07-13T14:20:52.872773+0000","last_fullsized":"2023-07-13T14:20:52.872773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'816","last_scrub_stamp":"2023-07-13T14:20:52.872671+0000","last_deep_scrub":"31'816","last_deep_scrub_stamp":"2023-07-13T14:20:52.872671+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.872671+0000","objects_scrubbed":1,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:47.008377+0000","scrub_duration":0.031418862999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174695,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":810,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"31'38","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.880340+0000","last_change":"2023-07-13T14:21:20.880382+0000","last_active":"2023-07-13T14:21:20.880340+0000","last_peered":"2023-07-13T14:21:20.880340+0000","last_clean":"2023-07-13T14:21:20.880340+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T14:21:20.880340+0000","last_undegraded":"2023-07-13T14:21:20.880340+0000","last_fullsized":"2023-07-13T14:21:20.880340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-07-13T14:21:20.880256+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-07-13T14:21:20.880256+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.880256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:27:33.886477+0000","scrub_duration":0.026224425999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"31'163","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.202326+0000","last_change":"2023-07-13T14:21:15.202326+0000","last_active":"2023-07-13T14:21:15.202326+0000","last_peered":"2023-07-13T14:21:15.202326+0000","last_clean":"2023-07-13T14:21:15.202326+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T14:21:15.202326+0000","last_undegraded":"2023-07-13T14:21:15.202326+0000","last_fullsized":"2023-07-13T14:21:15.202326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-07-13T14:21:15.202204+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-07-13T14:21:15.202204+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.202204+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:37:24.012794+0000","scrub_duration":0.021845495999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":7667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:58.535405+0000","last_change":"2023-07-13T14:20:58.535405+0000","last_active":"2023-07-13T14:20:58.535405+0000","last_peered":"2023-07-13T14:20:58.535405+0000","last_clean":"2023-07-13T14:20:58.535405+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T14:20:58.535405+0000","last_undegraded":"2023-07-13T14:20:58.535405+0000","last_fullsized":"2023-07-13T14:20:58.535405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:58.535275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:58.535275+0000","last_clean_scrub_stamp":"2023-07-13T14:20:58.535275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:42:08.869306+0000","scrub_duration":0.022332606000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:58.126314+0000","last_change":"2023-07-13T14:20:58.126314+0000","last_active":"2023-07-13T14:20:58.126314+0000","last_peered":"2023-07-13T14:20:58.126314+0000","last_clean":"2023-07-13T14:20:58.126314+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T14:20:58.126314+0000","last_undegraded":"2023-07-13T14:20:58.126314+0000","last_fullsized":"2023-07-13T14:20:58.126314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:20:58.126153+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:20:58.126153+0000","last_clean_scrub_stamp":"2023-07-13T14:20:58.126153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:56:38.869235+0000","scrub_duration":0.019046782000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"31'29","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.839289+0000","last_change":"2023-07-13T14:21:08.839289+0000","last_active":"2023-07-13T14:21:08.839289+0000","last_peered":"2023-07-13T14:21:08.839289+0000","last_clean":"2023-07-13T14:21:08.839289+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T14:21:08.839289+0000","last_undegraded":"2023-07-13T14:21:08.839289+0000","last_fullsized":"2023-07-13T14:21:08.839289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:21:08.839132+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:21:08.839132+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.839132+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:35:20.305896+0000","scrub_duration":0.02620055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"31'90","reported_seq":122,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.023591+0000","last_change":"2023-07-13T13:52:23.929915+0000","last_active":"2023-07-13T14:20:43.023591+0000","last_peered":"2023-07-13T14:20:43.023591+0000","last_clean":"2023-07-13T14:20:43.023591+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T14:20:43.023591+0000","last_undegraded":"2023-07-13T14:20:43.023591+0000","last_fullsized":"2023-07-13T14:20:43.023591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:09.344291+0000","last_change":"2023-07-13T14:21:09.344334+0000","last_active":"2023-07-13T14:21:09.344291+0000","last_peered":"2023-07-13T14:21:09.344291+0000","last_clean":"2023-07-13T14:21:09.344291+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T14:21:09.344291+0000","last_undegraded":"2023-07-13T14:21:09.344291+0000","last_fullsized":"2023-07-13T14:21:09.344291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-07-13T14:21:09.344224+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-07-13T14:21:09.344224+0000","last_clean_scrub_stamp":"2023-07-13T14:21:09.344224+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:20:05.689039+0000","scrub_duration":0.026165491999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:44.296225+0000","last_change":"2023-07-13T14:20:44.296281+0000","last_active":"2023-07-13T14:20:44.296225+0000","last_peered":"2023-07-13T14:20:44.296225+0000","last_clean":"2023-07-13T14:20:44.296225+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T14:20:44.296225+0000","last_undegraded":"2023-07-13T14:20:44.296225+0000","last_fullsized":"2023-07-13T14:20:44.296225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:44.296110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:44.296110+0000","last_clean_scrub_stamp":"2023-07-13T14:20:44.296110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:40:36.078817+0000","scrub_duration":0.019097020999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'30","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.382223+0000","last_change":"2023-07-13T14:21:24.382263+0000","last_active":"2023-07-13T14:21:24.382223+0000","last_peered":"2023-07-13T14:21:24.382223+0000","last_clean":"2023-07-13T14:21:24.382223+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T14:21:24.382223+0000","last_undegraded":"2023-07-13T14:21:24.382223+0000","last_fullsized":"2023-07-13T14:21:24.382223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:24.382046+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:24.382046+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.382046+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:31.983181+0000","scrub_duration":0.018755054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"31'139","reported_seq":179,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:34.389909+0000","last_change":"2023-07-13T14:21:34.390009+0000","last_active":"2023-07-13T14:21:34.389909+0000","last_peered":"2023-07-13T14:21:34.389909+0000","last_clean":"2023-07-13T14:21:34.389909+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T14:21:34.389909+0000","last_undegraded":"2023-07-13T14:21:34.389909+0000","last_fullsized":"2023-07-13T14:21:34.389909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'139","last_scrub_stamp":"2023-07-13T14:21:34.389806+0000","last_deep_scrub":"31'139","last_deep_scrub_stamp":"2023-07-13T14:21:34.389806+0000","last_clean_scrub_stamp":"2023-07-13T14:21:34.389806+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:33:11.083589+0000","scrub_duration":0.018696449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":9717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:45.540863+0000","last_change":"2023-07-13T14:20:45.540898+0000","last_active":"2023-07-13T14:20:45.540863+0000","last_peered":"2023-07-13T14:20:45.540863+0000","last_clean":"2023-07-13T14:20:45.540863+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T14:20:45.540863+0000","last_undegraded":"2023-07-13T14:20:45.540863+0000","last_fullsized":"2023-07-13T14:20:45.540863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:45.540787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:45.540787+0000","last_clean_scrub_stamp":"2023-07-13T14:20:45.540787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:13:04.071711+0000","scrub_duration":0.021879480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'315","reported_seq":362,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.857667+0000","last_change":"2023-07-13T14:20:57.857749+0000","last_active":"2023-07-13T14:20:57.857667+0000","last_peered":"2023-07-13T14:20:57.857667+0000","last_clean":"2023-07-13T14:20:57.857667+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T14:20:57.857667+0000","last_undegraded":"2023-07-13T14:20:57.857667+0000","last_fullsized":"2023-07-13T14:20:57.857667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'315","last_scrub_stamp":"2023-07-13T14:20:57.857551+0000","last_deep_scrub":"31'315","last_deep_scrub_stamp":"2023-07-13T14:20:57.857551+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.857551+0000","objects_scrubbed":1,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:28:59.718479+0000","scrub_duration":0.036700948999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"31'21","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:25.564162+0000","last_change":"2023-07-13T14:21:25.564162+0000","last_active":"2023-07-13T14:21:25.564162+0000","last_peered":"2023-07-13T14:21:25.564162+0000","last_clean":"2023-07-13T14:21:25.564162+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T14:21:25.564162+0000","last_undegraded":"2023-07-13T14:21:25.564162+0000","last_fullsized":"2023-07-13T14:21:25.564162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2023-07-13T14:21:25.564010+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2023-07-13T14:21:25.564010+0000","last_clean_scrub_stamp":"2023-07-13T14:21:25.564010+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:10:48.598731+0000","scrub_duration":0.021775233000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'134","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:21.148835+0000","last_change":"2023-07-13T14:21:21.148888+0000","last_active":"2023-07-13T14:21:21.148835+0000","last_peered":"2023-07-13T14:21:21.148835+0000","last_clean":"2023-07-13T14:21:21.148835+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T14:21:21.148835+0000","last_undegraded":"2023-07-13T14:21:21.148835+0000","last_fullsized":"2023-07-13T14:21:21.148835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'134","last_scrub_stamp":"2023-07-13T14:21:21.148680+0000","last_deep_scrub":"31'134","last_deep_scrub_stamp":"2023-07-13T14:21:21.148680+0000","last_clean_scrub_stamp":"2023-07-13T14:21:21.148680+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:56.264106+0000","scrub_duration":0.019123204000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'714","reported_seq":759,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.883967+0000","last_change":"2023-07-13T14:20:51.884018+0000","last_active":"2023-07-13T14:20:51.883967+0000","last_peered":"2023-07-13T14:20:51.883967+0000","last_clean":"2023-07-13T14:20:51.883967+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T14:20:51.883967+0000","last_undegraded":"2023-07-13T14:20:51.883967+0000","last_fullsized":"2023-07-13T14:20:51.883967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'714","last_scrub_stamp":"2023-07-13T14:20:51.883901+0000","last_deep_scrub":"31'714","last_deep_scrub_stamp":"2023-07-13T14:20:51.883901+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.883901+0000","objects_scrubbed":1,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:16:24.409670+0000","scrub_duration":0.073239398999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'26","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.681270+0000","last_change":"2023-07-13T14:20:47.681332+0000","last_active":"2023-07-13T14:20:47.681270+0000","last_peered":"2023-07-13T14:20:47.681270+0000","last_clean":"2023-07-13T14:20:47.681270+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T14:20:47.681270+0000","last_undegraded":"2023-07-13T14:20:47.681270+0000","last_fullsized":"2023-07-13T14:20:47.681270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2023-07-13T14:20:47.681178+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2023-07-13T14:20:47.681178+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.681178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:54:56.528327+0000","scrub_duration":0.018502169999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"31'117","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:37.436222+0000","last_change":"2023-07-13T14:21:37.436276+0000","last_active":"2023-07-13T14:21:37.436222+0000","last_peered":"2023-07-13T14:21:37.436222+0000","last_clean":"2023-07-13T14:21:37.436222+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T14:21:37.436222+0000","last_undegraded":"2023-07-13T14:21:37.436222+0000","last_fullsized":"2023-07-13T14:21:37.436222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'117","last_scrub_stamp":"2023-07-13T14:21:37.436131+0000","last_deep_scrub":"31'117","last_deep_scrub_stamp":"2023-07-13T14:21:37.436131+0000","last_clean_scrub_stamp":"2023-07-13T14:21:37.436131+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:04:11.377636+0000","scrub_duration":0.022344217999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":13476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'5","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:09.160197+0000","last_change":"2023-07-13T14:21:09.160240+0000","last_active":"2023-07-13T14:21:09.160197+0000","last_peered":"2023-07-13T14:21:09.160197+0000","last_clean":"2023-07-13T14:21:09.160197+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T14:21:09.160197+0000","last_undegraded":"2023-07-13T14:21:09.160197+0000","last_fullsized":"2023-07-13T14:21:09.160197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:09.160120+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:09.160120+0000","last_clean_scrub_stamp":"2023-07-13T14:21:09.160120+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:43.946646+0000","scrub_duration":0.029922359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'33","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:31.512942+0000","last_change":"2023-07-13T14:21:31.512996+0000","last_active":"2023-07-13T14:21:31.512942+0000","last_peered":"2023-07-13T14:21:31.512942+0000","last_clean":"2023-07-13T14:21:31.512942+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T14:21:31.512942+0000","last_undegraded":"2023-07-13T14:21:31.512942+0000","last_fullsized":"2023-07-13T14:21:31.512942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:21:31.512819+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:21:31.512819+0000","last_clean_scrub_stamp":"2023-07-13T14:21:31.512819+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:25:20.977137+0000","scrub_duration":0.021710390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'97","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:45.146792+0000","last_change":"2023-07-13T14:21:45.146857+0000","last_active":"2023-07-13T14:21:45.146792+0000","last_peered":"2023-07-13T14:21:45.146792+0000","last_clean":"2023-07-13T14:21:45.146792+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T14:21:45.146792+0000","last_undegraded":"2023-07-13T14:21:45.146792+0000","last_fullsized":"2023-07-13T14:21:45.146792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'97","last_scrub_stamp":"2023-07-13T14:21:45.146715+0000","last_deep_scrub":"31'97","last_deep_scrub_stamp":"2023-07-13T14:21:45.146715+0000","last_clean_scrub_stamp":"2023-07-13T14:21:45.146715+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:39:13.804356+0000","scrub_duration":0.021399174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":9809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"31'1260","reported_seq":1307,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.288637+0000","last_change":"2023-07-13T14:21:14.288681+0000","last_active":"2023-07-13T14:21:14.288637+0000","last_peered":"2023-07-13T14:21:14.288637+0000","last_clean":"2023-07-13T14:21:14.288637+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T14:21:14.288637+0000","last_undegraded":"2023-07-13T14:21:14.288637+0000","last_fullsized":"2023-07-13T14:21:14.288637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1260","last_scrub_stamp":"2023-07-13T14:21:14.288525+0000","last_deep_scrub":"31'1260","last_deep_scrub_stamp":"2023-07-13T14:21:14.288525+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.288525+0000","objects_scrubbed":3,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:21.111968+0000","scrub_duration":0.098002016999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'30","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:33.566512+0000","last_change":"2023-07-13T14:21:33.566570+0000","last_active":"2023-07-13T14:21:33.566512+0000","last_peered":"2023-07-13T14:21:33.566512+0000","last_clean":"2023-07-13T14:21:33.566512+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T14:21:33.566512+0000","last_undegraded":"2023-07-13T14:21:33.566512+0000","last_fullsized":"2023-07-13T14:21:33.566512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:33.566402+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:33.566402+0000","last_clean_scrub_stamp":"2023-07-13T14:21:33.566402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:37:40.270587+0000","scrub_duration":0.021711978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"31'115","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.023630+0000","last_change":"2023-07-13T13:52:23.986993+0000","last_active":"2023-07-13T14:20:43.023630+0000","last_peered":"2023-07-13T14:20:43.023630+0000","last_clean":"2023-07-13T14:20:43.023630+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T14:20:43.023630+0000","last_undegraded":"2023-07-13T14:20:43.023630+0000","last_fullsized":"2023-07-13T14:20:43.023630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T13:52:22.671239+0000","last_clean_scrub_stamp":"2023-07-13T13:52:22.671239+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'764","reported_seq":814,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:05.409170+0000","last_change":"2023-07-13T14:21:05.409213+0000","last_active":"2023-07-13T14:21:05.409170+0000","last_peered":"2023-07-13T14:21:05.409170+0000","last_clean":"2023-07-13T14:21:05.409170+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T14:21:05.409170+0000","last_undegraded":"2023-07-13T14:21:05.409170+0000","last_fullsized":"2023-07-13T14:21:05.409170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'764","last_scrub_stamp":"2023-07-13T14:21:05.409053+0000","last_deep_scrub":"31'764","last_deep_scrub_stamp":"2023-07-13T14:21:05.409053+0000","last_clean_scrub_stamp":"2023-07-13T14:21:05.409053+0000","objects_scrubbed":1,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:12.232496+0000","scrub_duration":0.058883059000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":4555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.170407+0000","last_change":"2023-07-13T14:20:55.170407+0000","last_active":"2023-07-13T14:20:55.170407+0000","last_peered":"2023-07-13T14:20:55.170407+0000","last_clean":"2023-07-13T14:20:55.170407+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T14:20:55.170407+0000","last_undegraded":"2023-07-13T14:20:55.170407+0000","last_fullsized":"2023-07-13T14:20:55.170407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:55.170275+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:55.170275+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.170275+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:16.808243+0000","scrub_duration":0.018752201999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'135","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.143163+0000","last_change":"2023-07-13T14:21:22.143163+0000","last_active":"2023-07-13T14:21:22.143163+0000","last_peered":"2023-07-13T14:21:22.143163+0000","last_clean":"2023-07-13T14:21:22.143163+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T14:21:22.143163+0000","last_undegraded":"2023-07-13T14:21:22.143163+0000","last_fullsized":"2023-07-13T14:21:22.143163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2023-07-13T14:21:22.143026+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2023-07-13T14:21:22.143026+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.143026+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:59.119380+0000","scrub_duration":0.019092520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":6623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"31'736","reported_seq":784,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:07.933127+0000","last_change":"2023-07-13T14:21:07.933127+0000","last_active":"2023-07-13T14:21:07.933127+0000","last_peered":"2023-07-13T14:21:07.933127+0000","last_clean":"2023-07-13T14:21:07.933127+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T14:21:07.933127+0000","last_undegraded":"2023-07-13T14:21:07.933127+0000","last_fullsized":"2023-07-13T14:21:07.933127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'736","last_scrub_stamp":"2023-07-13T14:21:07.932955+0000","last_deep_scrub":"31'736","last_deep_scrub_stamp":"2023-07-13T14:21:07.932955+0000","last_clean_scrub_stamp":"2023-07-13T14:21:07.932955+0000","objects_scrubbed":3,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:33:15.292167+0000","scrub_duration":0.073400576999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'37","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:40.600282+0000","last_change":"2023-07-13T14:21:40.600324+0000","last_active":"2023-07-13T14:21:40.600282+0000","last_peered":"2023-07-13T14:21:40.600282+0000","last_clean":"2023-07-13T14:21:40.600282+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T14:21:40.600282+0000","last_undegraded":"2023-07-13T14:21:40.600282+0000","last_fullsized":"2023-07-13T14:21:40.600282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:40.600199+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:40.600199+0000","last_clean_scrub_stamp":"2023-07-13T14:21:40.600199+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:37.554600+0000","scrub_duration":0.021753134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"31'43","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.494451+0000","last_change":"2023-07-13T14:20:51.494451+0000","last_active":"2023-07-13T14:20:51.494451+0000","last_peered":"2023-07-13T14:20:51.494451+0000","last_clean":"2023-07-13T14:20:51.494451+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T14:20:51.494451+0000","last_undegraded":"2023-07-13T14:20:51.494451+0000","last_fullsized":"2023-07-13T14:20:51.494451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-07-13T14:20:51.494264+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-07-13T14:20:51.494264+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.494264+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:19:20.845976+0000","scrub_duration":0.021866048999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"31'36","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.338438+0000","last_change":"2023-07-13T14:21:20.338438+0000","last_active":"2023-07-13T14:21:20.338438+0000","last_peered":"2023-07-13T14:21:20.338438+0000","last_clean":"2023-07-13T14:21:20.338438+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T14:21:20.338438+0000","last_undegraded":"2023-07-13T14:21:20.338438+0000","last_fullsized":"2023-07-13T14:21:20.338438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:21:20.338174+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:21:20.338174+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.338174+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:50:14.174112+0000","scrub_duration":0.018797963000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"31'42","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:10.506676+0000","last_change":"2023-07-13T14:21:10.506676+0000","last_active":"2023-07-13T14:21:10.506676+0000","last_peered":"2023-07-13T14:21:10.506676+0000","last_clean":"2023-07-13T14:21:10.506676+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T14:21:10.506676+0000","last_undegraded":"2023-07-13T14:21:10.506676+0000","last_fullsized":"2023-07-13T14:21:10.506676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:21:10.506562+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:21:10.506562+0000","last_clean_scrub_stamp":"2023-07-13T14:21:10.506562+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:23.333519+0000","scrub_duration":0.021720092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"31'28","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.231458+0000","last_change":"2023-07-13T14:20:57.231458+0000","last_active":"2023-07-13T14:20:57.231458+0000","last_peered":"2023-07-13T14:20:57.231458+0000","last_clean":"2023-07-13T14:20:57.231458+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T14:20:57.231458+0000","last_undegraded":"2023-07-13T14:20:57.231458+0000","last_fullsized":"2023-07-13T14:20:57.231458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:20:57.231265+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:20:57.231265+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.231265+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:35:53.580424+0000","scrub_duration":0.018638647000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'22","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:05.117156+0000","last_change":"2023-07-13T14:21:05.117192+0000","last_active":"2023-07-13T14:21:05.117156+0000","last_peered":"2023-07-13T14:21:05.117156+0000","last_clean":"2023-07-13T14:21:05.117156+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T14:21:05.117156+0000","last_undegraded":"2023-07-13T14:21:05.117156+0000","last_fullsized":"2023-07-13T14:21:05.117156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:21:05.117076+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:21:05.117076+0000","last_clean_scrub_stamp":"2023-07-13T14:21:05.117076+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:29:06.978004+0000","scrub_duration":0.019054194999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3402,"num_write_kb":282366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3765,"ondisk_log_size":3765,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":35165063,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":7922,"num_write_kb":39030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49258496,"data_stored":70330126,"data_compressed":6207514,"data_compressed_allocated":9723904,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":0},"log_size":7513,"ondisk_log_size":7513,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509800,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34704,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337136,"statfs":{"total":96636764160,"available":96601227264,"internally_reserved":0,"allocated":3678208,"data_stored":4927655,"data_compressed":341063,"data_compressed_allocated":569344,"data_compressed_original":2035712,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.438},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.433},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.438,"15min":0.45200000000000001},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.72099999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29199999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60299999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.47599999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":3.2789999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.32400000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63500000000000001,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.66400000000000003,"5min":0.84599999999999997,"15min":1.4630000000000001},"last":0.501}]},{"osd":3,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48399999999999999},"min":{"1min":0.35499999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.53400000000000003,"5min":0.93300000000000005,"15min":1.4650000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.35099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64700000000000002,"5min":3.8999999999999999,"15min":3.8999999999999999},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42299999999999999,"15min":0.44500000000000001},"min":{"1min":0.28199999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.628,"5min":0.628,"15min":0.83399999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.44700000000000001,"15min":0.46700000000000003},"min":{"1min":0.30599999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52700000000000002,"5min":0.65500000000000003,"15min":0.83299999999999996},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.47299999999999998,"15min":0.498},"min":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.63400000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.51200000000000001},"min":{"1min":0.316,"5min":0.253,"15min":0.253},"max":{"1min":0.60699999999999998,"5min":0.72499999999999998,"15min":0.79700000000000004},"last":0.32000000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:20:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.52800000000000002},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64600000000000002,"5min":0.72599999999999998,"15min":0.86699999999999999},"last":0.377},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.622,"5min":0.67300000000000004,"15min":0.81399999999999995},"last":0.33900000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509800,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30324,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341516,"statfs":{"total":96636764160,"available":96605712384,"internally_reserved":0,"allocated":3387392,"data_stored":4336399,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41999999999999998,"15min":0.436},"min":{"1min":0.27100000000000002,"5min":0.24199999999999999,"15min":0.217},"max":{"1min":0.56000000000000005,"5min":0.61299999999999999,"15min":1.2549999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.432,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.25700000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":2.3759999999999999},"last":0.502}]},{"osd":1,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42799999999999999,"15min":0.43099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.60199999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.47999999999999998,"15min":0.46400000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28699999999999998},"max":{"1min":0.60199999999999998,"5min":2.899,"15min":2.899},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.36499999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59099999999999997,"5min":0.92500000000000004,"15min":2.1789999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45400000000000001,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61599999999999999,"5min":0.70299999999999996,"15min":3.4060000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.56200000000000006,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.25900000000000001},"max":{"1min":0.63300000000000001,"5min":2.7389999999999999,"15min":5.3810000000000002},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44600000000000001,"15min":0.44700000000000001},"min":{"1min":0.28299999999999997,"5min":0.25800000000000001,"15min":0.23799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.80100000000000005},"last":0.33100000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.311,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60199999999999998,"5min":0.73399999999999999,"15min":0.81599999999999995},"last":0.312},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.32000000000000001,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":0.70499999999999996,"15min":0.89500000000000002},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jul 13 14:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.33900000000000002,"5min":0.32000000000000001,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.745,"15min":0.75800000000000001},"last":0.37},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68500000000000005,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.40200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575208,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39120,"kb_used_data":3912,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94332720,"statfs":{"total":96636764160,"available":96596705280,"internally_reserved":0,"allocated":4005888,"data_stored":5770865,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33100000000000002,"15min":0.33800000000000002},"min":{"1min":0.20399999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.435,"5min":0.61599999999999999,"15min":3.7240000000000002},"last":0.376},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.216,"5min":0.214,"15min":0.214},"max":{"1min":0.42099999999999999,"5min":0.71099999999999997,"15min":0.76200000000000001},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.314,"15min":0.33000000000000002},"min":{"1min":0.218,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.38400000000000001,"5min":0.52100000000000002,"15min":1.49},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.375},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.20300000000000001},"max":{"1min":0.52100000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47899999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.29499999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.48999999999999999,"5min":1.548,"15min":1.548},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.70499999999999996,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.80100000000000005,"15min":0.83099999999999996},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.309},"max":{"1min":0.746,"5min":0.83299999999999996,"15min":0.89700000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.92800000000000005},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":1.625,"15min":1.625},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.81999999999999995,"15min":0.92200000000000004},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58099999999999996,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73399999999999999,"5min":0.94299999999999995,"15min":0.95299999999999996},"last":0.505},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68400000000000005,"5min":1.657,"15min":1.657},"last":0.51600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542504,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66744,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94305096,"statfs":{"total":96636764160,"available":96568418304,"internally_reserved":0,"allocated":9617408,"data_stored":13490652,"data_compressed":1179065,"data_compressed_allocated":1941504,"data_compressed_original":6012928,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 14:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30299999999999999,"15min":0.307},"min":{"1min":0.215,"5min":0.186,"15min":0.185},"max":{"1min":0.46100000000000002,"5min":0.53600000000000003,"15min":0.64800000000000002},"last":0.248},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.19},"max":{"1min":0.52000000000000002,"5min":0.64400000000000002,"15min":1.6879999999999999},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48199999999999998,"5min":0.59499999999999997,"15min":0.77200000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.374,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.42799999999999999,"5min":3.4940000000000002,"15min":3.4940000000000002},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38,"15min":0.377},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.67500000000000004,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38800000000000001,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.26400000000000001,"15min":0.26300000000000001},"max":{"1min":0.51300000000000001,"5min":0.76500000000000001,"15min":2.5379999999999998},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65500000000000003,"5min":0.85099999999999998,"15min":0.91400000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28699999999999998},"max":{"1min":0.753,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.501}]},{"osd":5,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52300000000000002,"15min":0.54100000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.73599999999999999,"5min":0.80700000000000005,"15min":0.94299999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.629,"5min":0.76900000000000002,"15min":1.0529999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55500000000000005,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.96599999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.83699999999999997,"15min":0.98299999999999998},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81499999999999995,"15min":0.997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73099999999999998,"5min":0.86599999999999999,"15min":1.03},"last":0.54100000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509800,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1228800,"data_stored":1576561,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.309,"15min":0.31},"min":{"1min":0.221,"5min":0.20799999999999999,"15min":0.17899999999999999},"max":{"1min":0.48099999999999998,"5min":0.65200000000000002,"15min":0.751},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.34000000000000002,"15min":0.36099999999999999},"min":{"1min":0.215,"5min":0.21299999999999999,"15min":0.20699999999999999},"max":{"1min":0.503,"5min":0.57099999999999995,"15min":3.0939999999999999},"last":0.498}]},{"osd":1,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36099999999999999,"15min":0.36199999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.222},"max":{"1min":0.47199999999999998,"5min":0.749,"15min":1.248},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46400000000000002,"5min":0.94899999999999995,"15min":2.9529999999999998},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34200000000000003,"15min":0.36899999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.223},"max":{"1min":0.48099999999999998,"5min":0.53100000000000003,"15min":2.2490000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.375,"5min":0.39000000000000001,"15min":0.40500000000000003},"min":{"1min":0.29199999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.51600000000000001,"5min":0.71299999999999997,"15min":1.167},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":0.75700000000000001,"5min":0.79300000000000004,"15min":0.82999999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.26700000000000002},"max":{"1min":0.68400000000000005,"5min":0.82899999999999996,"15min":2.3220000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76500000000000001,"5min":0.86899999999999999,"15min":2.3660000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":1.681},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.34799999999999998},"max":{"1min":0.68300000000000005,"5min":0.73699999999999999,"15min":1.6970000000000001},"last":0.627},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69199999999999995,"5min":0.94699999999999995,"15min":0.98999999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jul 13 14:20:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56000000000000005,"15min":0.57299999999999995},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.70799999999999996,"5min":0.83899999999999997,"15min":2.4020000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.39600000000000002,"5min":0.371,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":0.72699999999999998,"15min":1.6619999999999999},"last":0.64800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509800,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":6184960,"data_stored":8530793,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.495,"5min":0.65500000000000003,"15min":0.78300000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.318,"15min":0.33800000000000002},"min":{"1min":0.24199999999999999,"5min":0.22500000000000001,"15min":0.193},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":2.972},"last":0.26900000000000002}]},{"osd":1,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36299999999999999,"15min":0.35599999999999998},"min":{"1min":0.25700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48199999999999998,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.38},"min":{"1min":0.26100000000000001,"5min":0.221,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.73999999999999999,"15min":2.173},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.28100000000000003,"5min":0.23599999999999999,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":2.335},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39700000000000002,"15min":0.41699999999999998},"min":{"1min":0.255,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55800000000000005,"5min":0.71399999999999997,"15min":2.2000000000000002},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.26000000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.83799999999999997,"15min":0.88600000000000001},"last":0.621}]},{"osd":5,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.84599999999999997,"15min":0.92800000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34699999999999998},"max":{"1min":0.85299999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.33200000000000002},"max":{"1min":0.76300000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.78500000000000003,"15min":0.82299999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.34699999999999998,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.97599999999999998},"last":0.58699999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509800,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77928,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94293912,"statfs":{"total":96636764160,"available":96556965888,"internally_reserved":0,"allocated":15171584,"data_stored":21289038,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":1781,"internal_metadata":64616715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42899999999999999,"15min":0.437},"min":{"1min":0.33800000000000002,"5min":0.27200000000000002,"15min":0.23400000000000001},"max":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.72399999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.443,"15min":0.435},"min":{"1min":0.33800000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60399999999999998,"5min":0.68100000000000005,"15min":0.68500000000000005},"last":0.497}]},{"osd":1,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.44},"min":{"1min":0.316,"5min":0.29299999999999998,"15min":0.25},"max":{"1min":0.62,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45900000000000002},"min":{"1min":0.35099999999999998,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.623,"5min":0.69399999999999995,"15min":0.73499999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45100000000000001,"15min":0.46400000000000002},"min":{"1min":0.31,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72899999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.47899999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.64100000000000001,"5min":2.266,"15min":2.266},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57099999999999995,"5min":1.2849999999999999,"15min":1.5620000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.29599999999999999},"max":{"1min":0.76800000000000002,"5min":1.4259999999999999,"15min":2.6960000000000002},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.46300000000000002},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.253},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.73699999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.25600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.28599999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jul 13 14:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.495,"15min":0.50700000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.27800000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.77500000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.39100000000000001,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80400000000000005},"last":0.60299999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509800,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61820,"kb_used_data":8564,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94310020,"statfs":{"total":96636764160,"available":96573460480,"internally_reserved":0,"allocated":8769536,"data_stored":12725659,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.44900000000000001,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65600000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.26200000000000001,"15min":0.23899999999999999},"max":{"1min":0.623,"5min":0.68000000000000005,"15min":0.72399999999999998},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47599999999999998,"15min":0.46000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.77700000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":1.3129999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.40400000000000003,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":1.7430000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24299999999999999},"max":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":1.284},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.64000000000000001,"5min":0.90100000000000002,"15min":1.056},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":1.0960000000000001,"15min":1.78},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.43099999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.434},{"interface":"front","average":{"1min":0.435,"5min":0.46899999999999997,"15min":0.47599999999999998},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65800000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.46600000000000003,"15min":0.47999999999999998},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":1.2210000000000001},"last":0.62},{"interface":"front","average":{"1min":0.436,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":0.70599999999999996,"15min":0.77400000000000002},"last":0.5}]},{"osd":7,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.33800000000000002,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.71299999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.505,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74399999999999999,"5min":1.0429999999999999,"15min":1.351},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":12758189,"data_compressed":1146678,"data_compressed_allocated":1896448,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3674112,"data_stored":5628770,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897024,"data_stored":1434466,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5853184,"data_stored":8388698,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":21146943,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":12583564,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3055616,"data_stored":4194304,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":4195192,"data_compressed":308676,"data_compressed_allocated":524288,"data_compressed_original":1462272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T14:21:48.193 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:48.194 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:48.194 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:48.195 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:48.196 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:48.197 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:48.197 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-13T13:52:22.671239+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=13, tm_min=52, tm_sec=22, tm_wday=3, tm_yday=194, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=13, tm_hour=14, tm_min=20, tm_sec=37, tm_wday=3, tm_yday=194, tm_isdst=0) 2023-07-13T14:21:48.198 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-13T14:21:58.392 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:21:58.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:22:08.199 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-13T14:22:08.325 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.334+0000 7fd8496b2700 1 Processor -- start 2023-07-13T14:22:08.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.334+0000 7fd8496b2700 1 -- start start 2023-07-13T14:22:08.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.334+0000 7fd8496b2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8440c99c0 0x7fd8440c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.334+0000 7fd8496b2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd8440c9d90 0x7fd8440c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.334+0000 7fd8496b2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440ca910 con 0x7fd844158390 2023-07-13T14:22:08.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.334+0000 7fd8496b2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440c9600 con 0x7fd8440c9d90 2023-07-13T14:22:08.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.334+0000 7fd8496b2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84406c080 con 0x7fd8440c99c0 2023-07-13T14:22:08.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.335+0000 7fd842ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8440c99c0 0x7fd8440c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.335+0000 7fd8427fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd8440c9d90 0x7fd8440c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.336+0000 7fd8437fe700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd844158390 0x7fd8440cb0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:60750/0 (socket says 172.21.15.118:60750) 2023-07-13T14:22:08.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.336+0000 7fd8437fe700 1 -- 172.21.15.118:0/3350559547 learned_addr learned my addr 172.21.15.118:0/3350559547 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:22:08.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.339+0000 7fd842ffd700 1 -- 172.21.15.118:0/3350559547 >> v2:172.21.15.123:3300/0 conn(0x7fd8440c9d90 msgr2=0x7fd8440c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:08.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.339+0000 7fd842ffd700 1 --2- 172.21.15.118:0/3350559547 >> v2:172.21.15.123:3300/0 conn(0x7fd8440c9d90 0x7fd8440c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.339+0000 7fd842ffd700 1 -- 172.21.15.118:0/3350559547 >> v1:172.21.15.123:6789/0 conn(0x7fd844158390 legacy=0x7fd8440cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.339+0000 7fd842ffd700 1 -- 172.21.15.118:0/3350559547 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440cec80 con 0x7fd8440c99c0 2023-07-13T14:22:08.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.341+0000 7fd842ffd700 1 --2- 172.21.15.118:0/3350559547 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8440c99c0 0x7fd8440c90c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd834009840 tx=0x7fd834009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d0438344bfbde90 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:08.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd841ffb700 1 -- 172.21.15.118:0/3350559547 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834011830 con 0x7fd8440c99c0 2023-07-13T14:22:08.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd841ffb700 1 -- 172.21.15.118:0/3350559547 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834011990 con 0x7fd8440c99c0 2023-07-13T14:22:08.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd841ffb700 1 -- 172.21.15.118:0/3350559547 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834011d20 con 0x7fd8440c99c0 2023-07-13T14:22:08.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd8496b2700 1 -- 172.21.15.118:0/3350559547 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8440c99c0 msgr2=0x7fd8440c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:08.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3350559547 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8440c99c0 0x7fd8440c90c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd834009840 tx=0x7fd834009b50 comp rx=0 tx=0).stop 2023-07-13T14:22:08.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd8496b2700 1 -- 172.21.15.118:0/3350559547 shutdown_connections 2023-07-13T14:22:08.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3350559547 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd8440c99c0 0x7fd8440c90c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3350559547 >> v2:172.21.15.123:3300/0 conn(0x7fd8440c9d90 0x7fd8440c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd8496b2700 1 -- 172.21.15.118:0/3350559547 >> 172.21.15.118:0/3350559547 conn(0x7fd84406c750 msgr2=0x7fd84406cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:08.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd8496b2700 1 -- 172.21.15.118:0/3350559547 shutdown_connections 2023-07-13T14:22:08.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.346+0000 7fd8496b2700 1 -- 172.21.15.118:0/3350559547 wait complete. 2023-07-13T14:22:08.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.348+0000 7fd8496b2700 1 Processor -- start 2023-07-13T14:22:08.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.348+0000 7fd8496b2700 1 -- start start 2023-07-13T14:22:08.343 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.349+0000 7fd8496b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8440c99c0 0x7fd8441e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.349+0000 7fd8496b2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8440c9d90 0x7fd8441ee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.349+0000 7fd8496b2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd844158390 0x7fd8441466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.349+0000 7fd8496b2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844150590 con 0x7fd8440c9d90 2023-07-13T14:22:08.344 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.349+0000 7fd8496b2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440b4050 con 0x7fd8440c99c0 2023-07-13T14:22:08.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.349+0000 7fd8496b2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8441f1720 con 0x7fd844158390 2023-07-13T14:22:08.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.350+0000 7fd8427fc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8440c9d90 0x7fd8441ee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.350+0000 7fd842ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8440c99c0 0x7fd8441e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.345 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.350+0000 7fd8437fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd844158390 0x7fd8441466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.350+0000 7fd8437fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd844158390 0x7fd8441466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:42476/0 (socket says 172.21.15.118:42476) 2023-07-13T14:22:08.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.350+0000 7fd842ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8440c99c0 0x7fd8441e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:37606/0 (socket says 172.21.15.118:37606) 2023-07-13T14:22:08.346 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.350+0000 7fd8437fe700 1 -- 172.21.15.118:0/3196586008 learned_addr learned my addr 172.21.15.118:0/3196586008 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:08.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.354+0000 7fd8437fe700 1 -- 172.21.15.118:0/3196586008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8440c99c0 msgr2=0x7fd8441e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:08.347 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.354+0000 7fd8437fe700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8440c99c0 0x7fd8441e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.354+0000 7fd8437fe700 1 -- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8440c9d90 msgr2=0x7fd8441ee1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:08.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.354+0000 7fd8437fe700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8440c9d90 0x7fd8441ee1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.348 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.354+0000 7fd8437fe700 1 -- 172.21.15.118:0/3196586008 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340094a0 con 0x7fd844158390 2023-07-13T14:22:08.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.357+0000 7fd8437fe700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd844158390 0x7fd8441466d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00cab0 tx=0x7fd83c00cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.361+0000 7fd82b7fe700 1 -- 172.21.15.118:0/3196586008 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00a9a0 con 0x7fd844158390 2023-07-13T14:22:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.361+0000 7fd82b7fe700 1 -- 172.21.15.118:0/3196586008 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00ab00 con 0x7fd844158390 2023-07-13T14:22:08.353 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.361+0000 7fd82b7fe700 1 -- 172.21.15.118:0/3196586008 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00ae70 con 0x7fd844158390 2023-07-13T14:22:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.361+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8440b4260 con 0x7fd844158390 2023-07-13T14:22:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.361+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8441f1c50 con 0x7fd844158390 2023-07-13T14:22:08.354 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.362+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8440743c0 con 0x7fd844158390 2023-07-13T14:22:08.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.611+0000 7fd82b7fe700 1 -- 172.21.15.118:0/3196586008 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd83c01b3b0 con 0x7fd844158390 2023-07-13T14:22:08.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.611+0000 7fd82b7fe700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd83006ad30 0x7fd83006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.603 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.611+0000 7fd842ffd700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd83006ad30 0x7fd83006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.604 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.612+0000 7fd842ffd700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd83006ad30 0x7fd83006d1e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd834000c00 tx=0x7fd834008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:08.607 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.616+0000 7fd82b7fe700 1 -- 172.21.15.118:0/3196586008 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd83c05c0a0 con 0x7fd844158390 2023-07-13T14:22:08.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.626+0000 7fd82b7fe700 1 -- 172.21.15.118:0/3196586008 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd83c0544d0 con 0x7fd844158390 2023-07-13T14:22:08.800 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.808+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 --> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8440cf240 con 0x7fd83006ad30 2023-07-13T14:22:08.810 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.819+0000 7fd82b7fe700 1 -- 172.21.15.118:0/3196586008 <== mgr.4192 v2:172.21.15.118:6832/1448394653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+396087 (secure 0 0 0) 0x7fd834011c00 con 0x7fd83006ad30 2023-07-13T14:22:08.818 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:22:08.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd83006ad30 msgr2=0x7fd83006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:08.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd83006ad30 0x7fd83006d1e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd834000c00 tx=0x7fd834008030 comp rx=0 tx=0).stop 2023-07-13T14:22:08.821 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd844158390 msgr2=0x7fd8441466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:08.822 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd844158390 0x7fd8441466d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00cab0 tx=0x7fd83c00cdc0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.822 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 shutdown_connections 2023-07-13T14:22:08.822 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fd83006ad30 0x7fd83006d1e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8440c99c0 0x7fd8441e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd844158390 0x7fd8441466d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 --2- 172.21.15.118:0/3196586008 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8440c9d90 0x7fd8441ee1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.823 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 >> 172.21.15.118:0/3196586008 conn(0x7fd84406c750 msgr2=0x7fd8440cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:08.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 shutdown_connections 2023-07-13T14:22:08.824 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.823+0000 7fd8496b2700 1 -- 172.21.15.118:0/3196586008 wait complete. 2023-07-13T14:22:08.824 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-07-13T14:22:08.827 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":925,"stamp":"2023-07-13T14:22:07.321042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35755431,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":925,"num_read_kb":952,"num_write":11483,"num_write_kb":323812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13395,"ondisk_log_size":13395,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406344,"kb_used_data":50824,"kb_used_omap":13,"kb_used_meta":355442,"kb_avail":754568376,"statfs":{"total":773094113280,"available":772678017024,"internally_reserved":0,"allocated":52043776,"data_stored":72647622,"data_compressed":6272288,"data_compressed_allocated":9814016,"data_compressed_original":32006144,"omap_allocated":14248,"internal_metadata":363972696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002743"},"pg_stats":[{"pgid":"4.3f","version":"31'26","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.697055+0000","last_change":"2023-07-13T14:20:54.697055+0000","last_active":"2023-07-13T14:20:54.697055+0000","last_peered":"2023-07-13T14:20:54.697055+0000","last_clean":"2023-07-13T14:20:54.697055+0000","last_became_active":"2023-07-13T13:52:17.925776+0000","last_became_peered":"2023-07-13T13:52:17.925776+0000","last_unstale":"2023-07-13T14:20:54.697055+0000","last_undegraded":"2023-07-13T14:20:54.697055+0000","last_fullsized":"2023-07-13T14:20:54.697055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2023-07-13T14:20:54.696939+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2023-07-13T14:20:54.696939+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.696939+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:29:01.595104+0000","scrub_duration":0.018622025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"31'31","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.133215+0000","last_change":"2023-07-13T14:20:48.133215+0000","last_active":"2023-07-13T14:20:48.133215+0000","last_peered":"2023-07-13T14:20:48.133215+0000","last_clean":"2023-07-13T14:20:48.133215+0000","last_became_active":"2023-07-13T13:52:17.952172+0000","last_became_peered":"2023-07-13T13:52:17.952172+0000","last_unstale":"2023-07-13T14:20:48.133215+0000","last_undegraded":"2023-07-13T14:20:48.133215+0000","last_fullsized":"2023-07-13T14:20:48.133215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:48.133089+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:48.133089+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.133089+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:26:56.268712+0000","scrub_duration":0.021360286999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"31'36","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:45.472644+0000","last_change":"2023-07-13T14:20:45.472644+0000","last_active":"2023-07-13T14:20:45.472644+0000","last_peered":"2023-07-13T14:20:45.472644+0000","last_clean":"2023-07-13T14:20:45.472644+0000","last_became_active":"2023-07-13T13:52:17.942661+0000","last_became_peered":"2023-07-13T13:52:17.942661+0000","last_unstale":"2023-07-13T14:20:45.472644+0000","last_undegraded":"2023-07-13T14:20:45.472644+0000","last_fullsized":"2023-07-13T14:20:45.472644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:20:45.472514+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:20:45.472514+0000","last_clean_scrub_stamp":"2023-07-13T14:20:45.472514+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:24.113486+0000","scrub_duration":0.021725029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"31'25","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:53.442661+0000","last_change":"2023-07-13T14:20:53.442722+0000","last_active":"2023-07-13T14:20:53.442661+0000","last_peered":"2023-07-13T14:20:53.442661+0000","last_clean":"2023-07-13T14:20:53.442661+0000","last_became_active":"2023-07-13T13:52:17.933599+0000","last_became_peered":"2023-07-13T13:52:17.933599+0000","last_unstale":"2023-07-13T14:20:53.442661+0000","last_undegraded":"2023-07-13T14:20:53.442661+0000","last_fullsized":"2023-07-13T14:20:53.442661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2023-07-13T14:20:53.442582+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2023-07-13T14:20:53.442582+0000","last_clean_scrub_stamp":"2023-07-13T14:20:53.442582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:26:25.786899+0000","scrub_duration":0.021817185999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"31'23","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:42.761836+0000","last_change":"2023-07-13T14:20:42.761873+0000","last_active":"2023-07-13T14:20:42.761836+0000","last_peered":"2023-07-13T14:20:42.761836+0000","last_clean":"2023-07-13T14:20:42.761836+0000","last_became_active":"2023-07-13T13:52:17.886420+0000","last_became_peered":"2023-07-13T13:52:17.886420+0000","last_unstale":"2023-07-13T14:20:42.761836+0000","last_undegraded":"2023-07-13T14:20:42.761836+0000","last_fullsized":"2023-07-13T14:20:42.761836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2023-07-13T14:20:42.761766+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2023-07-13T14:20:42.761766+0000","last_clean_scrub_stamp":"2023-07-13T14:20:42.761766+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:02.865757+0000","scrub_duration":0.026158679000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.541567+0000","last_change":"2023-07-13T14:20:54.541633+0000","last_active":"2023-07-13T14:20:54.541567+0000","last_peered":"2023-07-13T14:20:54.541567+0000","last_clean":"2023-07-13T14:20:54.541567+0000","last_became_active":"2023-07-13T13:52:17.942336+0000","last_became_peered":"2023-07-13T13:52:17.942336+0000","last_unstale":"2023-07-13T14:20:54.541567+0000","last_undegraded":"2023-07-13T14:20:54.541567+0000","last_fullsized":"2023-07-13T14:20:54.541567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:54.541444+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:54.541444+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.541444+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:14:52.144625+0000","scrub_duration":0.021735659000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.535925+0000","last_change":"2023-07-13T14:21:17.535975+0000","last_active":"2023-07-13T14:21:17.535925+0000","last_peered":"2023-07-13T14:21:17.535925+0000","last_clean":"2023-07-13T14:21:17.535925+0000","last_became_active":"2023-07-13T13:52:17.949952+0000","last_became_peered":"2023-07-13T13:52:17.949952+0000","last_unstale":"2023-07-13T14:21:17.535925+0000","last_undegraded":"2023-07-13T14:21:17.535925+0000","last_fullsized":"2023-07-13T14:21:17.535925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:17.535835+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:17.535835+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.535835+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:56.176808+0000","scrub_duration":0.022364232000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"31'22","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:32.183454+0000","last_change":"2023-07-13T14:21:32.183545+0000","last_active":"2023-07-13T14:21:32.183454+0000","last_peered":"2023-07-13T14:21:32.183454+0000","last_clean":"2023-07-13T14:21:32.183454+0000","last_became_active":"2023-07-13T13:52:17.943146+0000","last_became_peered":"2023-07-13T13:52:17.943146+0000","last_unstale":"2023-07-13T14:21:32.183454+0000","last_undegraded":"2023-07-13T14:21:32.183454+0000","last_fullsized":"2023-07-13T14:21:32.183454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:21:32.183338+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:21:32.183338+0000","last_clean_scrub_stamp":"2023-07-13T14:21:32.183338+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:04:06.124842+0000","scrub_duration":0.021369658999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"31'35","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.801365+0000","last_change":"2023-07-13T14:21:14.801365+0000","last_active":"2023-07-13T14:21:14.801365+0000","last_peered":"2023-07-13T14:21:14.801365+0000","last_clean":"2023-07-13T14:21:14.801365+0000","last_became_active":"2023-07-13T13:52:58.032221+0000","last_became_peered":"2023-07-13T13:52:58.032221+0000","last_unstale":"2023-07-13T14:21:14.801365+0000","last_undegraded":"2023-07-13T14:21:14.801365+0000","last_fullsized":"2023-07-13T14:21:14.801365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:21:14.801249+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:21:14.801249+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.801249+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:51.777603+0000","scrub_duration":0.026178751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'37","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:37.065365+0000","last_change":"2023-07-13T14:21:37.065426+0000","last_active":"2023-07-13T14:21:37.065365+0000","last_peered":"2023-07-13T14:21:37.065365+0000","last_clean":"2023-07-13T14:21:37.065365+0000","last_became_active":"2023-07-13T13:52:17.885909+0000","last_became_peered":"2023-07-13T13:52:17.885909+0000","last_unstale":"2023-07-13T14:21:37.065365+0000","last_undegraded":"2023-07-13T14:21:37.065365+0000","last_fullsized":"2023-07-13T14:21:37.065365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:37.065265+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:37.065265+0000","last_clean_scrub_stamp":"2023-07-13T14:21:37.065265+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:14:02.826964+0000","scrub_duration":0.021431605999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"31'30","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:41.577870+0000","last_change":"2023-07-13T14:21:41.577908+0000","last_active":"2023-07-13T14:21:41.577870+0000","last_peered":"2023-07-13T14:21:41.577870+0000","last_clean":"2023-07-13T14:21:41.577870+0000","last_became_active":"2023-07-13T13:52:58.431466+0000","last_became_peered":"2023-07-13T13:52:58.431466+0000","last_unstale":"2023-07-13T14:21:41.577870+0000","last_undegraded":"2023-07-13T14:21:41.577870+0000","last_fullsized":"2023-07-13T14:21:41.577870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:41.577806+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:41.577806+0000","last_clean_scrub_stamp":"2023-07-13T14:21:41.577806+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:26:00.059622+0000","scrub_duration":0.021748400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"31'22","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:53.729089+0000","last_change":"2023-07-13T14:20:53.729089+0000","last_active":"2023-07-13T14:20:53.729089+0000","last_peered":"2023-07-13T14:20:53.729089+0000","last_clean":"2023-07-13T14:20:53.729089+0000","last_became_active":"2023-07-13T13:52:17.942989+0000","last_became_peered":"2023-07-13T13:52:17.942989+0000","last_unstale":"2023-07-13T14:20:53.729089+0000","last_undegraded":"2023-07-13T14:20:53.729089+0000","last_fullsized":"2023-07-13T14:20:53.729089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:20:53.728917+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:20:53.728917+0000","last_clean_scrub_stamp":"2023-07-13T14:20:53.728917+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:13:12.259842+0000","scrub_duration":0.018519234999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"31'35","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:49.683702+0000","last_change":"2023-07-13T14:20:49.683702+0000","last_active":"2023-07-13T14:20:49.683702+0000","last_peered":"2023-07-13T14:20:49.683702+0000","last_clean":"2023-07-13T14:20:49.683702+0000","last_became_active":"2023-07-13T13:52:17.924887+0000","last_became_peered":"2023-07-13T13:52:17.924887+0000","last_unstale":"2023-07-13T14:20:49.683702+0000","last_undegraded":"2023-07-13T14:20:49.683702+0000","last_fullsized":"2023-07-13T14:20:49.683702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:49.683512+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:49.683512+0000","last_clean_scrub_stamp":"2023-07-13T14:20:49.683512+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:42:17.670520+0000","scrub_duration":0.018508302000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.160281+0000","last_change":"2023-07-13T14:20:51.160322+0000","last_active":"2023-07-13T14:20:51.160281+0000","last_peered":"2023-07-13T14:20:51.160281+0000","last_clean":"2023-07-13T14:20:51.160281+0000","last_became_active":"2023-07-13T13:52:17.925176+0000","last_became_peered":"2023-07-13T13:52:17.925176+0000","last_unstale":"2023-07-13T14:20:51.160281+0000","last_undegraded":"2023-07-13T14:20:51.160281+0000","last_fullsized":"2023-07-13T14:20:51.160281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:51.160209+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:51.160209+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.160209+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:42:01.494240+0000","scrub_duration":0.021377126999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:28.510184+0000","last_change":"2023-07-13T14:21:28.510229+0000","last_active":"2023-07-13T14:21:28.510184+0000","last_peered":"2023-07-13T14:21:28.510184+0000","last_clean":"2023-07-13T14:21:28.510184+0000","last_became_active":"2023-07-13T13:52:17.951737+0000","last_became_peered":"2023-07-13T13:52:17.951737+0000","last_unstale":"2023-07-13T14:21:28.510184+0000","last_undegraded":"2023-07-13T14:21:28.510184+0000","last_fullsized":"2023-07-13T14:21:28.510184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:21:28.510107+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:21:28.510107+0000","last_clean_scrub_stamp":"2023-07-13T14:21:28.510107+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:19:37.793987+0000","scrub_duration":0.022328363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"31'33","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.527797+0000","last_change":"2023-07-13T14:21:04.527845+0000","last_active":"2023-07-13T14:21:04.527797+0000","last_peered":"2023-07-13T14:21:04.527797+0000","last_clean":"2023-07-13T14:21:04.527797+0000","last_became_active":"2023-07-13T13:52:17.941918+0000","last_became_peered":"2023-07-13T13:52:17.941918+0000","last_unstale":"2023-07-13T14:21:04.527797+0000","last_undegraded":"2023-07-13T14:21:04.527797+0000","last_fullsized":"2023-07-13T14:21:04.527797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:21:04.527716+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:21:04.527716+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.527716+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:49:58.363654+0000","scrub_duration":0.021725926,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.797179+0000","last_change":"2023-07-13T14:21:15.797275+0000","last_active":"2023-07-13T14:21:15.797179+0000","last_peered":"2023-07-13T14:21:15.797179+0000","last_clean":"2023-07-13T14:21:15.797179+0000","last_became_active":"2023-07-13T13:52:17.887901+0000","last_became_peered":"2023-07-13T13:52:17.887901+0000","last_unstale":"2023-07-13T14:21:15.797179+0000","last_undegraded":"2023-07-13T14:21:15.797179+0000","last_fullsized":"2023-07-13T14:21:15.797179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:21:15.797014+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:21:15.797014+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.797014+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:54:14.772881+0000","scrub_duration":0.026240900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"31'42","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.423055+0000","last_change":"2023-07-13T14:20:43.423153+0000","last_active":"2023-07-13T14:20:43.423055+0000","last_peered":"2023-07-13T14:20:43.423055+0000","last_clean":"2023-07-13T14:20:43.423055+0000","last_became_active":"2023-07-13T13:52:17.942055+0000","last_became_peered":"2023-07-13T13:52:17.942055+0000","last_unstale":"2023-07-13T14:20:43.423055+0000","last_undegraded":"2023-07-13T14:20:43.423055+0000","last_fullsized":"2023-07-13T14:20:43.423055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:20:43.422890+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:20:43.422890+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.422890+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:18.209416+0000","scrub_duration":0.021729281999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.700259+0000","last_change":"2023-07-13T14:20:52.700259+0000","last_active":"2023-07-13T14:20:52.700259+0000","last_peered":"2023-07-13T14:20:52.700259+0000","last_clean":"2023-07-13T14:20:52.700259+0000","last_became_active":"2023-07-13T13:52:17.934752+0000","last_became_peered":"2023-07-13T13:52:17.934752+0000","last_unstale":"2023-07-13T14:20:52.700259+0000","last_undegraded":"2023-07-13T14:20:52.700259+0000","last_fullsized":"2023-07-13T14:20:52.700259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:52.700065+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:52.700065+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.700065+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:50:47.705198+0000","scrub_duration":0.018490046999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"31'36","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:44.593534+0000","last_change":"2023-07-13T14:21:44.593580+0000","last_active":"2023-07-13T14:21:44.593534+0000","last_peered":"2023-07-13T14:21:44.593534+0000","last_clean":"2023-07-13T14:21:44.593534+0000","last_became_active":"2023-07-13T13:52:17.946817+0000","last_became_peered":"2023-07-13T13:52:17.946817+0000","last_unstale":"2023-07-13T14:21:44.593534+0000","last_undegraded":"2023-07-13T14:21:44.593534+0000","last_fullsized":"2023-07-13T14:21:44.593534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:21:44.593441+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:21:44.593441+0000","last_clean_scrub_stamp":"2023-07-13T14:21:44.593441+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:49:01.629493+0000","scrub_duration":0.021685374,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"31'46","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.508160+0000","last_change":"2023-07-13T14:21:20.508160+0000","last_active":"2023-07-13T14:21:20.508160+0000","last_peered":"2023-07-13T14:21:20.508160+0000","last_clean":"2023-07-13T14:21:20.508160+0000","last_became_active":"2023-07-13T13:52:17.839351+0000","last_became_peered":"2023-07-13T13:52:17.839351+0000","last_unstale":"2023-07-13T14:21:20.508160+0000","last_undegraded":"2023-07-13T14:21:20.508160+0000","last_fullsized":"2023-07-13T14:21:20.508160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2023-07-13T14:21:20.507957+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2023-07-13T14:21:20.507957+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.507957+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:27.331400+0000","scrub_duration":0.022308759000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"31'34","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:13.808172+0000","last_change":"2023-07-13T14:21:13.808172+0000","last_active":"2023-07-13T14:21:13.808172+0000","last_peered":"2023-07-13T14:21:13.808172+0000","last_clean":"2023-07-13T14:21:13.808172+0000","last_became_active":"2023-07-13T13:52:17.952325+0000","last_became_peered":"2023-07-13T13:52:17.952325+0000","last_unstale":"2023-07-13T14:21:13.808172+0000","last_undegraded":"2023-07-13T14:21:13.808172+0000","last_fullsized":"2023-07-13T14:21:13.808172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'34","last_scrub_stamp":"2023-07-13T14:21:13.808022+0000","last_deep_scrub":"31'34","last_deep_scrub_stamp":"2023-07-13T14:21:13.808022+0000","last_clean_scrub_stamp":"2023-07-13T14:21:13.808022+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:48.923447+0000","scrub_duration":0.026269797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"31'37","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:27.378465+0000","last_change":"2023-07-13T14:21:27.378465+0000","last_active":"2023-07-13T14:21:27.378465+0000","last_peered":"2023-07-13T14:21:27.378465+0000","last_clean":"2023-07-13T14:21:27.378465+0000","last_became_active":"2023-07-13T13:52:17.885476+0000","last_became_peered":"2023-07-13T13:52:17.885476+0000","last_unstale":"2023-07-13T14:21:27.378465+0000","last_undegraded":"2023-07-13T14:21:27.378465+0000","last_fullsized":"2023-07-13T14:21:27.378465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:27.378345+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:27.378345+0000","last_clean_scrub_stamp":"2023-07-13T14:21:27.378345+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:53.140044+0000","scrub_duration":0.018693382000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"31'27","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.520935+0000","last_change":"2023-07-13T14:21:24.520982+0000","last_active":"2023-07-13T14:21:24.520935+0000","last_peered":"2023-07-13T14:21:24.520935+0000","last_clean":"2023-07-13T14:21:24.520935+0000","last_became_active":"2023-07-13T13:52:17.839368+0000","last_became_peered":"2023-07-13T13:52:17.839368+0000","last_unstale":"2023-07-13T14:21:24.520935+0000","last_undegraded":"2023-07-13T14:21:24.520935+0000","last_fullsized":"2023-07-13T14:21:24.520935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:24.520845+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:24.520845+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.520845+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:20:20.865660+0000","scrub_duration":0.022271132999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"31'27","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.315400+0000","last_change":"2023-07-13T14:20:43.315464+0000","last_active":"2023-07-13T14:20:43.315400+0000","last_peered":"2023-07-13T14:20:43.315400+0000","last_clean":"2023-07-13T14:20:43.315400+0000","last_became_active":"2023-07-13T13:52:17.951158+0000","last_became_peered":"2023-07-13T13:52:17.951158+0000","last_unstale":"2023-07-13T14:20:43.315400+0000","last_undegraded":"2023-07-13T14:20:43.315400+0000","last_fullsized":"2023-07-13T14:20:43.315400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:20:43.315283+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:20:43.315283+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.315283+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:20:32.602676+0000","scrub_duration":0.019068186000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"31'39","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.143444+0000","last_change":"2023-07-13T14:21:04.143551+0000","last_active":"2023-07-13T14:21:04.143444+0000","last_peered":"2023-07-13T14:21:04.143444+0000","last_clean":"2023-07-13T14:21:04.143444+0000","last_became_active":"2023-07-13T13:52:17.951294+0000","last_became_peered":"2023-07-13T13:52:17.951294+0000","last_unstale":"2023-07-13T14:21:04.143444+0000","last_undegraded":"2023-07-13T14:21:04.143444+0000","last_fullsized":"2023-07-13T14:21:04.143444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2023-07-13T14:21:04.143279+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2023-07-13T14:21:04.143279+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.143279+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:15:59.993894+0000","scrub_duration":0.019113529000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"31'23","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:36.094296+0000","last_change":"2023-07-13T14:21:36.094346+0000","last_active":"2023-07-13T14:21:36.094296+0000","last_peered":"2023-07-13T14:21:36.094296+0000","last_clean":"2023-07-13T14:21:36.094296+0000","last_became_active":"2023-07-13T13:52:17.838409+0000","last_became_peered":"2023-07-13T13:52:17.838409+0000","last_unstale":"2023-07-13T14:21:36.094296+0000","last_undegraded":"2023-07-13T14:21:36.094296+0000","last_fullsized":"2023-07-13T14:21:36.094296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'23","last_scrub_stamp":"2023-07-13T14:21:36.094207+0000","last_deep_scrub":"31'23","last_deep_scrub_stamp":"2023-07-13T14:21:36.094207+0000","last_clean_scrub_stamp":"2023-07-13T14:21:36.094207+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:48.921164+0000","scrub_duration":0.021343738000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"31'82","reported_seq":119,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:52.539557+0000","last_change":"2023-07-13T14:21:52.539630+0000","last_active":"2023-07-13T14:21:52.539557+0000","last_peered":"2023-07-13T14:21:52.539557+0000","last_clean":"2023-07-13T14:21:52.539557+0000","last_became_active":"2023-07-13T13:52:23.962858+0000","last_became_peered":"2023-07-13T13:52:23.962858+0000","last_unstale":"2023-07-13T14:21:52.539557+0000","last_undegraded":"2023-07-13T14:21:52.539557+0000","last_fullsized":"2023-07-13T14:21:52.539557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'82","last_scrub_stamp":"2023-07-13T14:21:52.539452+0000","last_deep_scrub":"31'82","last_deep_scrub_stamp":"2023-07-13T14:21:52.539452+0000","last_clean_scrub_stamp":"2023-07-13T14:21:52.539452+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:10:12.672724+0000","scrub_duration":0.021675010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":6322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"31'646","reported_seq":693,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:11.551318+0000","last_change":"2023-07-13T14:21:11.551370+0000","last_active":"2023-07-13T14:21:11.551318+0000","last_peered":"2023-07-13T14:21:11.551318+0000","last_clean":"2023-07-13T14:21:11.551318+0000","last_became_active":"2023-07-13T13:52:16.664262+0000","last_became_peered":"2023-07-13T13:52:16.664262+0000","last_unstale":"2023-07-13T14:21:11.551318+0000","last_undegraded":"2023-07-13T14:21:11.551318+0000","last_fullsized":"2023-07-13T14:21:11.551318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'646","last_scrub_stamp":"2023-07-13T14:21:11.551230+0000","last_deep_scrub":"31'646","last_deep_scrub_stamp":"2023-07-13T14:21:11.551230+0000","last_clean_scrub_stamp":"2023-07-13T14:21:11.551230+0000","objects_scrubbed":1,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:13:37.312929+0000","scrub_duration":0.060728402000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'42","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.145466+0000","last_change":"2023-07-13T14:20:51.145520+0000","last_active":"2023-07-13T14:20:51.145466+0000","last_peered":"2023-07-13T14:20:51.145466+0000","last_clean":"2023-07-13T14:20:51.145466+0000","last_became_active":"2023-07-13T13:52:17.948158+0000","last_became_peered":"2023-07-13T13:52:17.948158+0000","last_unstale":"2023-07-13T14:20:51.145466+0000","last_undegraded":"2023-07-13T14:20:51.145466+0000","last_fullsized":"2023-07-13T14:20:51.145466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:20:51.145400+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:20:51.145400+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.145400+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:47:22.361088+0000","scrub_duration":0.018685159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"31'125","reported_seq":165,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:01.236275+0000","last_change":"2023-07-13T14:21:01.236275+0000","last_active":"2023-07-13T14:21:01.236275+0000","last_peered":"2023-07-13T14:21:01.236275+0000","last_clean":"2023-07-13T14:21:01.236275+0000","last_became_active":"2023-07-13T13:52:23.984411+0000","last_became_peered":"2023-07-13T13:52:23.984411+0000","last_unstale":"2023-07-13T14:21:01.236275+0000","last_undegraded":"2023-07-13T14:21:01.236275+0000","last_fullsized":"2023-07-13T14:21:01.236275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'125","last_scrub_stamp":"2023-07-13T14:21:01.236103+0000","last_deep_scrub":"31'125","last_deep_scrub_stamp":"2023-07-13T14:21:01.236103+0000","last_clean_scrub_stamp":"2023-07-13T14:21:01.236103+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:12:45.305574+0000","scrub_duration":0.021819373999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":11569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.246199+0000","last_change":"2023-07-13T14:20:51.246199+0000","last_active":"2023-07-13T14:20:51.246199+0000","last_peered":"2023-07-13T14:20:51.246199+0000","last_clean":"2023-07-13T14:20:51.246199+0000","last_became_active":"2023-07-13T13:52:16.667537+0000","last_became_peered":"2023-07-13T13:52:16.667537+0000","last_unstale":"2023-07-13T14:20:51.246199+0000","last_undegraded":"2023-07-13T14:20:51.246199+0000","last_fullsized":"2023-07-13T14:20:51.246199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:20:51.246065+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:20:51.246065+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.246065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:13:11.350056+0000","scrub_duration":0.019069163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'20","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.772093+0000","last_change":"2023-07-13T14:21:17.772134+0000","last_active":"2023-07-13T14:21:17.772093+0000","last_peered":"2023-07-13T14:21:17.772093+0000","last_clean":"2023-07-13T14:21:17.772093+0000","last_became_active":"2023-07-13T13:52:17.886882+0000","last_became_peered":"2023-07-13T13:52:17.886882+0000","last_unstale":"2023-07-13T14:21:17.772093+0000","last_undegraded":"2023-07-13T14:21:17.772093+0000","last_fullsized":"2023-07-13T14:21:17.772093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'20","last_scrub_stamp":"2023-07-13T14:21:17.771947+0000","last_deep_scrub":"31'20","last_deep_scrub_stamp":"2023-07-13T14:21:17.771947+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.771947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:21:46.504818+0000","scrub_duration":0.026258467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"31'103","reported_seq":143,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:26.877408+0000","last_change":"2023-07-13T14:21:26.877482+0000","last_active":"2023-07-13T14:21:26.877408+0000","last_peered":"2023-07-13T14:21:26.877408+0000","last_clean":"2023-07-13T14:21:26.877408+0000","last_became_active":"2023-07-13T13:52:23.991222+0000","last_became_peered":"2023-07-13T13:52:23.991222+0000","last_unstale":"2023-07-13T14:21:26.877408+0000","last_undegraded":"2023-07-13T14:21:26.877408+0000","last_fullsized":"2023-07-13T14:21:26.877408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'103","last_scrub_stamp":"2023-07-13T14:21:26.877311+0000","last_deep_scrub":"31'103","last_deep_scrub_stamp":"2023-07-13T14:21:26.877311+0000","last_clean_scrub_stamp":"2023-07-13T14:21:26.877311+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:20:59.860554+0000","scrub_duration":0.026184144999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":8316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'5","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:00.291754+0000","last_change":"2023-07-13T14:21:00.291754+0000","last_active":"2023-07-13T14:21:00.291754+0000","last_peered":"2023-07-13T14:21:00.291754+0000","last_clean":"2023-07-13T14:21:00.291754+0000","last_became_active":"2023-07-13T13:52:16.607207+0000","last_became_peered":"2023-07-13T13:52:16.607207+0000","last_unstale":"2023-07-13T14:21:00.291754+0000","last_undegraded":"2023-07-13T14:21:00.291754+0000","last_fullsized":"2023-07-13T14:21:00.291754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:00.291634+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:00.291634+0000","last_clean_scrub_stamp":"2023-07-13T14:21:00.291634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:14:46.956921+0000","scrub_duration":0.018782136000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"31'33","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:54.429841+0000","last_change":"2023-07-13T14:20:54.429841+0000","last_active":"2023-07-13T14:20:54.429841+0000","last_peered":"2023-07-13T14:20:54.429841+0000","last_clean":"2023-07-13T14:20:54.429841+0000","last_became_active":"2023-07-13T13:52:17.934271+0000","last_became_peered":"2023-07-13T13:52:17.934271+0000","last_unstale":"2023-07-13T14:20:54.429841+0000","last_undegraded":"2023-07-13T14:20:54.429841+0000","last_fullsized":"2023-07-13T14:20:54.429841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:20:54.429670+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:20:54.429670+0000","last_clean_scrub_stamp":"2023-07-13T14:20:54.429670+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:42:05.035579+0000","scrub_duration":0.021817006999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"31'138","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.136451+0000","last_change":"2023-07-13T14:21:06.136507+0000","last_active":"2023-07-13T14:21:06.136451+0000","last_peered":"2023-07-13T14:21:06.136451+0000","last_clean":"2023-07-13T14:21:06.136451+0000","last_became_active":"2023-07-13T13:52:23.990735+0000","last_became_peered":"2023-07-13T13:52:23.990735+0000","last_unstale":"2023-07-13T14:21:06.136451+0000","last_undegraded":"2023-07-13T14:21:06.136451+0000","last_fullsized":"2023-07-13T14:21:06.136451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'138","last_scrub_stamp":"2023-07-13T14:21:06.136370+0000","last_deep_scrub":"31'138","last_deep_scrub_stamp":"2023-07-13T14:21:06.136370+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.136370+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:21:06.038112+0000","scrub_duration":0.021842811,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.826568+0000","last_change":"2023-07-13T14:20:55.826568+0000","last_active":"2023-07-13T14:20:55.826568+0000","last_peered":"2023-07-13T14:20:55.826568+0000","last_clean":"2023-07-13T14:20:55.826568+0000","last_became_active":"2023-07-13T13:52:16.668636+0000","last_became_peered":"2023-07-13T13:52:16.668636+0000","last_unstale":"2023-07-13T14:20:55.826568+0000","last_undegraded":"2023-07-13T14:20:55.826568+0000","last_fullsized":"2023-07-13T14:20:55.826568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:20:55.826367+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:20:55.826367+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.826367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:34:15.274393+0000","scrub_duration":0.026266379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'25","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.354725+0000","last_change":"2023-07-13T14:21:22.354769+0000","last_active":"2023-07-13T14:21:22.354725+0000","last_peered":"2023-07-13T14:21:22.354725+0000","last_clean":"2023-07-13T14:21:22.354725+0000","last_became_active":"2023-07-13T13:52:17.950547+0000","last_became_peered":"2023-07-13T13:52:17.950547+0000","last_unstale":"2023-07-13T14:21:22.354725+0000","last_undegraded":"2023-07-13T14:21:22.354725+0000","last_fullsized":"2023-07-13T14:21:22.354725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'25","last_scrub_stamp":"2023-07-13T14:21:22.354661+0000","last_deep_scrub":"31'25","last_deep_scrub_stamp":"2023-07-13T14:21:22.354661+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.354661+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:03:56.296165+0000","scrub_duration":0.018806537000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'89","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:35.445782+0000","last_change":"2023-07-13T14:21:35.445895+0000","last_active":"2023-07-13T14:21:35.445782+0000","last_peered":"2023-07-13T14:21:35.445782+0000","last_clean":"2023-07-13T14:21:35.445782+0000","last_became_active":"2023-07-13T13:52:23.975585+0000","last_became_peered":"2023-07-13T13:52:23.975585+0000","last_unstale":"2023-07-13T14:21:35.445782+0000","last_undegraded":"2023-07-13T14:21:35.445782+0000","last_fullsized":"2023-07-13T14:21:35.445782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'89","last_scrub_stamp":"2023-07-13T14:21:35.445663+0000","last_deep_scrub":"31'89","last_deep_scrub_stamp":"2023-07-13T14:21:35.445663+0000","last_clean_scrub_stamp":"2023-07-13T14:21:35.445663+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:50:29.281601+0000","scrub_duration":0.022346844000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":9189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"31'5","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.215028+0000","last_change":"2023-07-13T14:21:20.215066+0000","last_active":"2023-07-13T14:21:20.215028+0000","last_peered":"2023-07-13T14:21:20.215028+0000","last_clean":"2023-07-13T14:21:20.215028+0000","last_became_active":"2023-07-13T13:52:16.669882+0000","last_became_peered":"2023-07-13T13:52:16.669882+0000","last_unstale":"2023-07-13T14:21:20.215028+0000","last_undegraded":"2023-07-13T14:21:20.215028+0000","last_fullsized":"2023-07-13T14:21:20.215028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:20.214953+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:20.214953+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.214953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:15:17.818133+0000","scrub_duration":0.02134776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"31'28","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:33.424806+0000","last_change":"2023-07-13T14:21:33.424863+0000","last_active":"2023-07-13T14:21:33.424806+0000","last_peered":"2023-07-13T14:21:33.424806+0000","last_clean":"2023-07-13T14:21:33.424806+0000","last_became_active":"2023-07-13T13:52:17.838232+0000","last_became_peered":"2023-07-13T13:52:17.838232+0000","last_unstale":"2023-07-13T14:21:33.424806+0000","last_undegraded":"2023-07-13T14:21:33.424806+0000","last_fullsized":"2023-07-13T14:21:33.424806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:21:33.424567+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:21:33.424567+0000","last_clean_scrub_stamp":"2023-07-13T14:21:33.424567+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:20:54.648591+0000","scrub_duration":0.018805460999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"31'148","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:38.371285+0000","last_change":"2023-07-13T14:21:38.371390+0000","last_active":"2023-07-13T14:21:38.371285+0000","last_peered":"2023-07-13T14:21:38.371285+0000","last_clean":"2023-07-13T14:21:38.371285+0000","last_became_active":"2023-07-13T13:52:23.989179+0000","last_became_peered":"2023-07-13T13:52:23.989179+0000","last_unstale":"2023-07-13T14:21:38.371285+0000","last_undegraded":"2023-07-13T14:21:38.371285+0000","last_fullsized":"2023-07-13T14:21:38.371285+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'148","last_scrub_stamp":"2023-07-13T14:21:38.371168+0000","last_deep_scrub":"31'148","last_deep_scrub_stamp":"2023-07-13T14:21:38.371168+0000","last_clean_scrub_stamp":"2023-07-13T14:21:38.371168+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:26:08.774961+0000","scrub_duration":0.018748753,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":18843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"31'537","reported_seq":585,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.566013+0000","last_change":"2023-07-13T14:21:06.566013+0000","last_active":"2023-07-13T14:21:06.566013+0000","last_peered":"2023-07-13T14:21:06.566013+0000","last_clean":"2023-07-13T14:21:06.566013+0000","last_became_active":"2023-07-13T13:52:16.665072+0000","last_became_peered":"2023-07-13T13:52:16.665072+0000","last_unstale":"2023-07-13T14:21:06.566013+0000","last_undegraded":"2023-07-13T14:21:06.566013+0000","last_fullsized":"2023-07-13T14:21:06.566013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'537","last_scrub_stamp":"2023-07-13T14:21:06.565893+0000","last_deep_scrub":"31'537","last_deep_scrub_stamp":"2023-07-13T14:21:06.565893+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.565893+0000","objects_scrubbed":2,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:47:37.781581+0000","scrub_duration":0.031191707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"31'35","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:16.101485+0000","last_change":"2023-07-13T14:21:16.101562+0000","last_active":"2023-07-13T14:21:16.101485+0000","last_peered":"2023-07-13T14:21:16.101485+0000","last_clean":"2023-07-13T14:21:16.101485+0000","last_became_active":"2023-07-13T13:52:17.953956+0000","last_became_peered":"2023-07-13T13:52:17.953956+0000","last_unstale":"2023-07-13T14:21:16.101485+0000","last_undegraded":"2023-07-13T14:21:16.101485+0000","last_fullsized":"2023-07-13T14:21:16.101485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:21:16.101342+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:21:16.101342+0000","last_clean_scrub_stamp":"2023-07-13T14:21:16.101342+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:35:27.568107+0000","scrub_duration":0.019133585000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"31'132","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:25.086756+0000","last_change":"2023-07-13T14:21:25.086907+0000","last_active":"2023-07-13T14:21:25.086756+0000","last_peered":"2023-07-13T14:21:25.086756+0000","last_clean":"2023-07-13T14:21:25.086756+0000","last_became_active":"2023-07-13T13:52:23.992022+0000","last_became_peered":"2023-07-13T13:52:23.992022+0000","last_unstale":"2023-07-13T14:21:25.086756+0000","last_undegraded":"2023-07-13T14:21:25.086756+0000","last_fullsized":"2023-07-13T14:21:25.086756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'132","last_scrub_stamp":"2023-07-13T14:21:25.086576+0000","last_deep_scrub":"31'132","last_deep_scrub_stamp":"2023-07-13T14:21:25.086576+0000","last_clean_scrub_stamp":"2023-07-13T14:21:25.086576+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:21:53.819446+0000","scrub_duration":0.019060541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":15927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"31'849","reported_seq":897,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:19.596346+0000","last_change":"2023-07-13T14:21:19.596430+0000","last_active":"2023-07-13T14:21:19.596346+0000","last_peered":"2023-07-13T14:21:19.596346+0000","last_clean":"2023-07-13T14:21:19.596346+0000","last_became_active":"2023-07-13T13:52:16.662396+0000","last_became_peered":"2023-07-13T13:52:16.662396+0000","last_unstale":"2023-07-13T14:21:19.596346+0000","last_undegraded":"2023-07-13T14:21:19.596346+0000","last_fullsized":"2023-07-13T14:21:19.596346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'849","last_scrub_stamp":"2023-07-13T14:21:19.596255+0000","last_deep_scrub":"31'849","last_deep_scrub_stamp":"2023-07-13T14:21:19.596255+0000","last_clean_scrub_stamp":"2023-07-13T14:21:19.596255+0000","objects_scrubbed":4,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:38:48.253897+0000","scrub_duration":0.065532147999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":4550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"31'43","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:06.552757+0000","last_change":"2023-07-13T14:21:06.552817+0000","last_active":"2023-07-13T14:21:06.552757+0000","last_peered":"2023-07-13T14:21:06.552757+0000","last_clean":"2023-07-13T14:21:06.552757+0000","last_became_active":"2023-07-13T13:52:17.945945+0000","last_became_peered":"2023-07-13T13:52:17.945945+0000","last_unstale":"2023-07-13T14:21:06.552757+0000","last_undegraded":"2023-07-13T14:21:06.552757+0000","last_fullsized":"2023-07-13T14:21:06.552757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-07-13T14:21:06.552623+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-07-13T14:21:06.552623+0000","last_clean_scrub_stamp":"2023-07-13T14:21:06.552623+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:03:40.494128+0000","scrub_duration":0.021820767000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"31'113","reported_seq":151,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:51.112519+0000","last_change":"2023-07-13T14:21:51.112610+0000","last_active":"2023-07-13T14:21:51.112519+0000","last_peered":"2023-07-13T14:21:51.112519+0000","last_clean":"2023-07-13T14:21:51.112519+0000","last_became_active":"2023-07-13T13:52:23.997738+0000","last_became_peered":"2023-07-13T13:52:23.997738+0000","last_unstale":"2023-07-13T14:21:51.112519+0000","last_undegraded":"2023-07-13T14:21:51.112519+0000","last_fullsized":"2023-07-13T14:21:51.112519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'113","last_scrub_stamp":"2023-07-13T14:21:51.112426+0000","last_deep_scrub":"31'113","last_deep_scrub_stamp":"2023-07-13T14:21:51.112426+0000","last_clean_scrub_stamp":"2023-07-13T14:21:51.112426+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:11:14.147147+0000","scrub_duration":0.021353411999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":11208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"31'10","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:10.564980+0000","last_change":"2023-07-13T14:21:10.565038+0000","last_active":"2023-07-13T14:21:10.564980+0000","last_peered":"2023-07-13T14:21:10.564980+0000","last_clean":"2023-07-13T14:21:10.564980+0000","last_became_active":"2023-07-13T13:52:16.663362+0000","last_became_peered":"2023-07-13T13:52:16.663362+0000","last_unstale":"2023-07-13T14:21:10.564980+0000","last_undegraded":"2023-07-13T14:21:10.564980+0000","last_fullsized":"2023-07-13T14:21:10.564980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-07-13T14:21:10.564908+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-07-13T14:21:10.564908+0000","last_clean_scrub_stamp":"2023-07-13T14:21:10.564908+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:32.202876+0000","scrub_duration":0.031257395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'27","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:26.426145+0000","last_change":"2023-07-13T14:21:26.426225+0000","last_active":"2023-07-13T14:21:26.426145+0000","last_peered":"2023-07-13T14:21:26.426145+0000","last_clean":"2023-07-13T14:21:26.426145+0000","last_became_active":"2023-07-13T13:52:17.951500+0000","last_became_peered":"2023-07-13T13:52:17.951500+0000","last_unstale":"2023-07-13T14:21:26.426145+0000","last_undegraded":"2023-07-13T14:21:26.426145+0000","last_fullsized":"2023-07-13T14:21:26.426145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:26.426058+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:26.426058+0000","last_clean_scrub_stamp":"2023-07-13T14:21:26.426058+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:39.253015+0000","scrub_duration":0.018757216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"31'88","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:45.389930+0000","last_change":"2023-07-13T14:21:45.389992+0000","last_active":"2023-07-13T14:21:45.389930+0000","last_peered":"2023-07-13T14:21:45.389930+0000","last_clean":"2023-07-13T14:21:45.389930+0000","last_became_active":"2023-07-13T13:52:23.992681+0000","last_became_peered":"2023-07-13T13:52:23.992681+0000","last_unstale":"2023-07-13T14:21:45.389930+0000","last_undegraded":"2023-07-13T14:21:45.389930+0000","last_fullsized":"2023-07-13T14:21:45.389930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'88","last_scrub_stamp":"2023-07-13T14:21:45.389854+0000","last_deep_scrub":"31'88","last_deep_scrub_stamp":"2023-07-13T14:21:45.389854+0000","last_clean_scrub_stamp":"2023-07-13T14:21:45.389854+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:53:17.533634+0000","scrub_duration":0.018702909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":4323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.785349+0000","last_change":"2023-07-13T14:20:43.785391+0000","last_active":"2023-07-13T14:20:43.785349+0000","last_peered":"2023-07-13T14:20:43.785349+0000","last_clean":"2023-07-13T14:20:43.785349+0000","last_became_active":"2023-07-13T13:52:16.663096+0000","last_became_peered":"2023-07-13T13:52:16.663096+0000","last_unstale":"2023-07-13T14:20:43.785349+0000","last_undegraded":"2023-07-13T14:20:43.785349+0000","last_fullsized":"2023-07-13T14:20:43.785349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:20:43.785283+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:20:43.785283+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.785283+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:08:06.382987+0000","scrub_duration":0.026179840999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"31'29","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:34.152886+0000","last_change":"2023-07-13T14:21:34.152986+0000","last_active":"2023-07-13T14:21:34.152886+0000","last_peered":"2023-07-13T14:21:34.152886+0000","last_clean":"2023-07-13T14:21:34.152886+0000","last_became_active":"2023-07-13T13:52:17.842716+0000","last_became_peered":"2023-07-13T13:52:17.842716+0000","last_unstale":"2023-07-13T14:21:34.152886+0000","last_undegraded":"2023-07-13T14:21:34.152886+0000","last_fullsized":"2023-07-13T14:21:34.152886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:21:34.152718+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:21:34.152718+0000","last_clean_scrub_stamp":"2023-07-13T14:21:34.152718+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:41.753853+0000","scrub_duration":0.021409747999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"31'107","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:46.374189+0000","last_change":"2023-07-13T14:21:46.374247+0000","last_active":"2023-07-13T14:21:46.374189+0000","last_peered":"2023-07-13T14:21:46.374189+0000","last_clean":"2023-07-13T14:21:46.374189+0000","last_became_active":"2023-07-13T13:52:23.988655+0000","last_became_peered":"2023-07-13T13:52:23.988655+0000","last_unstale":"2023-07-13T14:21:46.374189+0000","last_undegraded":"2023-07-13T14:21:46.374189+0000","last_fullsized":"2023-07-13T14:21:46.374189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'107","last_scrub_stamp":"2023-07-13T14:21:46.374101+0000","last_deep_scrub":"31'107","last_deep_scrub_stamp":"2023-07-13T14:21:46.374101+0000","last_clean_scrub_stamp":"2023-07-13T14:21:46.374101+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:25:35.838418+0000","scrub_duration":0.018691466,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.470947+0000","last_change":"2023-07-13T14:21:14.470983+0000","last_active":"2023-07-13T14:21:14.470947+0000","last_peered":"2023-07-13T14:21:14.470947+0000","last_clean":"2023-07-13T14:21:14.470947+0000","last_became_active":"2023-07-13T13:52:16.664833+0000","last_became_peered":"2023-07-13T13:52:16.664833+0000","last_unstale":"2023-07-13T14:21:14.470947+0000","last_undegraded":"2023-07-13T14:21:14.470947+0000","last_fullsized":"2023-07-13T14:21:14.470947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:14.470809+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:14.470809+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.470809+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:50.802085+0000","scrub_duration":0.022385644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"31'37","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:19.866372+0000","last_change":"2023-07-13T14:21:19.866463+0000","last_active":"2023-07-13T14:21:19.866372+0000","last_peered":"2023-07-13T14:21:19.866372+0000","last_clean":"2023-07-13T14:21:19.866372+0000","last_became_active":"2023-07-13T13:52:17.887570+0000","last_became_peered":"2023-07-13T13:52:17.887570+0000","last_unstale":"2023-07-13T14:21:19.866372+0000","last_undegraded":"2023-07-13T14:21:19.866372+0000","last_fullsized":"2023-07-13T14:21:19.866372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:19.866258+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:19.866258+0000","last_clean_scrub_stamp":"2023-07-13T14:21:19.866258+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:15:25.513288+0000","scrub_duration":0.026200731000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"31'128","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:57.064430+0000","last_change":"2023-07-13T14:21:57.064510+0000","last_active":"2023-07-13T14:21:57.064430+0000","last_peered":"2023-07-13T14:21:57.064430+0000","last_clean":"2023-07-13T14:21:57.064430+0000","last_became_active":"2023-07-13T13:52:23.997102+0000","last_became_peered":"2023-07-13T13:52:23.997102+0000","last_unstale":"2023-07-13T14:21:57.064430+0000","last_undegraded":"2023-07-13T14:21:57.064430+0000","last_fullsized":"2023-07-13T14:21:57.064430+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-07-13T14:21:57.064334+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-07-13T14:21:57.064334+0000","last_clean_scrub_stamp":"2023-07-13T14:21:57.064334+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:25:46.528651+0000","scrub_duration":0.021272630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"31'18","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.559346+0000","last_change":"2023-07-13T14:20:48.559393+0000","last_active":"2023-07-13T14:20:48.559346+0000","last_peered":"2023-07-13T14:20:48.559346+0000","last_clean":"2023-07-13T14:20:48.559346+0000","last_became_active":"2023-07-13T13:52:16.692478+0000","last_became_peered":"2023-07-13T13:52:16.692478+0000","last_unstale":"2023-07-13T14:20:48.559346+0000","last_undegraded":"2023-07-13T14:20:48.559346+0000","last_fullsized":"2023-07-13T14:20:48.559346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'18","last_scrub_stamp":"2023-07-13T14:20:48.559269+0000","last_deep_scrub":"31'18","last_deep_scrub_stamp":"2023-07-13T14:20:48.559269+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.559269+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:31:48.936886+0000","scrub_duration":0.030617008000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"31'32","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:43.214449+0000","last_change":"2023-07-13T14:20:43.214449+0000","last_active":"2023-07-13T14:20:43.214449+0000","last_peered":"2023-07-13T14:20:43.214449+0000","last_clean":"2023-07-13T14:20:43.214449+0000","last_became_active":"2023-07-13T13:52:17.838154+0000","last_became_peered":"2023-07-13T13:52:17.838154+0000","last_unstale":"2023-07-13T14:20:43.214449+0000","last_undegraded":"2023-07-13T14:20:43.214449+0000","last_fullsized":"2023-07-13T14:20:43.214449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:43.214310+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:43.214310+0000","last_clean_scrub_stamp":"2023-07-13T14:20:43.214310+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:41:53.548341+0000","scrub_duration":0.018645834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"31'122","reported_seq":161,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:41.414126+0000","last_change":"2023-07-13T14:21:41.414192+0000","last_active":"2023-07-13T14:21:41.414126+0000","last_peered":"2023-07-13T14:21:41.414126+0000","last_clean":"2023-07-13T14:21:41.414126+0000","last_became_active":"2023-07-13T13:52:23.977197+0000","last_became_peered":"2023-07-13T13:52:23.977197+0000","last_unstale":"2023-07-13T14:21:41.414126+0000","last_undegraded":"2023-07-13T14:21:41.414126+0000","last_fullsized":"2023-07-13T14:21:41.414126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'122","last_scrub_stamp":"2023-07-13T14:21:41.414052+0000","last_deep_scrub":"31'122","last_deep_scrub_stamp":"2023-07-13T14:21:41.414052+0000","last_clean_scrub_stamp":"2023-07-13T14:21:41.414052+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:54.241009+0000","scrub_duration":0.022284814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.629275+0000","last_change":"2023-07-13T14:20:48.629275+0000","last_active":"2023-07-13T14:20:48.629275+0000","last_peered":"2023-07-13T14:20:48.629275+0000","last_clean":"2023-07-13T14:20:48.629275+0000","last_became_active":"2023-07-13T13:52:16.665590+0000","last_became_peered":"2023-07-13T13:52:16.665590+0000","last_unstale":"2023-07-13T14:20:48.629275+0000","last_undegraded":"2023-07-13T14:20:48.629275+0000","last_fullsized":"2023-07-13T14:20:48.629275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:20:48.629154+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:20:48.629154+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.629154+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:08:43.034204+0000","scrub_duration":0.031242654000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"31'31","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:46.079615+0000","last_change":"2023-07-13T14:20:46.079652+0000","last_active":"2023-07-13T14:20:46.079615+0000","last_peered":"2023-07-13T14:20:46.079615+0000","last_clean":"2023-07-13T14:20:46.079615+0000","last_became_active":"2023-07-13T13:52:17.838174+0000","last_became_peered":"2023-07-13T13:52:17.838174+0000","last_unstale":"2023-07-13T14:20:46.079615+0000","last_undegraded":"2023-07-13T14:20:46.079615+0000","last_fullsized":"2023-07-13T14:20:46.079615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:20:46.079455+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:20:46.079455+0000","last_clean_scrub_stamp":"2023-07-13T14:20:46.079455+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:36:54.890046+0000","scrub_duration":0.021429993000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"31'99","reported_seq":138,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:00.640773+0000","last_change":"2023-07-13T14:21:00.640860+0000","last_active":"2023-07-13T14:21:00.640773+0000","last_peered":"2023-07-13T14:21:00.640773+0000","last_clean":"2023-07-13T14:21:00.640773+0000","last_became_active":"2023-07-13T13:52:23.992701+0000","last_became_peered":"2023-07-13T13:52:23.992701+0000","last_unstale":"2023-07-13T14:21:00.640773+0000","last_undegraded":"2023-07-13T14:21:00.640773+0000","last_fullsized":"2023-07-13T14:21:00.640773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'99","last_scrub_stamp":"2023-07-13T14:21:00.640670+0000","last_deep_scrub":"31'99","last_deep_scrub_stamp":"2023-07-13T14:21:00.640670+0000","last_clean_scrub_stamp":"2023-07-13T14:21:00.640670+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:26:32.984986+0000","scrub_duration":0.018598401000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:12.485227+0000","last_change":"2023-07-13T14:21:12.485227+0000","last_active":"2023-07-13T14:21:12.485227+0000","last_peered":"2023-07-13T14:21:12.485227+0000","last_clean":"2023-07-13T14:21:12.485227+0000","last_became_active":"2023-07-13T13:52:16.664969+0000","last_became_peered":"2023-07-13T13:52:16.664969+0000","last_unstale":"2023-07-13T14:21:12.485227+0000","last_undegraded":"2023-07-13T14:21:12.485227+0000","last_fullsized":"2023-07-13T14:21:12.485227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-07-13T14:21:12.485090+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-07-13T14:21:12.485090+0000","last_clean_scrub_stamp":"2023-07-13T14:21:12.485090+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:36:08.834249+0000","scrub_duration":0.031224683,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"31'27","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.539150+0000","last_change":"2023-07-13T14:21:08.539193+0000","last_active":"2023-07-13T14:21:08.539150+0000","last_peered":"2023-07-13T14:21:08.539150+0000","last_clean":"2023-07-13T14:21:08.539150+0000","last_became_active":"2023-07-13T13:52:17.955567+0000","last_became_peered":"2023-07-13T13:52:17.955567+0000","last_unstale":"2023-07-13T14:21:08.539150+0000","last_undegraded":"2023-07-13T14:21:08.539150+0000","last_fullsized":"2023-07-13T14:21:08.539150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:21:08.539028+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:21:08.539028+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.539028+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:16.140163+0000","scrub_duration":0.021778479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"31'154","reported_seq":193,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.713847+0000","last_change":"2023-07-13T14:20:55.713847+0000","last_active":"2023-07-13T14:20:55.713847+0000","last_peered":"2023-07-13T14:20:55.713847+0000","last_clean":"2023-07-13T14:20:55.713847+0000","last_became_active":"2023-07-13T13:52:23.991720+0000","last_became_peered":"2023-07-13T13:52:23.991720+0000","last_unstale":"2023-07-13T14:20:55.713847+0000","last_undegraded":"2023-07-13T14:20:55.713847+0000","last_fullsized":"2023-07-13T14:20:55.713847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'154","last_scrub_stamp":"2023-07-13T14:20:55.713721+0000","last_deep_scrub":"31'154","last_deep_scrub_stamp":"2023-07-13T14:20:55.713721+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.713721+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:03:36.441089+0000","scrub_duration":0.018574487000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":8133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.481788+0000","last_change":"2023-07-13T14:21:15.481788+0000","last_active":"2023-07-13T14:21:15.481788+0000","last_peered":"2023-07-13T14:21:15.481788+0000","last_clean":"2023-07-13T14:21:15.481788+0000","last_became_active":"2023-07-13T13:52:16.668988+0000","last_became_peered":"2023-07-13T13:52:16.668988+0000","last_unstale":"2023-07-13T14:21:15.481788+0000","last_undegraded":"2023-07-13T14:21:15.481788+0000","last_fullsized":"2023-07-13T14:21:15.481788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:15.481684+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:15.481684+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.481684+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:15:02.146971+0000","scrub_duration":0.031206836000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"31'24","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.273574+0000","last_change":"2023-07-13T14:20:59.273634+0000","last_active":"2023-07-13T14:20:59.273574+0000","last_peered":"2023-07-13T14:20:59.273574+0000","last_clean":"2023-07-13T14:20:59.273574+0000","last_became_active":"2023-07-13T13:52:17.951900+0000","last_became_peered":"2023-07-13T13:52:17.951900+0000","last_unstale":"2023-07-13T14:20:59.273574+0000","last_undegraded":"2023-07-13T14:20:59.273574+0000","last_fullsized":"2023-07-13T14:20:59.273574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2023-07-13T14:20:59.273490+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2023-07-13T14:20:59.273490+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.273490+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:09:45.879482+0000","scrub_duration":0.021897019,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"31'113","reported_seq":152,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:03.664593+0000","last_change":"2023-07-13T14:21:03.664668+0000","last_active":"2023-07-13T14:21:03.664593+0000","last_peered":"2023-07-13T14:21:03.664593+0000","last_clean":"2023-07-13T14:21:03.664593+0000","last_became_active":"2023-07-13T13:52:23.981539+0000","last_became_peered":"2023-07-13T13:52:23.981539+0000","last_unstale":"2023-07-13T14:21:03.664593+0000","last_undegraded":"2023-07-13T14:21:03.664593+0000","last_fullsized":"2023-07-13T14:21:03.664593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'113","last_scrub_stamp":"2023-07-13T14:21:03.664506+0000","last_deep_scrub":"31'113","last_deep_scrub_stamp":"2023-07-13T14:21:03.664506+0000","last_clean_scrub_stamp":"2023-07-13T14:21:03.664506+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:06:43.199058+0000","scrub_duration":0.018497283999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'3","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:30.210083+0000","last_change":"2023-07-13T14:21:30.210083+0000","last_active":"2023-07-13T14:21:30.210083+0000","last_peered":"2023-07-13T14:21:30.210083+0000","last_clean":"2023-07-13T14:21:30.210083+0000","last_became_active":"2023-07-13T13:52:16.667599+0000","last_became_peered":"2023-07-13T13:52:16.667599+0000","last_unstale":"2023-07-13T14:21:30.210083+0000","last_undegraded":"2023-07-13T14:21:30.210083+0000","last_fullsized":"2023-07-13T14:21:30.210083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-07-13T14:21:30.209764+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-07-13T14:21:30.209764+0000","last_clean_scrub_stamp":"2023-07-13T14:21:30.209764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:50:24.045701+0000","scrub_duration":0.021434170999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"31'32","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:40.804835+0000","last_change":"2023-07-13T14:20:40.804835+0000","last_active":"2023-07-13T14:20:40.804835+0000","last_peered":"2023-07-13T14:20:40.804835+0000","last_clean":"2023-07-13T14:20:40.804835+0000","last_became_active":"2023-07-13T13:52:17.952091+0000","last_became_peered":"2023-07-13T13:52:17.952091+0000","last_unstale":"2023-07-13T14:20:40.804835+0000","last_undegraded":"2023-07-13T14:20:40.804835+0000","last_fullsized":"2023-07-13T14:20:40.804835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'32","last_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_deep_scrub":"31'32","last_deep_scrub_stamp":"2023-07-13T14:20:40.804640+0000","last_clean_scrub_stamp":"2023-07-13T14:20:40.804640+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:48:21.603330+0000","scrub_duration":0.026215853000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"31'94","reported_seq":133,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.659758+0000","last_change":"2023-07-13T14:20:59.659758+0000","last_active":"2023-07-13T14:20:59.659758+0000","last_peered":"2023-07-13T14:20:59.659758+0000","last_clean":"2023-07-13T14:20:59.659758+0000","last_became_active":"2023-07-13T13:52:23.986907+0000","last_became_peered":"2023-07-13T13:52:23.986907+0000","last_unstale":"2023-07-13T14:20:59.659758+0000","last_undegraded":"2023-07-13T14:20:59.659758+0000","last_fullsized":"2023-07-13T14:20:59.659758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'94","last_scrub_stamp":"2023-07-13T14:20:59.659593+0000","last_deep_scrub":"31'94","last_deep_scrub_stamp":"2023-07-13T14:20:59.659593+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.659593+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:03:44.402498+0000","scrub_duration":0.018527055000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"31'582","reported_seq":631,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.321647+0000","last_change":"2023-07-13T14:20:59.321647+0000","last_active":"2023-07-13T14:20:59.321647+0000","last_peered":"2023-07-13T14:20:59.321647+0000","last_clean":"2023-07-13T14:20:59.321647+0000","last_became_active":"2023-07-13T13:52:16.607115+0000","last_became_peered":"2023-07-13T13:52:16.607115+0000","last_unstale":"2023-07-13T14:20:59.321647+0000","last_undegraded":"2023-07-13T14:20:59.321647+0000","last_fullsized":"2023-07-13T14:20:59.321647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'582","last_scrub_stamp":"2023-07-13T14:20:59.321528+0000","last_deep_scrub":"31'582","last_deep_scrub_stamp":"2023-07-13T14:20:59.321528+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.321528+0000","objects_scrubbed":2,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:35.652804+0000","scrub_duration":0.066498466000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"31'30","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:43.621408+0000","last_change":"2023-07-13T14:21:43.621490+0000","last_active":"2023-07-13T14:21:43.621408+0000","last_peered":"2023-07-13T14:21:43.621408+0000","last_clean":"2023-07-13T14:21:43.621408+0000","last_became_active":"2023-07-13T13:52:17.942588+0000","last_became_peered":"2023-07-13T13:52:17.942588+0000","last_unstale":"2023-07-13T14:21:43.621408+0000","last_undegraded":"2023-07-13T14:21:43.621408+0000","last_fullsized":"2023-07-13T14:21:43.621408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:43.621219+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:43.621219+0000","last_clean_scrub_stamp":"2023-07-13T14:21:43.621219+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:23:25.969413+0000","scrub_duration":0.021831811999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'157","reported_seq":196,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:23.143800+0000","last_change":"2023-07-13T14:21:23.143800+0000","last_active":"2023-07-13T14:21:23.143800+0000","last_peered":"2023-07-13T14:21:23.143800+0000","last_clean":"2023-07-13T14:21:23.143800+0000","last_became_active":"2023-07-13T13:52:23.996096+0000","last_became_peered":"2023-07-13T13:52:23.996096+0000","last_unstale":"2023-07-13T14:21:23.143800+0000","last_undegraded":"2023-07-13T14:21:23.143800+0000","last_fullsized":"2023-07-13T14:21:23.143800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'157","last_scrub_stamp":"2023-07-13T14:21:23.143535+0000","last_deep_scrub":"31'157","last_deep_scrub_stamp":"2023-07-13T14:21:23.143535+0000","last_clean_scrub_stamp":"2023-07-13T14:21:23.143535+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:54:22.119402+0000","scrub_duration":0.019107764999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":13657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.537406+0000","last_change":"2023-07-13T14:20:47.537449+0000","last_active":"2023-07-13T14:20:47.537406+0000","last_peered":"2023-07-13T14:20:47.537406+0000","last_clean":"2023-07-13T14:20:47.537406+0000","last_became_active":"2023-07-13T13:52:16.692623+0000","last_became_peered":"2023-07-13T13:52:16.692623+0000","last_unstale":"2023-07-13T14:20:47.537406+0000","last_undegraded":"2023-07-13T14:20:47.537406+0000","last_fullsized":"2023-07-13T14:20:47.537406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-07-13T14:20:47.537321+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-07-13T14:20:47.537321+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.537321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:28:54.435486+0000","scrub_duration":0.021817349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"31'28","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:48.552823+0000","last_change":"2023-07-13T14:20:48.552823+0000","last_active":"2023-07-13T14:20:48.552823+0000","last_peered":"2023-07-13T14:20:48.552823+0000","last_clean":"2023-07-13T14:20:48.552823+0000","last_became_active":"2023-07-13T13:52:17.941904+0000","last_became_peered":"2023-07-13T13:52:17.941904+0000","last_unstale":"2023-07-13T14:20:48.552823+0000","last_undegraded":"2023-07-13T14:20:48.552823+0000","last_fullsized":"2023-07-13T14:20:48.552823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:20:48.552706+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:20:48.552706+0000","last_clean_scrub_stamp":"2023-07-13T14:20:48.552706+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:08:55.376149+0000","scrub_duration":0.021718227999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'108","reported_seq":147,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:43.125376+0000","last_change":"2023-07-13T14:21:43.125448+0000","last_active":"2023-07-13T14:21:43.125376+0000","last_peered":"2023-07-13T14:21:43.125376+0000","last_clean":"2023-07-13T14:21:43.125376+0000","last_became_active":"2023-07-13T13:52:23.987682+0000","last_became_peered":"2023-07-13T13:52:23.987682+0000","last_unstale":"2023-07-13T14:21:43.125376+0000","last_undegraded":"2023-07-13T14:21:43.125376+0000","last_fullsized":"2023-07-13T14:21:43.125376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'108","last_scrub_stamp":"2023-07-13T14:21:43.125287+0000","last_deep_scrub":"31'108","last_deep_scrub_stamp":"2023-07-13T14:21:43.125287+0000","last_clean_scrub_stamp":"2023-07-13T14:21:43.125287+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:21:04.349311+0000","scrub_duration":0.021296369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":8018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.584862+0000","last_change":"2023-07-13T14:21:22.584927+0000","last_active":"2023-07-13T14:21:22.584862+0000","last_peered":"2023-07-13T14:21:22.584862+0000","last_clean":"2023-07-13T14:21:22.584862+0000","last_became_active":"2023-07-13T13:52:16.632354+0000","last_became_peered":"2023-07-13T13:52:16.632354+0000","last_unstale":"2023-07-13T14:21:22.584862+0000","last_undegraded":"2023-07-13T14:21:22.584862+0000","last_fullsized":"2023-07-13T14:21:22.584862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-07-13T14:21:22.584760+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-07-13T14:21:22.584760+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.584760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:25:52.988554+0000","scrub_duration":0.021702089000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"31'17","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:32.550026+0000","last_change":"2023-07-13T14:21:32.550026+0000","last_active":"2023-07-13T14:21:32.550026+0000","last_peered":"2023-07-13T14:21:32.550026+0000","last_clean":"2023-07-13T14:21:32.550026+0000","last_became_active":"2023-07-13T13:52:17.945677+0000","last_became_peered":"2023-07-13T13:52:17.945677+0000","last_unstale":"2023-07-13T14:21:32.550026+0000","last_undegraded":"2023-07-13T14:21:32.550026+0000","last_fullsized":"2023-07-13T14:21:32.550026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'17","last_scrub_stamp":"2023-07-13T14:21:32.549866+0000","last_deep_scrub":"31'17","last_deep_scrub_stamp":"2023-07-13T14:21:32.549866+0000","last_clean_scrub_stamp":"2023-07-13T14:21:32.549866+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:54:56.396186+0000","scrub_duration":0.021730441999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"31'97","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:50.611140+0000","last_change":"2023-07-13T14:21:50.611224+0000","last_active":"2023-07-13T14:21:50.611140+0000","last_peered":"2023-07-13T14:21:50.611140+0000","last_clean":"2023-07-13T14:21:50.611140+0000","last_became_active":"2023-07-13T13:52:23.987019+0000","last_became_peered":"2023-07-13T13:52:23.987019+0000","last_unstale":"2023-07-13T14:21:50.611140+0000","last_undegraded":"2023-07-13T14:21:50.611140+0000","last_fullsized":"2023-07-13T14:21:50.611140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'97","last_scrub_stamp":"2023-07-13T14:21:50.611035+0000","last_deep_scrub":"31'97","last_deep_scrub_stamp":"2023-07-13T14:21:50.611035+0000","last_clean_scrub_stamp":"2023-07-13T14:21:50.611035+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:05:57.041838+0000","scrub_duration":0.021795269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:13.404244+0000","last_change":"2023-07-13T14:21:13.404287+0000","last_active":"2023-07-13T14:21:13.404244+0000","last_peered":"2023-07-13T14:21:13.404244+0000","last_clean":"2023-07-13T14:21:13.404244+0000","last_became_active":"2023-07-13T13:52:16.664743+0000","last_became_peered":"2023-07-13T13:52:16.664743+0000","last_unstale":"2023-07-13T14:21:13.404244+0000","last_undegraded":"2023-07-13T14:21:13.404244+0000","last_fullsized":"2023-07-13T14:21:13.404244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-07-13T14:21:13.404167+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-07-13T14:21:13.404167+0000","last_clean_scrub_stamp":"2023-07-13T14:21:13.404167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:19:22.688047+0000","scrub_duration":0.018715822999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:01.167106+0000","last_change":"2023-07-13T14:21:01.167106+0000","last_active":"2023-07-13T14:21:01.167106+0000","last_peered":"2023-07-13T14:21:01.167106+0000","last_clean":"2023-07-13T14:21:01.167106+0000","last_became_active":"2023-07-13T13:52:17.949302+0000","last_became_peered":"2023-07-13T13:52:17.949302+0000","last_unstale":"2023-07-13T14:21:01.167106+0000","last_undegraded":"2023-07-13T14:21:01.167106+0000","last_fullsized":"2023-07-13T14:21:01.167106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:01.166959+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:01.166959+0000","last_clean_scrub_stamp":"2023-07-13T14:21:01.166959+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:55.302665+0000","scrub_duration":0.019059868000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"31'114","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:23.861964+0000","last_change":"2023-07-13T14:21:23.861964+0000","last_active":"2023-07-13T14:21:23.861964+0000","last_peered":"2023-07-13T14:21:23.861964+0000","last_clean":"2023-07-13T14:21:23.861964+0000","last_became_active":"2023-07-13T13:52:23.991543+0000","last_became_peered":"2023-07-13T13:52:23.991543+0000","last_unstale":"2023-07-13T14:21:23.861964+0000","last_undegraded":"2023-07-13T14:21:23.861964+0000","last_fullsized":"2023-07-13T14:21:23.861964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'114","last_scrub_stamp":"2023-07-13T14:21:23.861696+0000","last_deep_scrub":"31'114","last_deep_scrub_stamp":"2023-07-13T14:21:23.861696+0000","last_clean_scrub_stamp":"2023-07-13T14:21:23.861696+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:53:14.235446+0000","scrub_duration":0.026254771999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":10023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.250142+0000","last_change":"2023-07-13T14:20:47.250142+0000","last_active":"2023-07-13T14:20:47.250142+0000","last_peered":"2023-07-13T14:20:47.250142+0000","last_clean":"2023-07-13T14:20:47.250142+0000","last_became_active":"2023-07-13T13:51:59.915568+0000","last_became_peered":"2023-07-13T13:51:59.915568+0000","last_unstale":"2023-07-13T14:20:47.250142+0000","last_undegraded":"2023-07-13T14:20:47.250142+0000","last_fullsized":"2023-07-13T14:20:47.250142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:47.250012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:47.250012+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.250012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:52.091091+0000","scrub_duration":0.019134366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'2","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:11.180189+0000","last_change":"2023-07-13T14:21:11.180189+0000","last_active":"2023-07-13T14:21:11.180189+0000","last_peered":"2023-07-13T14:21:11.180189+0000","last_clean":"2023-07-13T14:21:11.180189+0000","last_became_active":"2023-07-13T13:52:16.668928+0000","last_became_peered":"2023-07-13T13:52:16.668928+0000","last_unstale":"2023-07-13T14:21:11.180189+0000","last_undegraded":"2023-07-13T14:21:11.180189+0000","last_fullsized":"2023-07-13T14:21:11.180189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-07-13T14:21:11.179942+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-07-13T14:21:11.179942+0000","last_clean_scrub_stamp":"2023-07-13T14:21:11.179942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:49.820915+0000","scrub_duration":0.021406162999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"31'29","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.076940+0000","last_change":"2023-07-13T14:21:15.076940+0000","last_active":"2023-07-13T14:21:15.076940+0000","last_peered":"2023-07-13T14:21:15.076940+0000","last_clean":"2023-07-13T14:21:15.076940+0000","last_became_active":"2023-07-13T13:52:17.951956+0000","last_became_peered":"2023-07-13T13:52:17.951956+0000","last_unstale":"2023-07-13T14:21:15.076940+0000","last_undegraded":"2023-07-13T14:21:15.076940+0000","last_fullsized":"2023-07-13T14:21:15.076940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:21:15.076823+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:21:15.076823+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.076823+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:33:22.436034+0000","scrub_duration":0.019056437999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"31'128","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.879246+0000","last_change":"2023-07-13T14:21:24.879246+0000","last_active":"2023-07-13T14:21:24.879246+0000","last_peered":"2023-07-13T14:21:24.879246+0000","last_clean":"2023-07-13T14:21:24.879246+0000","last_became_active":"2023-07-13T13:52:23.997488+0000","last_became_peered":"2023-07-13T13:52:23.997488+0000","last_unstale":"2023-07-13T14:21:24.879246+0000","last_undegraded":"2023-07-13T14:21:24.879246+0000","last_fullsized":"2023-07-13T14:21:24.879246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'128","last_scrub_stamp":"2023-07-13T14:21:24.879124+0000","last_deep_scrub":"31'128","last_deep_scrub_stamp":"2023-07-13T14:21:24.879124+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.879124+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:48:07.345233+0000","scrub_duration":0.026230526000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":10905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.171511+0000","last_change":"2023-07-13T14:21:08.171511+0000","last_active":"2023-07-13T14:21:08.171511+0000","last_peered":"2023-07-13T14:21:08.171511+0000","last_clean":"2023-07-13T14:21:08.171511+0000","last_became_active":"2023-07-13T13:51:59.772687+0000","last_became_peered":"2023-07-13T13:51:59.772687+0000","last_unstale":"2023-07-13T14:21:08.171511+0000","last_undegraded":"2023-07-13T14:21:08.171511+0000","last_fullsized":"2023-07-13T14:21:08.171511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:21:08.171304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:21:08.171304+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.171304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:59.908974+0000","scrub_duration":0.021390960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'4","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:17.532611+0000","last_change":"2023-07-13T14:21:17.532611+0000","last_active":"2023-07-13T14:21:17.532611+0000","last_peered":"2023-07-13T14:21:17.532611+0000","last_clean":"2023-07-13T14:21:17.532611+0000","last_became_active":"2023-07-13T13:52:16.630616+0000","last_became_peered":"2023-07-13T13:52:16.630616+0000","last_unstale":"2023-07-13T14:21:17.532611+0000","last_undegraded":"2023-07-13T14:21:17.532611+0000","last_fullsized":"2023-07-13T14:21:17.532611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:21:17.532465+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:21:17.532465+0000","last_clean_scrub_stamp":"2023-07-13T14:21:17.532465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:20:38.756488+0000","scrub_duration":0.021709974999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"31'27","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:59.148473+0000","last_change":"2023-07-13T14:20:59.148473+0000","last_active":"2023-07-13T14:20:59.148473+0000","last_peered":"2023-07-13T14:20:59.148473+0000","last_clean":"2023-07-13T14:20:59.148473+0000","last_became_active":"2023-07-13T13:52:17.947670+0000","last_became_peered":"2023-07-13T13:52:17.947670+0000","last_unstale":"2023-07-13T14:20:59.148473+0000","last_undegraded":"2023-07-13T14:20:59.148473+0000","last_fullsized":"2023-07-13T14:20:59.148473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'27","last_scrub_stamp":"2023-07-13T14:20:59.148355+0000","last_deep_scrub":"31'27","last_deep_scrub_stamp":"2023-07-13T14:20:59.148355+0000","last_clean_scrub_stamp":"2023-07-13T14:20:59.148355+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:16:31.674123+0000","scrub_duration":0.019042481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'124","reported_seq":163,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.583944+0000","last_change":"2023-07-13T14:21:08.584065+0000","last_active":"2023-07-13T14:21:08.583944+0000","last_peered":"2023-07-13T14:21:08.583944+0000","last_clean":"2023-07-13T14:21:08.583944+0000","last_became_active":"2023-07-13T13:52:23.988292+0000","last_became_peered":"2023-07-13T13:52:23.988292+0000","last_unstale":"2023-07-13T14:21:08.583944+0000","last_undegraded":"2023-07-13T14:21:08.583944+0000","last_fullsized":"2023-07-13T14:21:08.583944+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'124","last_scrub_stamp":"2023-07-13T14:21:08.583835+0000","last_deep_scrub":"31'124","last_deep_scrub_stamp":"2023-07-13T14:21:08.583835+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.583835+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:09:55.189827+0000","scrub_duration":0.018560810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":7562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:46.643875+0000","last_change":"2023-07-13T14:20:46.643875+0000","last_active":"2023-07-13T14:20:46.643875+0000","last_peered":"2023-07-13T14:20:46.643875+0000","last_clean":"2023-07-13T14:20:46.643875+0000","last_became_active":"2023-07-13T13:52:01.224406+0000","last_became_peered":"2023-07-13T13:52:01.224406+0000","last_unstale":"2023-07-13T14:20:46.643875+0000","last_undegraded":"2023-07-13T14:20:46.643875+0000","last_fullsized":"2023-07-13T14:20:46.643875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:46.643707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:46.643707+0000","last_clean_scrub_stamp":"2023-07-13T14:20:46.643707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:27:19.450339+0000","scrub_duration":0.018539291999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'185","reported_seq":233,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.217415+0000","last_change":"2023-07-13T14:20:52.217479+0000","last_active":"2023-07-13T14:20:52.217415+0000","last_peered":"2023-07-13T14:20:52.217415+0000","last_clean":"2023-07-13T14:20:52.217415+0000","last_became_active":"2023-07-13T13:52:16.667781+0000","last_became_peered":"2023-07-13T13:52:16.667781+0000","last_unstale":"2023-07-13T14:20:52.217415+0000","last_undegraded":"2023-07-13T14:20:52.217415+0000","last_fullsized":"2023-07-13T14:20:52.217415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'185","last_scrub_stamp":"2023-07-13T14:20:52.217273+0000","last_deep_scrub":"31'185","last_deep_scrub_stamp":"2023-07-13T14:20:52.217273+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.217273+0000","objects_scrubbed":1,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:08:14.814977+0000","scrub_duration":0.030479297999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1434466,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'31","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:03.181921+0000","last_change":"2023-07-13T14:21:03.181976+0000","last_active":"2023-07-13T14:21:03.181921+0000","last_peered":"2023-07-13T14:21:03.181921+0000","last_clean":"2023-07-13T14:21:03.181921+0000","last_became_active":"2023-07-13T13:52:17.951834+0000","last_became_peered":"2023-07-13T13:52:17.951834+0000","last_unstale":"2023-07-13T14:21:03.181921+0000","last_undegraded":"2023-07-13T14:21:03.181921+0000","last_fullsized":"2023-07-13T14:21:03.181921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2023-07-13T14:21:03.181750+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2023-07-13T14:21:03.181750+0000","last_clean_scrub_stamp":"2023-07-13T14:21:03.181750+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:34:22.629776+0000","scrub_duration":0.019039165,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'87","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:39.417867+0000","last_change":"2023-07-13T14:21:39.417944+0000","last_active":"2023-07-13T14:21:39.417867+0000","last_peered":"2023-07-13T14:21:39.417867+0000","last_clean":"2023-07-13T14:21:39.417867+0000","last_became_active":"2023-07-13T13:52:23.986755+0000","last_became_peered":"2023-07-13T13:52:23.986755+0000","last_unstale":"2023-07-13T14:21:39.417867+0000","last_undegraded":"2023-07-13T14:21:39.417867+0000","last_fullsized":"2023-07-13T14:21:39.417867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2023-07-13T14:21:39.417788+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2023-07-13T14:21:39.417788+0000","last_clean_scrub_stamp":"2023-07-13T14:21:39.417788+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:47.018922+0000","scrub_duration":0.022273528000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:04.225755+0000","last_change":"2023-07-13T14:21:04.225755+0000","last_active":"2023-07-13T14:21:04.225755+0000","last_peered":"2023-07-13T14:21:04.225755+0000","last_clean":"2023-07-13T14:21:04.225755+0000","last_became_active":"2023-07-13T13:51:59.921220+0000","last_became_peered":"2023-07-13T13:51:59.921220+0000","last_unstale":"2023-07-13T14:21:04.225755+0000","last_undegraded":"2023-07-13T14:21:04.225755+0000","last_fullsized":"2023-07-13T14:21:04.225755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:21:04.225469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:21:04.225469+0000","last_clean_scrub_stamp":"2023-07-13T14:21:04.225469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:25.863437+0000","scrub_duration":0.021427478999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.541461+0000","last_change":"2023-07-13T14:20:55.541461+0000","last_active":"2023-07-13T14:20:55.541461+0000","last_peered":"2023-07-13T14:20:55.541461+0000","last_clean":"2023-07-13T14:20:55.541461+0000","last_became_active":"2023-07-13T13:51:57.961922+0000","last_became_peered":"2023-07-13T13:51:57.961922+0000","last_unstale":"2023-07-13T14:20:55.541461+0000","last_undegraded":"2023-07-13T14:20:55.541461+0000","last_fullsized":"2023-07-13T14:20:55.541461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-07-13T14:20:55.541167+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-07-13T14:20:55.541167+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.541167+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:27:03.676791+0000","scrub_duration":0.031242277999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'1","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:02.326661+0000","last_change":"2023-07-13T14:21:02.326661+0000","last_active":"2023-07-13T14:21:02.326661+0000","last_peered":"2023-07-13T14:21:02.326661+0000","last_clean":"2023-07-13T14:21:02.326661+0000","last_became_active":"2023-07-13T13:52:16.667924+0000","last_became_peered":"2023-07-13T13:52:16.667924+0000","last_unstale":"2023-07-13T14:21:02.326661+0000","last_undegraded":"2023-07-13T14:21:02.326661+0000","last_fullsized":"2023-07-13T14:21:02.326661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-07-13T14:21:02.326478+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-07-13T14:21:02.326478+0000","last_clean_scrub_stamp":"2023-07-13T14:21:02.326478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:12:40.967451+0000","scrub_duration":0.018713678000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"31'29","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.398775+0000","last_change":"2023-07-13T14:20:55.398775+0000","last_active":"2023-07-13T14:20:55.398775+0000","last_peered":"2023-07-13T14:20:55.398775+0000","last_clean":"2023-07-13T14:20:55.398775+0000","last_became_active":"2023-07-13T13:52:17.942264+0000","last_became_peered":"2023-07-13T13:52:17.942264+0000","last_unstale":"2023-07-13T14:20:55.398775+0000","last_undegraded":"2023-07-13T14:20:55.398775+0000","last_fullsized":"2023-07-13T14:20:55.398775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:20:55.398507+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:20:55.398507+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.398507+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:34:38.158480+0000","scrub_duration":0.021835706999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"31'125","reported_seq":164,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:48.155694+0000","last_change":"2023-07-13T14:21:48.155808+0000","last_active":"2023-07-13T14:21:48.155694+0000","last_peered":"2023-07-13T14:21:48.155694+0000","last_clean":"2023-07-13T14:21:48.155694+0000","last_became_active":"2023-07-13T13:52:23.990825+0000","last_became_peered":"2023-07-13T13:52:23.990825+0000","last_unstale":"2023-07-13T14:21:48.155694+0000","last_undegraded":"2023-07-13T14:21:48.155694+0000","last_fullsized":"2023-07-13T14:21:48.155694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'125","last_scrub_stamp":"2023-07-13T14:21:48.155609+0000","last_deep_scrub":"31'125","last_deep_scrub_stamp":"2023-07-13T14:21:48.155609+0000","last_clean_scrub_stamp":"2023-07-13T14:21:48.155609+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:26:18.559403+0000","scrub_duration":0.021370196000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":6861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.532718+0000","last_change":"2023-07-13T14:20:57.532718+0000","last_active":"2023-07-13T14:20:57.532718+0000","last_peered":"2023-07-13T14:20:57.532718+0000","last_clean":"2023-07-13T14:20:57.532718+0000","last_became_active":"2023-07-13T13:52:00.016146+0000","last_became_peered":"2023-07-13T13:52:00.016146+0000","last_unstale":"2023-07-13T14:20:57.532718+0000","last_undegraded":"2023-07-13T14:20:57.532718+0000","last_fullsized":"2023-07-13T14:20:57.532718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:57.532508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:57.532508+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.532508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:33.635034+0000","scrub_duration":0.022295781000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"31'816","reported_seq":1673,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:52.872773+0000","last_change":"2023-07-13T14:20:52.872773+0000","last_active":"2023-07-13T14:20:52.872773+0000","last_peered":"2023-07-13T14:20:52.872773+0000","last_clean":"2023-07-13T14:20:52.872773+0000","last_became_active":"2023-07-13T13:52:16.630028+0000","last_became_peered":"2023-07-13T13:52:16.630028+0000","last_unstale":"2023-07-13T14:20:52.872773+0000","last_undegraded":"2023-07-13T14:20:52.872773+0000","last_fullsized":"2023-07-13T14:20:52.872773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'816","last_scrub_stamp":"2023-07-13T14:20:52.872671+0000","last_deep_scrub":"31'816","last_deep_scrub_stamp":"2023-07-13T14:20:52.872671+0000","last_clean_scrub_stamp":"2023-07-13T14:20:52.872671+0000","objects_scrubbed":1,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:35:47.008377+0000","scrub_duration":0.031418862999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174695,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":810,"num_write_kb":853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"31'38","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.880340+0000","last_change":"2023-07-13T14:21:20.880382+0000","last_active":"2023-07-13T14:21:20.880340+0000","last_peered":"2023-07-13T14:21:20.880340+0000","last_clean":"2023-07-13T14:21:20.880340+0000","last_became_active":"2023-07-13T13:52:17.949913+0000","last_became_peered":"2023-07-13T13:52:17.949913+0000","last_unstale":"2023-07-13T14:21:20.880340+0000","last_undegraded":"2023-07-13T14:21:20.880340+0000","last_fullsized":"2023-07-13T14:21:20.880340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'38","last_scrub_stamp":"2023-07-13T14:21:20.880256+0000","last_deep_scrub":"31'38","last_deep_scrub_stamp":"2023-07-13T14:21:20.880256+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.880256+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:27:33.886477+0000","scrub_duration":0.026224425999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"31'163","reported_seq":203,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:15.202326+0000","last_change":"2023-07-13T14:21:15.202326+0000","last_active":"2023-07-13T14:21:15.202326+0000","last_peered":"2023-07-13T14:21:15.202326+0000","last_clean":"2023-07-13T14:21:15.202326+0000","last_became_active":"2023-07-13T13:52:23.988890+0000","last_became_peered":"2023-07-13T13:52:23.988890+0000","last_unstale":"2023-07-13T14:21:15.202326+0000","last_undegraded":"2023-07-13T14:21:15.202326+0000","last_fullsized":"2023-07-13T14:21:15.202326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'163","last_scrub_stamp":"2023-07-13T14:21:15.202204+0000","last_deep_scrub":"31'163","last_deep_scrub_stamp":"2023-07-13T14:21:15.202204+0000","last_clean_scrub_stamp":"2023-07-13T14:21:15.202204+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:37:24.012794+0000","scrub_duration":0.021845495999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":7667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:58.535405+0000","last_change":"2023-07-13T14:20:58.535405+0000","last_active":"2023-07-13T14:20:58.535405+0000","last_peered":"2023-07-13T14:20:58.535405+0000","last_clean":"2023-07-13T14:20:58.535405+0000","last_became_active":"2023-07-13T13:52:00.019398+0000","last_became_peered":"2023-07-13T13:52:00.019398+0000","last_unstale":"2023-07-13T14:20:58.535405+0000","last_undegraded":"2023-07-13T14:20:58.535405+0000","last_fullsized":"2023-07-13T14:20:58.535405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:58.535275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:58.535275+0000","last_clean_scrub_stamp":"2023-07-13T14:20:58.535275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:42:08.869306+0000","scrub_duration":0.022332606000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:58.126314+0000","last_change":"2023-07-13T14:20:58.126314+0000","last_active":"2023-07-13T14:20:58.126314+0000","last_peered":"2023-07-13T14:20:58.126314+0000","last_clean":"2023-07-13T14:20:58.126314+0000","last_became_active":"2023-07-13T13:52:16.667975+0000","last_became_peered":"2023-07-13T13:52:16.667975+0000","last_unstale":"2023-07-13T14:20:58.126314+0000","last_undegraded":"2023-07-13T14:20:58.126314+0000","last_fullsized":"2023-07-13T14:20:58.126314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-07-13T14:20:58.126153+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-07-13T14:20:58.126153+0000","last_clean_scrub_stamp":"2023-07-13T14:20:58.126153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:56:38.869235+0000","scrub_duration":0.019046782000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"31'29","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:08.839289+0000","last_change":"2023-07-13T14:21:08.839289+0000","last_active":"2023-07-13T14:21:08.839289+0000","last_peered":"2023-07-13T14:21:08.839289+0000","last_clean":"2023-07-13T14:21:08.839289+0000","last_became_active":"2023-07-13T13:52:17.885218+0000","last_became_peered":"2023-07-13T13:52:17.885218+0000","last_unstale":"2023-07-13T14:21:08.839289+0000","last_undegraded":"2023-07-13T14:21:08.839289+0000","last_fullsized":"2023-07-13T14:21:08.839289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'29","last_scrub_stamp":"2023-07-13T14:21:08.839132+0000","last_deep_scrub":"31'29","last_deep_scrub_stamp":"2023-07-13T14:21:08.839132+0000","last_clean_scrub_stamp":"2023-07-13T14:21:08.839132+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T15:35:20.305896+0000","scrub_duration":0.02620055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"31'90","reported_seq":130,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:48.604528+0000","last_change":"2023-07-13T14:21:48.604668+0000","last_active":"2023-07-13T14:21:48.604528+0000","last_peered":"2023-07-13T14:21:48.604528+0000","last_clean":"2023-07-13T14:21:48.604528+0000","last_became_active":"2023-07-13T13:52:23.929474+0000","last_became_peered":"2023-07-13T13:52:23.929474+0000","last_unstale":"2023-07-13T14:21:48.604528+0000","last_undegraded":"2023-07-13T14:21:48.604528+0000","last_fullsized":"2023-07-13T14:21:48.604528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'90","last_scrub_stamp":"2023-07-13T14:21:48.604363+0000","last_deep_scrub":"31'90","last_deep_scrub_stamp":"2023-07-13T14:21:48.604363+0000","last_clean_scrub_stamp":"2023-07-13T14:21:48.604363+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:44:21.332576+0000","scrub_duration":0.021811073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"31'10","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:09.344291+0000","last_change":"2023-07-13T14:21:09.344334+0000","last_active":"2023-07-13T14:21:09.344291+0000","last_peered":"2023-07-13T14:21:09.344291+0000","last_clean":"2023-07-13T14:21:09.344291+0000","last_became_active":"2023-07-13T13:52:16.663328+0000","last_became_peered":"2023-07-13T13:52:16.663328+0000","last_unstale":"2023-07-13T14:21:09.344291+0000","last_undegraded":"2023-07-13T14:21:09.344291+0000","last_fullsized":"2023-07-13T14:21:09.344291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2023-07-13T14:21:09.344224+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2023-07-13T14:21:09.344224+0000","last_clean_scrub_stamp":"2023-07-13T14:21:09.344224+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:20:05.689039+0000","scrub_duration":0.026165491999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:44.296225+0000","last_change":"2023-07-13T14:20:44.296281+0000","last_active":"2023-07-13T14:20:44.296225+0000","last_peered":"2023-07-13T14:20:44.296225+0000","last_clean":"2023-07-13T14:20:44.296225+0000","last_became_active":"2023-07-13T13:51:59.757381+0000","last_became_peered":"2023-07-13T13:51:59.757381+0000","last_unstale":"2023-07-13T14:20:44.296225+0000","last_undegraded":"2023-07-13T14:20:44.296225+0000","last_fullsized":"2023-07-13T14:20:44.296225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:44.296110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:44.296110+0000","last_clean_scrub_stamp":"2023-07-13T14:20:44.296110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:40:36.078817+0000","scrub_duration":0.019097020999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"31'30","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:24.382223+0000","last_change":"2023-07-13T14:21:24.382263+0000","last_active":"2023-07-13T14:21:24.382223+0000","last_peered":"2023-07-13T14:21:24.382223+0000","last_clean":"2023-07-13T14:21:24.382223+0000","last_became_active":"2023-07-13T13:52:17.837982+0000","last_became_peered":"2023-07-13T13:52:17.837982+0000","last_unstale":"2023-07-13T14:21:24.382223+0000","last_undegraded":"2023-07-13T14:21:24.382223+0000","last_fullsized":"2023-07-13T14:21:24.382223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:24.382046+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:24.382046+0000","last_clean_scrub_stamp":"2023-07-13T14:21:24.382046+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:31.983181+0000","scrub_duration":0.018755054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"31'139","reported_seq":179,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:34.389909+0000","last_change":"2023-07-13T14:21:34.390009+0000","last_active":"2023-07-13T14:21:34.389909+0000","last_peered":"2023-07-13T14:21:34.389909+0000","last_clean":"2023-07-13T14:21:34.389909+0000","last_became_active":"2023-07-13T13:52:23.986636+0000","last_became_peered":"2023-07-13T13:52:23.986636+0000","last_unstale":"2023-07-13T14:21:34.389909+0000","last_undegraded":"2023-07-13T14:21:34.389909+0000","last_fullsized":"2023-07-13T14:21:34.389909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'139","last_scrub_stamp":"2023-07-13T14:21:34.389806+0000","last_deep_scrub":"31'139","last_deep_scrub_stamp":"2023-07-13T14:21:34.389806+0000","last_clean_scrub_stamp":"2023-07-13T14:21:34.389806+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T23:33:11.083589+0000","scrub_duration":0.018696449,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":9717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:45.540863+0000","last_change":"2023-07-13T14:20:45.540898+0000","last_active":"2023-07-13T14:20:45.540863+0000","last_peered":"2023-07-13T14:20:45.540863+0000","last_clean":"2023-07-13T14:20:45.540863+0000","last_became_active":"2023-07-13T13:52:00.015606+0000","last_became_peered":"2023-07-13T13:52:00.015606+0000","last_unstale":"2023-07-13T14:20:45.540863+0000","last_undegraded":"2023-07-13T14:20:45.540863+0000","last_fullsized":"2023-07-13T14:20:45.540863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-13T14:20:45.540787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-13T14:20:45.540787+0000","last_clean_scrub_stamp":"2023-07-13T14:20:45.540787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:13:04.071711+0000","scrub_duration":0.021879480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'315","reported_seq":362,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.857667+0000","last_change":"2023-07-13T14:20:57.857749+0000","last_active":"2023-07-13T14:20:57.857667+0000","last_peered":"2023-07-13T14:20:57.857667+0000","last_clean":"2023-07-13T14:20:57.857667+0000","last_became_active":"2023-07-13T13:52:16.664290+0000","last_became_peered":"2023-07-13T13:52:16.664290+0000","last_unstale":"2023-07-13T14:20:57.857667+0000","last_undegraded":"2023-07-13T14:20:57.857667+0000","last_fullsized":"2023-07-13T14:20:57.857667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'315","last_scrub_stamp":"2023-07-13T14:20:57.857551+0000","last_deep_scrub":"31'315","last_deep_scrub_stamp":"2023-07-13T14:20:57.857551+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.857551+0000","objects_scrubbed":1,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:28:59.718479+0000","scrub_duration":0.036700948999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":868,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"31'21","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:25.564162+0000","last_change":"2023-07-13T14:21:25.564162+0000","last_active":"2023-07-13T14:21:25.564162+0000","last_peered":"2023-07-13T14:21:25.564162+0000","last_clean":"2023-07-13T14:21:25.564162+0000","last_became_active":"2023-07-13T13:52:17.943736+0000","last_became_peered":"2023-07-13T13:52:17.943736+0000","last_unstale":"2023-07-13T14:21:25.564162+0000","last_undegraded":"2023-07-13T14:21:25.564162+0000","last_fullsized":"2023-07-13T14:21:25.564162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2023-07-13T14:21:25.564010+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2023-07-13T14:21:25.564010+0000","last_clean_scrub_stamp":"2023-07-13T14:21:25.564010+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:10:48.598731+0000","scrub_duration":0.021775233000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'134","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:21.148835+0000","last_change":"2023-07-13T14:21:21.148888+0000","last_active":"2023-07-13T14:21:21.148835+0000","last_peered":"2023-07-13T14:21:21.148835+0000","last_clean":"2023-07-13T14:21:21.148835+0000","last_became_active":"2023-07-13T13:52:23.986658+0000","last_became_peered":"2023-07-13T13:52:23.986658+0000","last_unstale":"2023-07-13T14:21:21.148835+0000","last_undegraded":"2023-07-13T14:21:21.148835+0000","last_fullsized":"2023-07-13T14:21:21.148835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'134","last_scrub_stamp":"2023-07-13T14:21:21.148680+0000","last_deep_scrub":"31'134","last_deep_scrub_stamp":"2023-07-13T14:21:21.148680+0000","last_clean_scrub_stamp":"2023-07-13T14:21:21.148680+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:02:56.264106+0000","scrub_duration":0.019123204000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'714","reported_seq":759,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.883967+0000","last_change":"2023-07-13T14:20:51.884018+0000","last_active":"2023-07-13T14:20:51.883967+0000","last_peered":"2023-07-13T14:20:51.883967+0000","last_clean":"2023-07-13T14:20:51.883967+0000","last_became_active":"2023-07-13T13:52:16.630934+0000","last_became_peered":"2023-07-13T13:52:16.630934+0000","last_unstale":"2023-07-13T14:20:51.883967+0000","last_undegraded":"2023-07-13T14:20:51.883967+0000","last_fullsized":"2023-07-13T14:20:51.883967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'714","last_scrub_stamp":"2023-07-13T14:20:51.883901+0000","last_deep_scrub":"31'714","last_deep_scrub_stamp":"2023-07-13T14:20:51.883901+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.883901+0000","objects_scrubbed":1,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:16:24.409670+0000","scrub_duration":0.073239398999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"31'26","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:47.681270+0000","last_change":"2023-07-13T14:20:47.681332+0000","last_active":"2023-07-13T14:20:47.681270+0000","last_peered":"2023-07-13T14:20:47.681270+0000","last_clean":"2023-07-13T14:20:47.681270+0000","last_became_active":"2023-07-13T13:52:17.952171+0000","last_became_peered":"2023-07-13T13:52:17.952171+0000","last_unstale":"2023-07-13T14:20:47.681270+0000","last_undegraded":"2023-07-13T14:20:47.681270+0000","last_fullsized":"2023-07-13T14:20:47.681270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'26","last_scrub_stamp":"2023-07-13T14:20:47.681178+0000","last_deep_scrub":"31'26","last_deep_scrub_stamp":"2023-07-13T14:20:47.681178+0000","last_clean_scrub_stamp":"2023-07-13T14:20:47.681178+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:54:56.528327+0000","scrub_duration":0.018502169999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"31'117","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:37.436222+0000","last_change":"2023-07-13T14:21:37.436276+0000","last_active":"2023-07-13T14:21:37.436222+0000","last_peered":"2023-07-13T14:21:37.436222+0000","last_clean":"2023-07-13T14:21:37.436222+0000","last_became_active":"2023-07-13T13:52:23.996482+0000","last_became_peered":"2023-07-13T13:52:23.996482+0000","last_unstale":"2023-07-13T14:21:37.436222+0000","last_undegraded":"2023-07-13T14:21:37.436222+0000","last_fullsized":"2023-07-13T14:21:37.436222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'117","last_scrub_stamp":"2023-07-13T14:21:37.436131+0000","last_deep_scrub":"31'117","last_deep_scrub_stamp":"2023-07-13T14:21:37.436131+0000","last_clean_scrub_stamp":"2023-07-13T14:21:37.436131+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:04:11.377636+0000","scrub_duration":0.022344217999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":13476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"31'5","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:09.160197+0000","last_change":"2023-07-13T14:21:09.160240+0000","last_active":"2023-07-13T14:21:09.160197+0000","last_peered":"2023-07-13T14:21:09.160197+0000","last_clean":"2023-07-13T14:21:09.160197+0000","last_became_active":"2023-07-13T13:52:16.668980+0000","last_became_peered":"2023-07-13T13:52:16.668980+0000","last_unstale":"2023-07-13T14:21:09.160197+0000","last_undegraded":"2023-07-13T14:21:09.160197+0000","last_fullsized":"2023-07-13T14:21:09.160197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2023-07-13T14:21:09.160120+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2023-07-13T14:21:09.160120+0000","last_clean_scrub_stamp":"2023-07-13T14:21:09.160120+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T17:36:43.946646+0000","scrub_duration":0.029922359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"31'33","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:31.512942+0000","last_change":"2023-07-13T14:21:31.512996+0000","last_active":"2023-07-13T14:21:31.512942+0000","last_peered":"2023-07-13T14:21:31.512942+0000","last_clean":"2023-07-13T14:21:31.512942+0000","last_became_active":"2023-07-13T13:52:17.942325+0000","last_became_peered":"2023-07-13T13:52:17.942325+0000","last_unstale":"2023-07-13T14:21:31.512942+0000","last_undegraded":"2023-07-13T14:21:31.512942+0000","last_fullsized":"2023-07-13T14:21:31.512942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'33","last_scrub_stamp":"2023-07-13T14:21:31.512819+0000","last_deep_scrub":"31'33","last_deep_scrub_stamp":"2023-07-13T14:21:31.512819+0000","last_clean_scrub_stamp":"2023-07-13T14:21:31.512819+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:25:20.977137+0000","scrub_duration":0.021710390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"31'97","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:45.146792+0000","last_change":"2023-07-13T14:21:45.146857+0000","last_active":"2023-07-13T14:21:45.146792+0000","last_peered":"2023-07-13T14:21:45.146792+0000","last_clean":"2023-07-13T14:21:45.146792+0000","last_became_active":"2023-07-13T13:52:23.987689+0000","last_became_peered":"2023-07-13T13:52:23.987689+0000","last_unstale":"2023-07-13T14:21:45.146792+0000","last_undegraded":"2023-07-13T14:21:45.146792+0000","last_fullsized":"2023-07-13T14:21:45.146792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'97","last_scrub_stamp":"2023-07-13T14:21:45.146715+0000","last_deep_scrub":"31'97","last_deep_scrub_stamp":"2023-07-13T14:21:45.146715+0000","last_clean_scrub_stamp":"2023-07-13T14:21:45.146715+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:39:13.804356+0000","scrub_duration":0.021399174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":9809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"31'1260","reported_seq":1307,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:14.288637+0000","last_change":"2023-07-13T14:21:14.288681+0000","last_active":"2023-07-13T14:21:14.288637+0000","last_peered":"2023-07-13T14:21:14.288637+0000","last_clean":"2023-07-13T14:21:14.288637+0000","last_became_active":"2023-07-13T13:52:16.669344+0000","last_became_peered":"2023-07-13T13:52:16.669344+0000","last_unstale":"2023-07-13T14:21:14.288637+0000","last_undegraded":"2023-07-13T14:21:14.288637+0000","last_fullsized":"2023-07-13T14:21:14.288637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1260","last_scrub_stamp":"2023-07-13T14:21:14.288525+0000","last_deep_scrub":"31'1260","last_deep_scrub_stamp":"2023-07-13T14:21:14.288525+0000","last_clean_scrub_stamp":"2023-07-13T14:21:14.288525+0000","objects_scrubbed":3,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:21.111968+0000","scrub_duration":0.098002016999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":8925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'30","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:33.566512+0000","last_change":"2023-07-13T14:21:33.566570+0000","last_active":"2023-07-13T14:21:33.566512+0000","last_peered":"2023-07-13T14:21:33.566512+0000","last_clean":"2023-07-13T14:21:33.566512+0000","last_became_active":"2023-07-13T13:52:17.941839+0000","last_became_peered":"2023-07-13T13:52:17.941839+0000","last_unstale":"2023-07-13T14:21:33.566512+0000","last_undegraded":"2023-07-13T14:21:33.566512+0000","last_fullsized":"2023-07-13T14:21:33.566512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'30","last_scrub_stamp":"2023-07-13T14:21:33.566402+0000","last_deep_scrub":"31'30","last_deep_scrub_stamp":"2023-07-13T14:21:33.566402+0000","last_clean_scrub_stamp":"2023-07-13T14:21:33.566402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:37:40.270587+0000","scrub_duration":0.021711978,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"31'115","reported_seq":153,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:47.560212+0000","last_change":"2023-07-13T14:21:47.560289+0000","last_active":"2023-07-13T14:21:47.560212+0000","last_peered":"2023-07-13T14:21:47.560212+0000","last_clean":"2023-07-13T14:21:47.560212+0000","last_became_active":"2023-07-13T13:52:23.986614+0000","last_became_peered":"2023-07-13T13:52:23.986614+0000","last_unstale":"2023-07-13T14:21:47.560212+0000","last_undegraded":"2023-07-13T14:21:47.560212+0000","last_fullsized":"2023-07-13T14:21:47.560212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'115","last_scrub_stamp":"2023-07-13T14:21:47.560026+0000","last_deep_scrub":"31'115","last_deep_scrub_stamp":"2023-07-13T14:21:47.560026+0000","last_clean_scrub_stamp":"2023-07-13T14:21:47.560026+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T16:15:18.217616+0000","scrub_duration":0.021783456,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":9360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"31'764","reported_seq":814,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:05.409170+0000","last_change":"2023-07-13T14:21:05.409213+0000","last_active":"2023-07-13T14:21:05.409170+0000","last_peered":"2023-07-13T14:21:05.409170+0000","last_clean":"2023-07-13T14:21:05.409170+0000","last_became_active":"2023-07-13T13:52:16.692782+0000","last_became_peered":"2023-07-13T13:52:16.692782+0000","last_unstale":"2023-07-13T14:21:05.409170+0000","last_undegraded":"2023-07-13T14:21:05.409170+0000","last_fullsized":"2023-07-13T14:21:05.409170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'764","last_scrub_stamp":"2023-07-13T14:21:05.409053+0000","last_deep_scrub":"31'764","last_deep_scrub_stamp":"2023-07-13T14:21:05.409053+0000","last_clean_scrub_stamp":"2023-07-13T14:21:05.409053+0000","objects_scrubbed":1,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:09:12.232496+0000","scrub_duration":0.058883059000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":4555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'35","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:55.170407+0000","last_change":"2023-07-13T14:20:55.170407+0000","last_active":"2023-07-13T14:20:55.170407+0000","last_peered":"2023-07-13T14:20:55.170407+0000","last_clean":"2023-07-13T14:20:55.170407+0000","last_became_active":"2023-07-13T13:52:17.924999+0000","last_became_peered":"2023-07-13T13:52:17.924999+0000","last_unstale":"2023-07-13T14:20:55.170407+0000","last_undegraded":"2023-07-13T14:20:55.170407+0000","last_fullsized":"2023-07-13T14:20:55.170407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'35","last_scrub_stamp":"2023-07-13T14:20:55.170275+0000","last_deep_scrub":"31'35","last_deep_scrub_stamp":"2023-07-13T14:20:55.170275+0000","last_clean_scrub_stamp":"2023-07-13T14:20:55.170275+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T14:31:16.808243+0000","scrub_duration":0.018752201999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"31'135","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:22.143163+0000","last_change":"2023-07-13T14:21:22.143163+0000","last_active":"2023-07-13T14:21:22.143163+0000","last_peered":"2023-07-13T14:21:22.143163+0000","last_clean":"2023-07-13T14:21:22.143163+0000","last_became_active":"2023-07-13T13:52:23.990717+0000","last_became_peered":"2023-07-13T13:52:23.990717+0000","last_unstale":"2023-07-13T14:21:22.143163+0000","last_undegraded":"2023-07-13T14:21:22.143163+0000","last_fullsized":"2023-07-13T14:21:22.143163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'135","last_scrub_stamp":"2023-07-13T14:21:22.143026+0000","last_deep_scrub":"31'135","last_deep_scrub_stamp":"2023-07-13T14:21:22.143026+0000","last_clean_scrub_stamp":"2023-07-13T14:21:22.143026+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T01:10:59.119380+0000","scrub_duration":0.019092520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":6623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"31'736","reported_seq":784,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:07.933127+0000","last_change":"2023-07-13T14:21:07.933127+0000","last_active":"2023-07-13T14:21:07.933127+0000","last_peered":"2023-07-13T14:21:07.933127+0000","last_clean":"2023-07-13T14:21:07.933127+0000","last_became_active":"2023-07-13T13:52:16.668861+0000","last_became_peered":"2023-07-13T13:52:16.668861+0000","last_unstale":"2023-07-13T14:21:07.933127+0000","last_undegraded":"2023-07-13T14:21:07.933127+0000","last_fullsized":"2023-07-13T14:21:07.933127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'736","last_scrub_stamp":"2023-07-13T14:21:07.932955+0000","last_deep_scrub":"31'736","last_deep_scrub_stamp":"2023-07-13T14:21:07.932955+0000","last_clean_scrub_stamp":"2023-07-13T14:21:07.932955+0000","objects_scrubbed":3,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T20:33:15.292167+0000","scrub_duration":0.073400576999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":4435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"31'37","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:40.600282+0000","last_change":"2023-07-13T14:21:40.600324+0000","last_active":"2023-07-13T14:21:40.600282+0000","last_peered":"2023-07-13T14:21:40.600282+0000","last_clean":"2023-07-13T14:21:40.600282+0000","last_became_active":"2023-07-13T13:52:17.946025+0000","last_became_peered":"2023-07-13T13:52:17.946025+0000","last_unstale":"2023-07-13T14:21:40.600282+0000","last_undegraded":"2023-07-13T14:21:40.600282+0000","last_fullsized":"2023-07-13T14:21:40.600282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2023-07-13T14:21:40.600199+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2023-07-13T14:21:40.600199+0000","last_clean_scrub_stamp":"2023-07-13T14:21:40.600199+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:43:37.554600+0000","scrub_duration":0.021753134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"31'43","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:51.494451+0000","last_change":"2023-07-13T14:20:51.494451+0000","last_active":"2023-07-13T14:20:51.494451+0000","last_peered":"2023-07-13T14:20:51.494451+0000","last_clean":"2023-07-13T14:20:51.494451+0000","last_became_active":"2023-07-13T13:52:17.933623+0000","last_became_peered":"2023-07-13T13:52:17.933623+0000","last_unstale":"2023-07-13T14:20:51.494451+0000","last_undegraded":"2023-07-13T14:20:51.494451+0000","last_fullsized":"2023-07-13T14:20:51.494451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'43","last_scrub_stamp":"2023-07-13T14:20:51.494264+0000","last_deep_scrub":"31'43","last_deep_scrub_stamp":"2023-07-13T14:20:51.494264+0000","last_clean_scrub_stamp":"2023-07-13T14:20:51.494264+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T00:19:20.845976+0000","scrub_duration":0.021866048999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"31'36","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:20.338438+0000","last_change":"2023-07-13T14:21:20.338438+0000","last_active":"2023-07-13T14:21:20.338438+0000","last_peered":"2023-07-13T14:21:20.338438+0000","last_clean":"2023-07-13T14:21:20.338438+0000","last_became_active":"2023-07-13T13:52:17.950779+0000","last_became_peered":"2023-07-13T13:52:17.950779+0000","last_unstale":"2023-07-13T14:21:20.338438+0000","last_undegraded":"2023-07-13T14:21:20.338438+0000","last_fullsized":"2023-07-13T14:21:20.338438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2023-07-13T14:21:20.338174+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2023-07-13T14:21:20.338174+0000","last_clean_scrub_stamp":"2023-07-13T14:21:20.338174+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T21:50:14.174112+0000","scrub_duration":0.018797963000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"31'42","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:10.506676+0000","last_change":"2023-07-13T14:21:10.506676+0000","last_active":"2023-07-13T14:21:10.506676+0000","last_peered":"2023-07-13T14:21:10.506676+0000","last_clean":"2023-07-13T14:21:10.506676+0000","last_became_active":"2023-07-13T13:52:17.946591+0000","last_became_peered":"2023-07-13T13:52:17.946591+0000","last_unstale":"2023-07-13T14:21:10.506676+0000","last_undegraded":"2023-07-13T14:21:10.506676+0000","last_fullsized":"2023-07-13T14:21:10.506676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'42","last_scrub_stamp":"2023-07-13T14:21:10.506562+0000","last_deep_scrub":"31'42","last_deep_scrub_stamp":"2023-07-13T14:21:10.506562+0000","last_clean_scrub_stamp":"2023-07-13T14:21:10.506562+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T19:30:23.333519+0000","scrub_duration":0.021720092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"31'28","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:20:57.231458+0000","last_change":"2023-07-13T14:20:57.231458+0000","last_active":"2023-07-13T14:20:57.231458+0000","last_peered":"2023-07-13T14:20:57.231458+0000","last_clean":"2023-07-13T14:20:57.231458+0000","last_became_active":"2023-07-13T13:52:17.838081+0000","last_became_peered":"2023-07-13T13:52:17.838081+0000","last_unstale":"2023-07-13T14:20:57.231458+0000","last_undegraded":"2023-07-13T14:20:57.231458+0000","last_fullsized":"2023-07-13T14:20:57.231458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'28","last_scrub_stamp":"2023-07-13T14:20:57.231265+0000","last_deep_scrub":"31'28","last_deep_scrub_stamp":"2023-07-13T14:20:57.231265+0000","last_clean_scrub_stamp":"2023-07-13T14:20:57.231265+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T22:35:53.580424+0000","scrub_duration":0.018638647000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'22","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-07-13T14:21:05.117156+0000","last_change":"2023-07-13T14:21:05.117192+0000","last_active":"2023-07-13T14:21:05.117156+0000","last_peered":"2023-07-13T14:21:05.117156+0000","last_clean":"2023-07-13T14:21:05.117156+0000","last_became_active":"2023-07-13T13:52:17.951218+0000","last_became_peered":"2023-07-13T13:52:17.951218+0000","last_unstale":"2023-07-13T14:21:05.117156+0000","last_undegraded":"2023-07-13T14:21:05.117156+0000","last_fullsized":"2023-07-13T14:21:05.117156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2023-07-13T14:21:05.117076+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2023-07-13T14:21:05.117076+0000","last_clean_scrub_stamp":"2023-07-13T14:21:05.117076+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-14T18:29:06.978004+0000","scrub_duration":0.019054194999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3402,"num_write_kb":282366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3765,"ondisk_log_size":3765,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":35165063,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":809,"num_read_kb":852,"num_write":7922,"num_write_kb":39030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49258496,"data_stored":70330126,"data_compressed":6207514,"data_compressed_allocated":9723904,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":0},"log_size":7513,"ondisk_log_size":7513,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64774,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509804,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34704,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94337136,"statfs":{"total":96636764160,"available":96601227264,"internally_reserved":0,"allocated":3678208,"data_stored":4927655,"data_compressed":341063,"data_compressed_allocated":569344,"data_compressed_original":2035712,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.44400000000000001,"15min":0.44},"min":{"1min":0.32700000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.79500000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.46000000000000002,"15min":0.45500000000000002},"min":{"1min":0.435,"5min":0.25600000000000001,"15min":0.22700000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jul 13 14:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.35299999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.82799999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.46800000000000003,"15min":0.47699999999999998},"min":{"1min":0.35899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":3.2789999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jul 13 14:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45000000000000001,"15min":0.47399999999999998},"min":{"1min":0.40000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":3.9329999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48899999999999999,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.309,"15min":0.26700000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":1.4630000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.35199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":1.4650000000000001},"last":0.495},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.503,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":3.8999999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41499999999999998,"15min":0.44},"min":{"1min":0.26100000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.61799999999999999,"5min":0.628,"15min":0.83399999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.441,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.26000000000000001},"max":{"1min":0.60999999999999999,"5min":0.65500000000000003,"15min":0.76000000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jul 13 14:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.44800000000000001,"15min":0.48799999999999999},"min":{"1min":0.27600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64400000000000002,"5min":0.68700000000000006,"15min":0.97799999999999998},"last":0.439},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.27900000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.66900000000000004,"5min":0.72499999999999998,"15min":0.79700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:21:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.86699999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.496,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.28699999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81399999999999995},"last":0.58199999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509804,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30324,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341516,"statfs":{"total":96636764160,"available":96605712384,"internally_reserved":0,"allocated":3387392,"data_stored":4336399,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.433},"min":{"1min":0.245,"5min":0.245,"15min":0.217},"max":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":1.2549999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.25700000000000001,"15min":0.214},"max":{"1min":0.72499999999999998,"5min":0.73799999999999999,"15min":2.3759999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.28299999999999997},"max":{"1min":0.625,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.49299999999999999,"15min":0.46400000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69399999999999995,"5min":2.899,"15min":2.899},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jul 13 14:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.44800000000000001,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.26600000000000001},"max":{"1min":0.61399999999999999,"5min":0.66100000000000003,"15min":2.1789999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.47799999999999998},"min":{"1min":0.34000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":3.4060000000000001},"last":0.442}]},{"osd":3,"last update":"Thu Jul 13 14:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.55300000000000005,"15min":0.52600000000000002},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.63700000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.313,"15min":0.25900000000000001},"max":{"1min":0.753,"5min":2.7389999999999999,"15min":5.3810000000000002},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jul 13 14:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.434,"15min":0.438},"min":{"1min":0.28199999999999997,"5min":0.25800000000000001,"15min":0.23799999999999999},"max":{"1min":0.55200000000000005,"5min":0.755,"15min":0.755},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.47099999999999997,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.26400000000000001,"15min":0.246},"max":{"1min":0.60999999999999999,"5min":0.78000000000000003,"15min":0.80100000000000005},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jul 13 14:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45400000000000001,"15min":0.45700000000000002},"min":{"1min":0.30499999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60299999999999998,"5min":0.65400000000000003,"15min":0.81599999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.35199999999999998,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.63,"5min":0.70499999999999996,"15min":0.89500000000000002},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jul 13 14:21:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50600000000000001,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.32000000000000001,"15min":0.27900000000000003},"max":{"1min":0.64800000000000002,"5min":0.73199999999999998,"15min":0.747},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.499,"15min":0.505},"min":{"1min":0.36599999999999999,"5min":0.315,"15min":0.28499999999999998},"max":{"1min":0.63200000000000001,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.55000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575212,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39120,"kb_used_data":3912,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94332720,"statfs":{"total":96636764160,"available":96596705280,"internally_reserved":0,"allocated":4005888,"data_stored":5770865,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33100000000000002,"15min":0.33800000000000002},"min":{"1min":0.20399999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.435,"5min":0.61599999999999999,"15min":3.7240000000000002},"last":0.377},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33900000000000002,"15min":0.34200000000000003},"min":{"1min":0.216,"5min":0.214,"15min":0.214},"max":{"1min":0.42099999999999999,"5min":0.71099999999999997,"15min":0.76200000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.314,"15min":0.33000000000000002},"min":{"1min":0.218,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.38400000000000001,"5min":0.52100000000000002,"15min":1.49},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.375},"min":{"1min":0.26000000000000001,"5min":0.22700000000000001,"15min":0.20300000000000001},"max":{"1min":0.52100000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.47899999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.29499999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.48999999999999999,"5min":1.548,"15min":1.548},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52900000000000003,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.70499999999999996,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.314,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.80100000000000005,"15min":0.83099999999999996},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.309},"max":{"1min":0.746,"5min":0.83299999999999996,"15min":0.89700000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.92800000000000005},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.34799999999999998},"max":{"1min":0.71199999999999997,"5min":1.625,"15min":1.625},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":0.72099999999999997,"5min":0.81999999999999995,"15min":0.92200000000000004},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58099999999999996,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73399999999999999,"5min":0.94299999999999995,"15min":0.95299999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68400000000000005,"5min":1.657,"15min":1.657},"last":0.56299999999999994}]}]},{"osd":0,"up_from":14,"seq":60129542508,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66744,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94305096,"statfs":{"total":96636764160,"available":96568418304,"internally_reserved":0,"allocated":9617408,"data_stored":13490652,"data_compressed":1179065,"data_compressed_allocated":1941504,"data_compressed_original":6012928,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 13 14:21:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.312,"15min":0.31},"min":{"1min":0.188,"5min":0.186,"15min":0.185},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.64800000000000002},"last":0.254},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34000000000000002,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.19},"max":{"1min":0.46899999999999997,"5min":0.52000000000000002,"15min":1.6879999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48199999999999998,"5min":0.59499999999999997,"15min":0.77200000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.374,"15min":0.35799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.42799999999999999,"5min":3.4940000000000002,"15min":3.4940000000000002},"last":0.314}]},{"osd":3,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.38,"15min":0.377},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.67500000000000004,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38800000000000001,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.26400000000000001,"15min":0.26300000000000001},"max":{"1min":0.51300000000000001,"5min":0.76500000000000001,"15min":2.5379999999999998},"last":0.439}]},{"osd":4,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65500000000000003,"5min":0.85099999999999998,"15min":0.91400000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28699999999999998},"max":{"1min":0.753,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.52300000000000002,"15min":0.54100000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.26100000000000001},"max":{"1min":0.73599999999999999,"5min":0.80700000000000005,"15min":0.94299999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.629,"5min":0.76900000000000002,"15min":1.0529999999999999},"last":0.39900000000000002}]},{"osd":6,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55500000000000005,"15min":0.56599999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.33900000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.96599999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.40400000000000003,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":0.63900000000000001,"5min":0.83699999999999997,"15min":0.98299999999999998},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jul 13 14:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81499999999999995,"15min":0.997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73099999999999998,"5min":0.86599999999999999,"15min":1.03},"last":0.5}]}]},{"osd":2,"up_from":15,"seq":64424509804,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1228800,"data_stored":1576561,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.314,"15min":0.311},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.17899999999999999},"max":{"1min":0.41799999999999998,"5min":0.65200000000000002,"15min":0.751},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34300000000000003,"15min":0.36399999999999999},"min":{"1min":0.218,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.498,"5min":0.56699999999999995,"15min":3.0939999999999999},"last":0.377}]},{"osd":1,"last update":"Thu Jul 13 14:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35599999999999998,"15min":0.36299999999999999},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.222},"max":{"1min":0.50700000000000001,"5min":0.749,"15min":1.248},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.38700000000000001},"min":{"1min":0.27100000000000002,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":0.52800000000000002,"5min":0.94899999999999995,"15min":2.9529999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jul 13 14:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.37},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23200000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":2.2490000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39100000000000001,"15min":0.40699999999999997},"min":{"1min":0.30399999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.71299999999999997,"15min":1.167},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jul 13 14:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.28799999999999998},"max":{"1min":0.71299999999999997,"5min":0.79300000000000004,"15min":0.82999999999999996},"last":0.499},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.26700000000000002},"max":{"1min":0.82499999999999996,"5min":0.82899999999999996,"15min":2.3220000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jul 13 14:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54600000000000004},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78100000000000003,"5min":0.86899999999999999,"15min":2.3660000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.747,"5min":0.747,"15min":1.681},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jul 13 14:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.55200000000000005},"min":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.34799999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.6970000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.34699999999999998,"15min":0.34499999999999997},"max":{"1min":0.87,"5min":0.94699999999999995,"15min":0.98999999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jul 13 14:21:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.378},"max":{"1min":0.76100000000000001,"5min":0.83899999999999997,"15min":2.4020000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.39600000000000002,"15min":0.371},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":1.6619999999999999},"last":0.68999999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509804,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55200,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94316640,"statfs":{"total":96636764160,"available":96580239360,"internally_reserved":0,"allocated":6184960,"data_stored":8530793,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.32300000000000001},"min":{"1min":0.215,"5min":0.19500000000000001,"15min":0.182},"max":{"1min":0.495,"5min":0.65500000000000003,"15min":0.78300000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.318,"15min":0.33800000000000002},"min":{"1min":0.24199999999999999,"5min":0.22500000000000001,"15min":0.193},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":2.972},"last":0.433}]},{"osd":1,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36299999999999999,"15min":0.35599999999999998},"min":{"1min":0.25700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48199999999999998,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.38},"min":{"1min":0.26100000000000001,"5min":0.221,"15min":0.218},"max":{"1min":0.50600000000000001,"5min":0.73999999999999999,"15min":2.173},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.28100000000000003,"5min":0.23599999999999999,"15min":0.23200000000000001},"max":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":2.335},"last":0.499},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39700000000000002,"15min":0.41699999999999998},"min":{"1min":0.255,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55800000000000005,"5min":0.71399999999999997,"15min":2.2000000000000002},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52500000000000002,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.26000000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.83799999999999997,"15min":0.88600000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73199999999999998,"5min":0.84599999999999997,"15min":0.92800000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56299999999999994,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34699999999999998},"max":{"1min":0.85299999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.33200000000000002},"max":{"1min":0.76300000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.62}]},{"osd":7,"last update":"Thu Jul 13 14:21:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.752,"5min":0.78500000000000003,"15min":0.82299999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56299999999999994,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.34699999999999998,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.97599999999999998},"last":0.60799999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509804,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77928,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94293912,"statfs":{"total":96636764160,"available":96556965888,"internally_reserved":0,"allocated":15171584,"data_stored":21289038,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":1781,"internal_metadata":64616715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.45000000000000001,"15min":0.442},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.23400000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46000000000000002,"15min":0.441},"min":{"1min":0.38900000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45900000000000002,"15min":0.44600000000000001},"min":{"1min":0.41399999999999998,"5min":0.29999999999999999,"15min":0.25},"max":{"1min":0.67500000000000004,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29199999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.73499999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jul 13 14:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.39300000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.47599999999999998,"15min":0.48199999999999998},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":2.266},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jul 13 14:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.35799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72099999999999997,"5min":1.2849999999999999,"15min":1.5620000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":1.4259999999999999,"15min":2.6960000000000002},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jul 13 14:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42799999999999999,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.253},"max":{"1min":0.57999999999999996,"5min":0.748,"15min":0.748},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.46700000000000003},"min":{"1min":0.33300000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.627,"5min":0.68000000000000005,"15min":0.73699999999999999},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jul 13 14:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.46100000000000002,"15min":0.47999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29899999999999999,"15min":0.28000000000000003},"max":{"1min":0.64200000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.503,"15min":0.52100000000000002},"min":{"1min":0.32200000000000001,"5min":0.32100000000000001,"15min":0.28599999999999998},"max":{"1min":0.63800000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jul 13 14:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.49399999999999999,"15min":0.505},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.27800000000000002},"max":{"1min":0.65400000000000003,"5min":0.71899999999999997,"15min":0.77500000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.31900000000000001,"15min":0.30499999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38400000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509804,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61820,"kb_used_data":8564,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94310020,"statfs":{"total":96636764160,"available":96573460480,"internally_reserved":0,"allocated":8769536,"data_stored":12725659,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.44900000000000001,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65600000000000003,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.26200000000000001,"15min":0.23899999999999999},"max":{"1min":0.623,"5min":0.68000000000000005,"15min":0.72399999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47599999999999998,"15min":0.46000000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.252},"max":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.77700000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.441,"15min":0.44700000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":1.3129999999999999},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.40400000000000003,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.67600000000000005,"5min":0.69899999999999995,"15min":1.7430000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.44700000000000001,"15min":0.45000000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.24299999999999999},"max":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":1.284},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.35899999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.64000000000000001,"5min":0.90100000000000002,"15min":1.056},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":0.64600000000000002,"5min":1.0960000000000001,"15min":1.78},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.43099999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.46899999999999997,"15min":0.47599999999999998},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65800000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.46600000000000003,"15min":0.47999999999999998},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.23699999999999999},"max":{"1min":0.57199999999999995,"5min":0.69299999999999995,"15min":1.2210000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.436,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60299999999999998,"5min":0.70599999999999996,"15min":0.77400000000000002},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jul 13 14:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.33800000000000002,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.71299999999999997,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74399999999999999,"5min":1.0429999999999999,"15min":1.351},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32387,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":12758189,"data_compressed":1146678,"data_compressed_allocated":1896448,"data_compressed_original":5439488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3674112,"data_stored":5628770,"data_compressed":581279,"data_compressed_allocated":868352,"data_compressed_original":2826240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":897024,"data_stored":1434466,"data_compressed":164678,"data_compressed_allocated":249856,"data_compressed_original":790528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5853184,"data_stored":8388698,"data_compressed":721785,"data_compressed_allocated":1138688,"data_compressed_original":3678208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14839808,"data_stored":21146943,"data_compressed":1850312,"data_compressed_allocated":2883584,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8437760,"data_stored":12583564,"data_compressed":1148969,"data_compressed_allocated":1728512,"data_compressed_original":5881856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3055616,"data_stored":4194304,"data_compressed":285137,"data_compressed_allocated":434176,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":4195192,"data_compressed":308676,"data_compressed_allocated":524288,"data_compressed_original":1462272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-13T14:22:08.845 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-13T14:22:08.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.996+0000 7f1febc33700 1 Processor -- start 2023-07-13T14:22:08.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.996+0000 7f1febc33700 1 -- start start 2023-07-13T14:22:08.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.997+0000 7f1febc33700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fe40b36d0 0x7f1fe415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.997+0000 7f1febc33700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b3aa0 0x7f1fe4159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.990 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.997+0000 7f1febc33700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1fe40ce7e0 0x7f1fe40cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:08.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.997+0000 7f1febc33700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe4158740 con 0x7f1fe40ce7e0 2023-07-13T14:22:08.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.997+0000 7f1febc33700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40c3af0 con 0x7f1fe40b36d0 2023-07-13T14:22:08.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.997+0000 7f1febc33700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40c3dd0 con 0x7f1fe40b3aa0 2023-07-13T14:22:08.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.998+0000 7f1fea1d0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1fe40ce7e0 0x7f1fe40cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.998+0000 7f1fe91ce700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b3aa0 0x7f1fe4159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.998+0000 7f1fe99cf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1fe40b36d0 0x7f1fe415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:08.992 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.998+0000 7f1fe91ce700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b3aa0 0x7f1fe4159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:42492/0 (socket says 172.21.15.118:42492) 2023-07-13T14:22:08.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:08.998+0000 7f1fe91ce700 1 -- 172.21.15.118:0/2188997775 learned_addr learned my addr 172.21.15.118:0/2188997775 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:08.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.001+0000 7f1fea1d0700 1 -- 172.21.15.118:0/2188997775 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b3aa0 msgr2=0x7f1fe4159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:08.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.001+0000 7f1fea1d0700 1 --2- 172.21.15.118:0/2188997775 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b3aa0 0x7f1fe4159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.001+0000 7f1fea1d0700 1 -- 172.21.15.118:0/2188997775 >> v2:172.21.15.123:3300/0 conn(0x7f1fe40b36d0 msgr2=0x7f1fe415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:08.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.001+0000 7f1fea1d0700 1 --2- 172.21.15.118:0/2188997775 >> v2:172.21.15.123:3300/0 conn(0x7f1fe40b36d0 0x7f1fe415bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:08.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.001+0000 7f1fea1d0700 1 -- 172.21.15.118:0/2188997775 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40c40b0 con 0x7f1fe40ce7e0 2023-07-13T14:22:08.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.003+0000 7f1fea1d0700 1 --2- 172.21.15.118:0/2188997775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40ce7e0 0x7f1fe40cec60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40c5b60 tx=0x7f1fdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417e3a3106452ef1 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:08.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.007+0000 7f1fe89cd700 1 -- 172.21.15.118:0/2188997775 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00e070 con 0x7f1fe40ce7e0 2023-07-13T14:22:08.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.007+0000 7f1fe89cd700 1 -- 172.21.15.118:0/2188997775 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00bb20 con 0x7f1fe40ce7e0 2023-07-13T14:22:08.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.007+0000 7f1fe89cd700 1 -- 172.21.15.118:0/2188997775 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc012430 con 0x7f1fe40ce7e0 2023-07-13T14:22:09.000 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 -- 172.21.15.118:0/2188997775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40ce7e0 msgr2=0x7f1fe40cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 --2- 172.21.15.118:0/2188997775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40ce7e0 0x7f1fe40cec60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40c5b60 tx=0x7f1fdc00b330 comp rx=0 tx=0).stop 2023-07-13T14:22:09.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 -- 172.21.15.118:0/2188997775 shutdown_connections 2023-07-13T14:22:09.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 --2- 172.21.15.118:0/2188997775 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40ce7e0 0x7f1fe40cec60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 --2- 172.21.15.118:0/2188997775 >> v2:172.21.15.123:3300/0 conn(0x7f1fe40b36d0 0x7f1fe415bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 --2- 172.21.15.118:0/2188997775 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b3aa0 0x7f1fe4159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 -- 172.21.15.118:0/2188997775 >> 172.21.15.118:0/2188997775 conn(0x7f1fe4071840 msgr2=0x7f1fe406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:09.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 -- 172.21.15.118:0/2188997775 shutdown_connections 2023-07-13T14:22:09.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.008+0000 7f1febc33700 1 -- 172.21.15.118:0/2188997775 wait complete. 2023-07-13T14:22:09.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.009+0000 7f1febc33700 1 Processor -- start 2023-07-13T14:22:09.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.009+0000 7f1febc33700 1 -- start start 2023-07-13T14:22:09.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.010+0000 7f1febc33700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b36d0 0x7f1fe41f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.010+0000 7f1febc33700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40b3aa0 0x7f1fe41e3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.010+0000 7f1febc33700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ce7e0 0x7f1fe415b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.010+0000 7f1febc33700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe41f22f0 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.010+0000 7f1febc33700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe415ab00 con 0x7f1fe40ce7e0 2023-07-13T14:22:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.010+0000 7f1febc33700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe41e1b90 con 0x7f1fe40b36d0 2023-07-13T14:22:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.011+0000 7f1fe91ce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40b3aa0 0x7f1fe41e3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.011+0000 7f1fea1d0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ce7e0 0x7f1fe415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.011+0000 7f1fe99cf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b36d0 0x7f1fe41f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.011+0000 7f1fe91ce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40b3aa0 0x7f1fe41e3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:35932/0 (socket says 172.21.15.118:35932) 2023-07-13T14:22:09.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.011+0000 7f1fe91ce700 1 -- 172.21.15.118:0/1185142989 learned_addr learned my addr 172.21.15.118:0/1185142989 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.014+0000 7f1fe91ce700 1 -- 172.21.15.118:0/1185142989 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b36d0 msgr2=0x7f1fe41f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.014+0000 7f1fe91ce700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b36d0 0x7f1fe41f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.014+0000 7f1fe91ce700 1 -- 172.21.15.118:0/1185142989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ce7e0 msgr2=0x7f1fe415b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.014+0000 7f1fe91ce700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ce7e0 0x7f1fe415b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.014+0000 7f1fe91ce700 1 -- 172.21.15.118:0/1185142989 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc009a70 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.017+0000 7f1fe91ce700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40b3aa0 0x7f1fe41e3ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000e910 tx=0x7f1fe000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:09.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.021+0000 7f1fda7fc700 1 -- 172.21.15.118:0/1185142989 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00096a0 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.021+0000 7f1fda7fc700 1 -- 172.21.15.118:0/1185142989 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe0013680 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.021+0000 7f1fda7fc700 1 -- 172.21.15.118:0/1185142989 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0013a30 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.013 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.021+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe41e1e30 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.021+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe415ad50 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.022+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe404e280 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.122 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.130+0000 7f1fda7fc700 1 -- 172.21.15.118:0/1185142989 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1fe0013b90 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.130+0000 7f1fda7fc700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1fc806ad30 0x7f1fc806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.130+0000 7f1fda7fc700 1 -- 172.21.15.118:0/1185142989 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1fe0089e30 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.131+0000 7f1fe99cf700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1fc806ad30 0x7f1fc806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.123 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.131+0000 7f1fe99cf700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1fc806ad30 0x7f1fc806d1e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009ac0 tx=0x7f1fd4009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:09.280 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.289+0000 7f1fda7fc700 1 -- 172.21.15.118:0/1185142989 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1fe0054c20 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.498 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.506+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1fe406ab20 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.664+0000 7f1fda7fc700 1 -- 172.21.15.118:0/1185142989 <== mon.0 v2:172.21.15.118:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1fe0054c20 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.656 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.664+0000 7f1fda7fc700 1 -- 172.21.15.118:0/1185142989 <== mon.0 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1fe00170c0 con 0x7f1fe40b3aa0 2023-07-13T14:22:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.670+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1fc806ad30 msgr2=0x7f1fc806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.670+0000 7f1febc33700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1fc806ad30 0x7f1fc806d1e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009ac0 tx=0x7f1fd4009210 comp rx=0 tx=0).stop 2023-07-13T14:22:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.670+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40b3aa0 msgr2=0x7f1fe41e3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.661 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.670+0000 7f1febc33700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40b3aa0 0x7f1fe41e3ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000e910 tx=0x7f1fe000ec20 comp rx=0 tx=0).stop 2023-07-13T14:22:09.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.671+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 shutdown_connections 2023-07-13T14:22:09.662 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.671+0000 7f1febc33700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f1fc806ad30 0x7f1fc806d1e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.671+0000 7f1febc33700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1fe40ce7e0 0x7f1fe415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.671+0000 7f1febc33700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1fe40b36d0 0x7f1fe41f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.671+0000 7f1febc33700 1 --2- 172.21.15.118:0/1185142989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1fe40b3aa0 0x7f1fe41e3ab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.671+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 >> 172.21.15.118:0/1185142989 conn(0x7f1fe4071840 msgr2=0x7f1fe41571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:09.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.671+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 shutdown_connections 2023-07-13T14:22:09.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.671+0000 7f1febc33700 1 -- 172.21.15.118:0/1185142989 wait complete. 2023-07-13T14:22:09.677 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-13T14:22:09.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T14:22:09.803 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.812+0000 7fa9976c9700 1 Processor -- start 2023-07-13T14:22:09.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.812+0000 7fa9976c9700 1 -- start start 2023-07-13T14:22:09.804 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.813+0000 7fa9976c9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa99014ed20 0x7fa9900c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.813+0000 7fa9976c9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa9900caf30 0x7fa9900c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.813+0000 7fa9976c9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9901550e0 con 0x7fa990154c60 2023-07-13T14:22:09.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.813+0000 7fa9976c9700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9900c1ab0 con 0x7fa9900caf30 2023-07-13T14:22:09.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.813+0000 7fa9976c9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa990070fb0 con 0x7fa99014ed20 2023-07-13T14:22:09.805 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.813+0000 7fa995465700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa99014ed20 0x7fa9900c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.814+0000 7fa995c66700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa990154c60 0x7fa990070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.118:60754/0 (socket says 172.21.15.118:60754) 2023-07-13T14:22:09.806 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.814+0000 7fa995c66700 1 -- 172.21.15.118:0/572751323 learned_addr learned my addr 172.21.15.118:0/572751323 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:22:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.817+0000 7fa995465700 1 -- 172.21.15.118:0/572751323 >> v2:172.21.15.118:3300/0 conn(0x7fa9900caf30 msgr2=0x7fa9900c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.817+0000 7fa995465700 1 --2- 172.21.15.118:0/572751323 >> v2:172.21.15.118:3300/0 conn(0x7fa9900caf30 0x7fa9900c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.817+0000 7fa995465700 1 -- 172.21.15.118:0/572751323 >> v1:172.21.15.123:6789/0 conn(0x7fa990154c60 legacy=0x7fa990070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.809 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.817+0000 7fa995465700 1 -- 172.21.15.118:0/572751323 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99006fc70 con 0x7fa99014ed20 2023-07-13T14:22:09.813 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.822+0000 7fa995465700 1 --2- 172.21.15.118:0/572751323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99014ed20 0x7fa9900c4400 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa99006eb00 tx=0x7fa98c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=863f4703afa3a6c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:09.816 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.825+0000 7fa987fff700 1 -- 172.21.15.118:0/572751323 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c011830 con 0x7fa99014ed20 2023-07-13T14:22:09.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.882+0000 7fa987fff700 1 -- 172.21.15.118:0/572751323 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa98c011990 con 0x7fa99014ed20 2023-07-13T14:22:09.874 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.882+0000 7fa987fff700 1 -- 172.21.15.118:0/572751323 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c011d40 con 0x7fa99014ed20 2023-07-13T14:22:09.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.883+0000 7fa9976c9700 1 -- 172.21.15.118:0/572751323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99014ed20 msgr2=0x7fa9900c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.883+0000 7fa9976c9700 1 --2- 172.21.15.118:0/572751323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99014ed20 0x7fa9900c4400 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa99006eb00 tx=0x7fa98c009b20 comp rx=0 tx=0).stop 2023-07-13T14:22:09.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.883+0000 7fa9976c9700 1 -- 172.21.15.118:0/572751323 shutdown_connections 2023-07-13T14:22:09.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.883+0000 7fa9976c9700 1 --2- 172.21.15.118:0/572751323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa99014ed20 0x7fa9900c4400 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.883+0000 7fa9976c9700 1 --2- 172.21.15.118:0/572751323 >> v2:172.21.15.118:3300/0 conn(0x7fa9900caf30 0x7fa9900c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.883+0000 7fa9976c9700 1 -- 172.21.15.118:0/572751323 >> 172.21.15.118:0/572751323 conn(0x7fa99006d830 msgr2=0x7fa99006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:09.875 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.883+0000 7fa9976c9700 1 -- 172.21.15.118:0/572751323 shutdown_connections 2023-07-13T14:22:09.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.883+0000 7fa9976c9700 1 -- 172.21.15.118:0/572751323 wait complete. 2023-07-13T14:22:09.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.885+0000 7fa9976c9700 1 Processor -- start 2023-07-13T14:22:09.876 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.885+0000 7fa9976c9700 1 -- start start 2023-07-13T14:22:09.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.886+0000 7fa9976c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9900caf30 0x7fa990160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.886+0000 7fa9976c9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa99014ed20 0x7fa9901506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.886+0000 7fa9976c9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa990154c60 0x7fa99013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.886+0000 7fa9976c9700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99014af30 con 0x7fa99014ed20 2023-07-13T14:22:09.878 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.886+0000 7fa9976c9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa990151fe0 con 0x7fa9900caf30 2023-07-13T14:22:09.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.886+0000 7fa9976c9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99014fc10 con 0x7fa990154c60 2023-07-13T14:22:09.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.887+0000 7fa995c66700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa990154c60 0x7fa99013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.887+0000 7fa995c66700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa990154c60 0x7fa99013f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:42516/0 (socket says 172.21.15.118:42516) 2023-07-13T14:22:09.879 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.887+0000 7fa995c66700 1 -- 172.21.15.118:0/328352255 learned_addr learned my addr 172.21.15.118:0/328352255 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:09.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.888+0000 7fa995465700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9900caf30 0x7fa990160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.880 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.889+0000 7fa994c64700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa99014ed20 0x7fa9901506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.892+0000 7fa995c66700 1 -- 172.21.15.118:0/328352255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9900caf30 msgr2=0x7fa990160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.892+0000 7fa995c66700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9900caf30 0x7fa990160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.883 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.892+0000 7fa995c66700 1 -- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa99014ed20 msgr2=0x7fa9901506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:09.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.892+0000 7fa995c66700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa99014ed20 0x7fa9901506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:09.884 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.892+0000 7fa995c66700 1 -- 172.21.15.118:0/328352255 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0094a0 con 0x7fa990154c60 2023-07-13T14:22:09.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.895+0000 7fa995c66700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa990154c60 0x7fa99013f600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa98800cab0 tx=0x7fa98800cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.900+0000 7fa985ffb700 1 -- 172.21.15.118:0/328352255 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800a940 con 0x7fa990154c60 2023-07-13T14:22:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.900+0000 7fa985ffb700 1 -- 172.21.15.118:0/328352255 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa98800aaa0 con 0x7fa990154c60 2023-07-13T14:22:09.892 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.900+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99014e3b0 con 0x7fa990154c60 2023-07-13T14:22:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.901+0000 7fa985ffb700 1 -- 172.21.15.118:0/328352255 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800ae30 con 0x7fa990154c60 2023-07-13T14:22:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.901+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99014b140 con 0x7fa990154c60 2023-07-13T14:22:09.893 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.902+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa990153bd0 con 0x7fa990154c60 2023-07-13T14:22:09.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.923+0000 7fa985ffb700 1 -- 172.21.15.118:0/328352255 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa98801b3b0 con 0x7fa990154c60 2023-07-13T14:22:09.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.923+0000 7fa985ffb700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa97406ace0 0x7fa97406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:09.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.923+0000 7fa995465700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa97406ace0 0x7fa97406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:09.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:09.924+0000 7fa995465700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa97406ace0 0x7fa97406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0090b0 tx=0x7fa98c008030 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:10.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.075+0000 7fa985ffb700 1 -- 172.21.15.118:0/328352255 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa988007b40 con 0x7fa990154c60 2023-07-13T14:22:10.157 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.165+0000 7fa985ffb700 1 -- 172.21.15.118:0/328352255 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa988054570 con 0x7fa990154c60 2023-07-13T14:22:10.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.391+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9900743c0 con 0x7fa990154c60 2023-07-13T14:22:10.412 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.420+0000 7fa985ffb700 1 -- 172.21.15.118:0/328352255 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6197 (secure 0 0 0) 0x7fa988057b90 con 0x7fa990154c60 2023-07-13T14:22:10.412 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:22:10.412 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1760692596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1760692596},{"type":"v1","addr":"172.21.15.118:6835","nonce":1760692596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3512155037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3512155037},{"type":"v1","addr":"172.21.15.123:6833","nonce":3512155037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/439561314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":439561314},{"type":"v1","addr":"172.21.15.123:6835","nonce":439561314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2359037201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359037201},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359037201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3040631544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3040631544},{"type":"v1","addr":"172.21.15.118:6839","nonce":3040631544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-13T13:52:17.418144+0000","modified":"2023-07-13T13:52:47.871510+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/3588922803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":3588922803},{"type":"v1","addr":"172.21.15.118:6837","nonce":3588922803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-13T14:22:10.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa97406ace0 msgr2=0x7fa97406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:10.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa97406ace0 0x7fa97406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0090b0 tx=0x7fa98c008030 comp rx=0 tx=0).stop 2023-07-13T14:22:10.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa990154c60 msgr2=0x7fa99013f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:10.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa990154c60 0x7fa99013f600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa98800cab0 tx=0x7fa98800cdc0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 shutdown_connections 2023-07-13T14:22:10.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fa97406ace0 0x7fa97406d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9900caf30 0x7fa990160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa990154c60 0x7fa99013f600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 --2- 172.21.15.118:0/328352255 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa99014ed20 0x7fa9901506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 >> 172.21.15.118:0/328352255 conn(0x7fa99006d830 msgr2=0x7fa99006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:10.415 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 shutdown_connections 2023-07-13T14:22:10.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.422+0000 7fa9976c9700 1 -- 172.21.15.118:0/328352255 wait complete. 2023-07-13T14:22:10.416 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 10 2023-07-13T14:22:10.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-13T14:22:10.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.555+0000 7f6d9deff700 1 Processor -- start 2023-07-13T14:22:10.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.556+0000 7f6d9deff700 1 -- start start 2023-07-13T14:22:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.556+0000 7f6d9deff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d980c6f30 0x7f6d980cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.556+0000 7f6d9deff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6d980c9c20 0x7f6d980c7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.556+0000 7f6d9deff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d9806e040 0x7f6d981583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.556+0000 7f6d9deff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980c8f50 con 0x7f6d980c9c20 2023-07-13T14:22:10.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.556+0000 7f6d9deff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980c7840 con 0x7f6d980c6f30 2023-07-13T14:22:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.556+0000 7f6d9deff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980c9790 con 0x7f6d9806e040 2023-07-13T14:22:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.557+0000 7f6d96ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6d980c9c20 0x7f6d980c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.557+0000 7f6d96ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6d980c9c20 0x7f6d980c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50296/0 (socket says 172.21.15.118:50296) 2023-07-13T14:22:10.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.557+0000 7f6d96ffd700 1 -- 172.21.15.118:0/3772499219 learned_addr learned my addr 172.21.15.118:0/3772499219 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:10.550 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.558+0000 7f6d977fe700 1 --2- 172.21.15.118:0/3772499219 >> v2:172.21.15.123:3300/0 conn(0x7f6d980c6f30 0x7f6d980cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:10.550 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.559+0000 7f6d97fff700 1 --2- 172.21.15.118:0/3772499219 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d9806e040 0x7f6d981583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:10.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.560+0000 7f6d96ffd700 1 -- 172.21.15.118:0/3772499219 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d9806e040 msgr2=0x7f6d981583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:10.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.560+0000 7f6d96ffd700 1 --2- 172.21.15.118:0/3772499219 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d9806e040 0x7f6d981583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.560+0000 7f6d96ffd700 1 -- 172.21.15.118:0/3772499219 >> v2:172.21.15.123:3300/0 conn(0x7f6d980c6f30 msgr2=0x7f6d980cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.560+0000 7f6d96ffd700 1 --2- 172.21.15.118:0/3772499219 >> v2:172.21.15.123:3300/0 conn(0x7f6d980c6f30 0x7f6d980cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.560+0000 7f6d96ffd700 1 -- 172.21.15.118:0/3772499219 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9806ec80 con 0x7f6d980c9c20 2023-07-13T14:22:10.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.564+0000 7f6d96ffd700 1 --2- 172.21.15.118:0/3772499219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d980c9c20 0x7f6d980c7300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d9806d220 tx=0x7f6d8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557a94cf6f9690c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.571+0000 7f6d967fc700 1 -- 172.21.15.118:0/3772499219 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c011830 con 0x7f6d980c9c20 2023-07-13T14:22:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.571+0000 7f6d967fc700 1 -- 172.21.15.118:0/3772499219 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6d8c011990 con 0x7f6d980c9c20 2023-07-13T14:22:10.563 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.571+0000 7f6d967fc700 1 -- 172.21.15.118:0/3772499219 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c011d40 con 0x7f6d980c9c20 2023-07-13T14:22:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 -- 172.21.15.118:0/3772499219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d980c9c20 msgr2=0x7f6d980c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3772499219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d980c9c20 0x7f6d980c7300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d9806d220 tx=0x7f6d8c009c00 comp rx=0 tx=0).stop 2023-07-13T14:22:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 -- 172.21.15.118:0/3772499219 shutdown_connections 2023-07-13T14:22:10.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3772499219 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d9806e040 0x7f6d981583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3772499219 >> v2:172.21.15.123:3300/0 conn(0x7f6d980c6f30 0x7f6d980cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3772499219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d980c9c20 0x7f6d980c7300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 -- 172.21.15.118:0/3772499219 >> 172.21.15.118:0/3772499219 conn(0x7f6d98069f30 msgr2=0x7f6d9806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:10.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 -- 172.21.15.118:0/3772499219 shutdown_connections 2023-07-13T14:22:10.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.572+0000 7f6d9deff700 1 -- 172.21.15.118:0/3772499219 wait complete. 2023-07-13T14:22:10.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.573+0000 7f6d9deff700 1 Processor -- start 2023-07-13T14:22:10.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.574+0000 7f6d9deff700 1 -- start start 2023-07-13T14:22:10.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.574+0000 7f6d9deff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d9806e040 0x7f6d9814c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:10.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.574+0000 7f6d9deff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d980c6f30 0x7f6d980c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:10.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.574+0000 7f6d9deff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980c9c20 0x7f6d980c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:10.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.574+0000 7f6d9deff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98159540 con 0x7f6d9806e040 2023-07-13T14:22:10.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.574+0000 7f6d9deff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9814c8b0 con 0x7f6d980c9c20 2023-07-13T14:22:10.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.574+0000 7f6d9deff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98159770 con 0x7f6d980c6f30 2023-07-13T14:22:10.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.575+0000 7f6d96ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d980c6f30 0x7f6d980c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:10.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.575+0000 7f6d96ffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d980c6f30 0x7f6d980c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.118:43956/0 (socket says 172.21.15.118:43956) 2023-07-13T14:22:10.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.575+0000 7f6d96ffd700 1 -- 172.21.15.118:0/3834852496 learned_addr learned my addr 172.21.15.118:0/3834852496 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.579+0000 7f6d96ffd700 1 -- 172.21.15.118:0/3834852496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980c9c20 msgr2=0x7f6d980c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:10.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.579+0000 7f6d96ffd700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980c9c20 0x7f6d980c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.579+0000 7f6d96ffd700 1 -- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d9806e040 msgr2=0x7f6d9814c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.579+0000 7f6d96ffd700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d9806e040 0x7f6d9814c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:10.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.579+0000 7f6d96ffd700 1 -- 172.21.15.118:0/3834852496 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009550 con 0x7f6d980c6f30 2023-07-13T14:22:10.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.581+0000 7f6d96ffd700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d980c6f30 0x7f6d980c5d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0098f0 tx=0x7f6d8c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.585+0000 7f6d7ffff700 1 -- 172.21.15.118:0/3834852496 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0036a0 con 0x7f6d980c6f30 2023-07-13T14:22:10.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.585+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d98159a30 con 0x7f6d980c6f30 2023-07-13T14:22:10.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.585+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d981f17a0 con 0x7f6d980c6f30 2023-07-13T14:22:10.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.586+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d980743c0 con 0x7f6d980c6f30 2023-07-13T14:22:10.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.894+0000 7f6d7ffff700 1 -- 172.21.15.118:0/3834852496 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6d8c01e070 con 0x7f6d980c6f30 2023-07-13T14:22:10.885 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.894+0000 7f6d7ffff700 1 -- 172.21.15.118:0/3834852496 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c003a00 con 0x7f6d980c6f30 2023-07-13T14:22:10.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.894+0000 7f6d7ffff700 1 -- 172.21.15.118:0/3834852496 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d8c003ba0 con 0x7f6d980c6f30 2023-07-13T14:22:10.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.895+0000 7f6d7ffff700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6d8406ace0 0x7f6d8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:10.886 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.895+0000 7f6d977fe700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6d8406ace0 0x7f6d8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:10.887 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.895+0000 7f6d977fe700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6d8406ace0 0x7f6d8406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009ae0 tx=0x7f6d880095a0 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:10.890 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.899+0000 7f6d7ffff700 1 -- 172.21.15.118:0/3834852496 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d8c02c3b0 con 0x7f6d980c6f30 2023-07-13T14:22:10.900 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:10.909+0000 7f6d7ffff700 1 -- 172.21.15.118:0/3834852496 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6d8c055940 con 0x7f6d980c6f30 2023-07-13T14:22:11.131 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.140+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d98159c20 con 0x7f6d980c6f30 2023-07-13T14:22:11.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.155+0000 7f6d7ffff700 1 -- 172.21.15.118:0/3834852496 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6197 (secure 0 0 0) 0x7f6d98159c20 con 0x7f6d980c6f30 2023-07-13T14:22:11.146 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:22:11.147 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1760692596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1760692596},{"type":"v1","addr":"172.21.15.118:6835","nonce":1760692596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3512155037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3512155037},{"type":"v1","addr":"172.21.15.123:6833","nonce":3512155037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/439561314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":439561314},{"type":"v1","addr":"172.21.15.123:6835","nonce":439561314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2359037201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2359037201},{"type":"v1","addr":"172.21.15.123:6837","nonce":2359037201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6839/3040631544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6838","nonce":3040631544},{"type":"v1","addr":"172.21.15.118:6839","nonce":3040631544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-13T13:52:17.418144+0000","modified":"2023-07-13T13:52:47.871510+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4321":{"gid":4321,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.118:6837/3588922803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":3588922803},{"type":"v1","addr":"172.21.15.118:6837","nonce":3588922803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-13T14:22:11.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6d8406ace0 msgr2=0x7f6d8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6d8406ace0 0x7f6d8406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009ae0 tx=0x7f6d880095a0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d980c6f30 msgr2=0x7f6d980c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d980c6f30 0x7f6d980c5d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0098f0 tx=0x7f6d8c004750 comp rx=0 tx=0).stop 2023-07-13T14:22:11.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 shutdown_connections 2023-07-13T14:22:11.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f6d8406ace0 0x7f6d8406d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d980c9c20 0x7f6d980c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6d9806e040 0x7f6d9814c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 --2- 172.21.15.118:0/3834852496 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6d980c6f30 0x7f6d980c5d50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 >> 172.21.15.118:0/3834852496 conn(0x7f6d98069f30 msgr2=0x7f6d98151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:11.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 shutdown_connections 2023-07-13T14:22:11.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.157+0000 7f6d9deff700 1 -- 172.21.15.118:0/3834852496 wait complete. 2023-07-13T14:22:11.151 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 10 2023-07-13T14:22:11.161 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-13T14:22:11.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.299+0000 7fb6ffc25700 1 Processor -- start 2023-07-13T14:22:11.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.299+0000 7fb6ffc25700 1 -- start start 2023-07-13T14:22:11.291 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.300+0000 7fb6ffc25700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6f814ed20 0x7fb6f80c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.300+0000 7fb6ffc25700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f8070fb0 con 0x7fb6f80c5f20 2023-07-13T14:22:11.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.300+0000 7fb6ffc25700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f806fc70 con 0x7fb6f80caf30 2023-07-13T14:22:11.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.300+0000 7fb6ffc25700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f80c1ab0 con 0x7fb6f814ed20 2023-07-13T14:22:11.292 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.301+0000 7fb6fe1c2700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb6f80c5f20 0x7fb6f815f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:50552/0 (socket says 172.21.15.118:50552) 2023-07-13T14:22:11.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.301+0000 7fb6fe1c2700 1 -- 172.21.15.118:0/716280094 learned_addr learned my addr 172.21.15.118:0/716280094 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:22:11.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.301+0000 7fb6fd9c1700 1 --2- 172.21.15.118:0/716280094 >> v2:172.21.15.123:3300/0 conn(0x7fb6f814ed20 0x7fb6f80c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.304+0000 7fb6fc9bf700 1 -- 172.21.15.118:0/716280094 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263827723 0 0) 0x7fb6f8070fb0 con 0x7fb6f80c5f20 2023-07-13T14:22:11.295 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.304+0000 7fb6fc9bf700 1 -- 172.21.15.118:0/716280094 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e40057c0 con 0x7fb6f80c5f20 2023-07-13T14:22:11.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.304+0000 7fb6fd9c1700 1 -- 172.21.15.118:0/716280094 >> v1:172.21.15.123:6789/0 conn(0x7fb6f80caf30 legacy=0x7fb6f8070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:11.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.304+0000 7fb6fd9c1700 1 -- 172.21.15.118:0/716280094 >> v1:172.21.15.118:6789/0 conn(0x7fb6f80c5f20 legacy=0x7fb6f815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.304+0000 7fb6fd9c1700 1 -- 172.21.15.118:0/716280094 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f814f0f0 con 0x7fb6f814ed20 2023-07-13T14:22:11.299 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.308+0000 7fb6fd9c1700 1 --2- 172.21.15.118:0/716280094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f80c4400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009840 tx=0x7fb6e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14c23072deed3130 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:11.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.314+0000 7fb6fc9bf700 1 -- 172.21.15.118:0/716280094 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8004230 con 0x7fb6f814ed20 2023-07-13T14:22:11.305 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.314+0000 7fb6fc9bf700 1 -- 172.21.15.118:0/716280094 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb6e8004390 con 0x7fb6f814ed20 2023-07-13T14:22:11.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.314+0000 7fb6fc9bf700 1 -- 172.21.15.118:0/716280094 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80036e0 con 0x7fb6f814ed20 2023-07-13T14:22:11.306 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.315+0000 7fb6ffc25700 1 -- 172.21.15.118:0/716280094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 msgr2=0x7fb6f80c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.315+0000 7fb6ffc25700 1 --2- 172.21.15.118:0/716280094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f80c4400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009840 tx=0x7fb6e8009b50 comp rx=0 tx=0).stop 2023-07-13T14:22:11.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.315+0000 7fb6ffc25700 1 -- 172.21.15.118:0/716280094 shutdown_connections 2023-07-13T14:22:11.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.315+0000 7fb6ffc25700 1 --2- 172.21.15.118:0/716280094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f80c4400 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.315+0000 7fb6ffc25700 1 -- 172.21.15.118:0/716280094 >> 172.21.15.118:0/716280094 conn(0x7fb6f806d830 msgr2=0x7fb6f806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:11.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.315+0000 7fb6ffc25700 1 -- 172.21.15.118:0/716280094 shutdown_connections 2023-07-13T14:22:11.307 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.315+0000 7fb6ffc25700 1 -- 172.21.15.118:0/716280094 wait complete. 2023-07-13T14:22:11.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.316+0000 7fb6ffc25700 1 Processor -- start 2023-07-13T14:22:11.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.316+0000 7fb6ffc25700 1 -- start start 2023-07-13T14:22:11.308 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.317+0000 7fb6ffc25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6f80c5f20 0x7fb6f814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.317+0000 7fb6ffc25700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6f80caf30 0x7fb6f81540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.317+0000 7fb6ffc25700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f81446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.317+0000 7fb6ffc25700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f8155a50 con 0x7fb6f80c5f20 2023-07-13T14:22:11.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.317+0000 7fb6ffc25700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81554d0 con 0x7fb6f814ed20 2023-07-13T14:22:11.309 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.317+0000 7fb6ffc25700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f8155770 con 0x7fb6f80caf30 2023-07-13T14:22:11.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.317+0000 7fb6fe1c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f81446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.318+0000 7fb6fd1c0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6f80caf30 0x7fb6f81540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.310 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.318+0000 7fb6fe1c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f81446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:35312/0 (socket says 172.21.15.118:35312) 2023-07-13T14:22:11.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.318+0000 7fb6fe1c2700 1 -- 172.21.15.118:0/3645456667 learned_addr learned my addr 172.21.15.118:0/3645456667 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:11.311 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.318+0000 7fb6fd9c1700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6f80c5f20 0x7fb6f814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.322+0000 7fb6fe1c2700 1 -- 172.21.15.118:0/3645456667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6f80caf30 msgr2=0x7fb6f81540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.322+0000 7fb6fe1c2700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6f80caf30 0x7fb6f81540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.313 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.322+0000 7fb6fe1c2700 1 -- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6f80c5f20 msgr2=0x7fb6f814fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.322+0000 7fb6fe1c2700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6f80c5f20 0x7fb6f814fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.314 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.322+0000 7fb6fe1c2700 1 -- 172.21.15.118:0/3645456667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e80094a0 con 0x7fb6f814ed20 2023-07-13T14:22:11.316 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.324+0000 7fb6fe1c2700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f81446c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000caa0 tx=0x7fb6f000cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:11.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.328+0000 7fb6ee7fc700 1 -- 172.21.15.118:0/3645456667 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000a9e0 con 0x7fb6f814ed20 2023-07-13T14:22:11.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.328+0000 7fb6ee7fc700 1 -- 172.21.15.118:0/3645456667 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb6f000ab40 con 0x7fb6f814ed20 2023-07-13T14:22:11.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.328+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f8153610 con 0x7fb6f814ed20 2023-07-13T14:22:11.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.328+0000 7fb6ee7fc700 1 -- 172.21.15.118:0/3645456667 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0012400 con 0x7fb6f814ed20 2023-07-13T14:22:11.320 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.328+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f8153bd0 con 0x7fb6f814ed20 2023-07-13T14:22:11.321 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.329+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f80743c0 con 0x7fb6f814ed20 2023-07-13T14:22:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.348+0000 7fb6ee7fc700 1 -- 172.21.15.118:0/3645456667 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6f001b3b0 con 0x7fb6f814ed20 2023-07-13T14:22:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.349+0000 7fb6ee7fc700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb6dc06ad30 0x7fb6dc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.340 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.349+0000 7fb6fd9c1700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb6dc06ad30 0x7fb6dc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.341 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.349+0000 7fb6fd9c1700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb6dc06ad30 0x7fb6dc06d1e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80090b0 tx=0x7fb6e8010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:11.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.544+0000 7fb6ee7fc700 1 -- 172.21.15.118:0/3645456667 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb6f0007b40 con 0x7fb6f814ed20 2023-07-13T14:22:11.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.594+0000 7fb6ee7fc700 1 -- 172.21.15.118:0/3645456667 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6f00546e0 con 0x7fb6f814ed20 2023-07-13T14:22:11.783 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.792+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6f8070250 con 0x7fb6f814ed20 2023-07-13T14:22:11.844 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.852+0000 7fb6ee7fc700 1 -- 172.21.15.118:0/3645456667 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20252 (secure 0 0 0) 0x7fb6f0017090 con 0x7fb6f814ed20 2023-07-13T14:22:11.844 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-13T14:22:11.844 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":31,"fsid":"1835fe1d-409c-4aad-9a14-d592cbe8c9c2","created":"2023-07-13T13:51:40.626569+0000","modified":"2023-07-13T13:52:57.795549+0000","last_up_change":"2023-07-13T13:51:55.598839+0000","last_in_change":"2023-07-13T13:51:46.930035+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-13T13:51:55.327381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-13T13:51:57.354158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-13T13:52:15.149076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-13T13:52:16.169659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-13T13:52:21.744112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f3621acd-3f8b-4f13-842f-b77d2af53155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6819","nonce":724794801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6822","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6825","nonce":724794801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6831","nonce":724794801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":724794801},{"type":"v1","addr":"172.21.15.118:6829","nonce":724794801}]},"public_addr":"172.21.15.118:6819/724794801","cluster_addr":"172.21.15.118:6825/724794801","heartbeat_back_addr":"172.21.15.118:6831/724794801","heartbeat_front_addr":"172.21.15.118:6829/724794801","state":["exists","up"]},{"osd":1,"uuid":"8c95fa14-1c18-4706-8f63-f39c33c31218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6801","nonce":1775143218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6803","nonce":1775143218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6807","nonce":1775143218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1775143218},{"type":"v1","addr":"172.21.15.118:6805","nonce":1775143218}]},"public_addr":"172.21.15.118:6801/1775143218","cluster_addr":"172.21.15.118:6803/1775143218","heartbeat_back_addr":"172.21.15.118:6807/1775143218","heartbeat_front_addr":"172.21.15.118:6805/1775143218","state":["exists","up"]},{"osd":2,"uuid":"440590bc-7a10-4ddb-b42c-f77cbd1d914d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6810","nonce":3477414536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6815","nonce":3477414536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6827","nonce":3477414536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":3477414536},{"type":"v1","addr":"172.21.15.118:6821","nonce":3477414536}]},"public_addr":"172.21.15.118:6810/3477414536","cluster_addr":"172.21.15.118:6815/3477414536","heartbeat_back_addr":"172.21.15.118:6827/3477414536","heartbeat_front_addr":"172.21.15.118:6821/3477414536","state":["exists","up"]},{"osd":3,"uuid":"f0d830ad-d6c9-4d6c-aa48-c354454d4657","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6811","nonce":3059213709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6814","nonce":3059213709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6823","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6826","nonce":3059213709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":3059213709},{"type":"v1","addr":"172.21.15.118:6820","nonce":3059213709}]},"public_addr":"172.21.15.118:6811/3059213709","cluster_addr":"172.21.15.118:6814/3059213709","heartbeat_back_addr":"172.21.15.118:6826/3059213709","heartbeat_front_addr":"172.21.15.118:6820/3059213709","state":["exists","up"]},{"osd":4,"uuid":"ebf94a9d-f1d8-4b84-a42e-c08b4842272c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6809","nonce":1567879638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6811","nonce":1567879638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6815","nonce":1567879638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1567879638},{"type":"v1","addr":"172.21.15.123:6813","nonce":1567879638}]},"public_addr":"172.21.15.123:6809/1567879638","cluster_addr":"172.21.15.123:6811/1567879638","heartbeat_back_addr":"172.21.15.123:6815/1567879638","heartbeat_front_addr":"172.21.15.123:6813/1567879638","state":["exists","up"]},{"osd":5,"uuid":"c6b6800f-c001-406d-8677-d60d889f5c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6817","nonce":3894697051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6819","nonce":3894697051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6823","nonce":3894697051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3894697051},{"type":"v1","addr":"172.21.15.123:6821","nonce":3894697051}]},"public_addr":"172.21.15.123:6817/3894697051","cluster_addr":"172.21.15.123:6819/3894697051","heartbeat_back_addr":"172.21.15.123:6823/3894697051","heartbeat_front_addr":"172.21.15.123:6821/3894697051","state":["exists","up"]},{"osd":6,"uuid":"4d277993-aa04-4411-9955-36f262d9c671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6801","nonce":381173612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6803","nonce":381173612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6807","nonce":381173612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":381173612},{"type":"v1","addr":"172.21.15.123:6805","nonce":381173612}]},"public_addr":"172.21.15.123:6801/381173612","cluster_addr":"172.21.15.123:6803/381173612","heartbeat_back_addr":"172.21.15.123:6807/381173612","heartbeat_front_addr":"172.21.15.123:6805/381173612","state":["exists","up"]},{"osd":7,"uuid":"6e123750-7e4c-4c05-ad3a-cce706495fd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6825","nonce":4183445338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6827","nonce":4183445338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6831","nonce":4183445338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4183445338},{"type":"v1","addr":"172.21.15.123:6829","nonce":4183445338}]},"public_addr":"172.21.15.123:6825/4183445338","cluster_addr":"172.21.15.123:6827/4183445338","heartbeat_back_addr":"172.21.15.123:6831/4183445338","heartbeat_front_addr":"172.21.15.123:6829/4183445338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.967706+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:51.893270+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.199651+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.220533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.118393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.170698+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.081704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-13T13:51:52.214095+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.35","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-13T14:22:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb6dc06ad30 msgr2=0x7fb6dc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb6dc06ad30 0x7fb6dc06d1e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80090b0 tx=0x7fb6e8010000 comp rx=0 tx=0).stop 2023-07-13T14:22:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 msgr2=0x7fb6f81446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f81446c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000caa0 tx=0x7fb6f000cdb0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 shutdown_connections 2023-07-13T14:22:11.847 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fb6dc06ad30 0x7fb6dc06d1e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6f814ed20 0x7fb6f81446c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6f80c5f20 0x7fb6f814fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 --2- 172.21.15.118:0/3645456667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb6f80caf30 0x7fb6f81540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 >> 172.21.15.118:0/3645456667 conn(0x7fb6f806d830 msgr2=0x7fb6f8070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 shutdown_connections 2023-07-13T14:22:11.848 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.855+0000 7fb6ffc25700 1 -- 172.21.15.118:0/3645456667 wait complete. 2023-07-13T14:22:11.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-13T14:22:11.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.991+0000 7f9200e69700 1 Processor -- start 2023-07-13T14:22:11.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.991+0000 7f9200e69700 1 -- start start 2023-07-13T14:22:11.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.992+0000 7f9200e69700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f91fc152850 0x7f91fc06f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.992+0000 7f9200e69700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc0c5d90 0x7f91fc1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.992+0000 7f9200e69700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91fc06eaa0 0x7f91fc0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.992+0000 7f9200e69700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc0c6c60 con 0x7f91fc152850 2023-07-13T14:22:11.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.992+0000 7f9200e69700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc0c66a0 con 0x7f91fc06eaa0 2023-07-13T14:22:11.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.992+0000 7f9200e69700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0c6980 con 0x7f91fc0c5d90 2023-07-13T14:22:11.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.993+0000 7f91fa59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f91fc152850 0x7f91fc06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.993+0000 7f91fad9d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91fc06eaa0 0x7f91fc0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.985 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.993+0000 7f91f9d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc0c5d90 0x7f91fc1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.993+0000 7f91fa59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f91fc152850 0x7f91fc06f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50314/0 (socket says 172.21.15.118:50314) 2023-07-13T14:22:11.986 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.993+0000 7f91fa59c700 1 -- 172.21.15.118:0/2902614758 learned_addr learned my addr 172.21.15.118:0/2902614758 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:11.987 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.996+0000 7f91fa59c700 1 -- 172.21.15.118:0/2902614758 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc0c5d90 msgr2=0x7f91fc1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:11.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.996+0000 7f91fa59c700 1 --2- 172.21.15.118:0/2902614758 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc0c5d90 0x7f91fc1590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.996+0000 7f91fa59c700 1 -- 172.21.15.118:0/2902614758 >> v2:172.21.15.123:3300/0 conn(0x7f91fc06eaa0 msgr2=0x7f91fc0c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:11.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.996+0000 7f91fa59c700 1 --2- 172.21.15.118:0/2902614758 >> v2:172.21.15.123:3300/0 conn(0x7f91fc06eaa0 0x7f91fc0c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.996+0000 7f91fa59c700 1 -- 172.21.15.118:0/2902614758 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc06e2a0 con 0x7f91fc152850 2023-07-13T14:22:11.989 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:11.998+0000 7f91fa59c700 1 --2- 172.21.15.118:0/2902614758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 0x7f91fc06f380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f91fc15cd00 tx=0x7f91f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45539fc9d4f19a74 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:11.991 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.000+0000 7f91f959a700 1 -- 172.21.15.118:0/2902614758 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011830 con 0x7f91fc152850 2023-07-13T14:22:11.993 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.002+0000 7f91f959a700 1 -- 172.21.15.118:0/2902614758 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f91f0011990 con 0x7f91fc152850 2023-07-13T14:22:11.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.002+0000 7f91f959a700 1 -- 172.21.15.118:0/2902614758 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011d40 con 0x7f91fc152850 2023-07-13T14:22:11.994 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 -- 172.21.15.118:0/2902614758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 msgr2=0x7f91fc06f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:11.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 --2- 172.21.15.118:0/2902614758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 0x7f91fc06f380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f91fc15cd00 tx=0x7f91f0009bd0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 -- 172.21.15.118:0/2902614758 shutdown_connections 2023-07-13T14:22:11.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 --2- 172.21.15.118:0/2902614758 >> v2:172.21.15.123:3300/0 conn(0x7f91fc06eaa0 0x7f91fc0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 --2- 172.21.15.118:0/2902614758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 0x7f91fc06f380 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 --2- 172.21.15.118:0/2902614758 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc0c5d90 0x7f91fc1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:11.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 -- 172.21.15.118:0/2902614758 >> 172.21.15.118:0/2902614758 conn(0x7f91fc070d40 msgr2=0x7f91fc071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:11.995 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 -- 172.21.15.118:0/2902614758 shutdown_connections 2023-07-13T14:22:11.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.003+0000 7f9200e69700 1 -- 172.21.15.118:0/2902614758 wait complete. 2023-07-13T14:22:11.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.004+0000 7f9200e69700 1 Processor -- start 2023-07-13T14:22:11.996 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.004+0000 7f9200e69700 1 -- start start 2023-07-13T14:22:11.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.005+0000 7f9200e69700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc06eaa0 0x7f91fc1eec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.005+0000 7f9200e69700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91fc0c5d90 0x7f91fc159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.005+0000 7f9200e69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 0x7f91fc0c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:11.997 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.005+0000 7f9200e69700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0c44e0 con 0x7f91fc152850 2023-07-13T14:22:11.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.005+0000 7f9200e69700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0c47c0 con 0x7f91fc0c5d90 2023-07-13T14:22:11.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.005+0000 7f9200e69700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc1ee140 con 0x7f91fc06eaa0 2023-07-13T14:22:11.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.006+0000 7f91fad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 0x7f91fc0c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.998 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.006+0000 7f91f9d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91fc0c5d90 0x7f91fc159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.006+0000 7f91fa59c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc06eaa0 0x7f91fc1eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:11.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.006+0000 7f91fad9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 0x7f91fc0c72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50330/0 (socket says 172.21.15.118:50330) 2023-07-13T14:22:11.999 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.006+0000 7f91fad9d700 1 -- 172.21.15.118:0/2919256061 learned_addr learned my addr 172.21.15.118:0/2919256061 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:12.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.010+0000 7f91fa59c700 1 -- 172.21.15.118:0/2919256061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91fc0c5d90 msgr2=0x7f91fc159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:12.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.010+0000 7f91fa59c700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91fc0c5d90 0x7f91fc159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.010+0000 7f91fa59c700 1 -- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 msgr2=0x7f91fc0c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:12.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.010+0000 7f91fa59c700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 0x7f91fc0c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.002 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.010+0000 7f91fa59c700 1 -- 172.21.15.118:0/2919256061 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f0009550 con 0x7f91fc06eaa0 2023-07-13T14:22:12.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.010+0000 7f91f9d9b700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91fc0c5d90 0x7f91fc159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-13T14:22:12.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.013+0000 7f91fa59c700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc06eaa0 0x7f91fc1eec20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f91f0016000 tx=0x7f91f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:12.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.017+0000 7f91eaffd700 1 -- 172.21.15.118:0/2919256061 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0004450 con 0x7f91fc06eaa0 2023-07-13T14:22:12.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.017+0000 7f91eaffd700 1 -- 172.21.15.118:0/2919256061 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f91f001e070 con 0x7f91fc06eaa0 2023-07-13T14:22:12.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.017+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc1ee420 con 0x7f91fc06eaa0 2023-07-13T14:22:12.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.017+0000 7f91eaffd700 1 -- 172.21.15.118:0/2919256061 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0003900 con 0x7f91fc06eaa0 2023-07-13T14:22:12.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.017+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc0c9610 con 0x7f91fc06eaa0 2023-07-13T14:22:12.010 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.018+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc04e280 con 0x7f91fc06eaa0 2023-07-13T14:22:12.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.263+0000 7f91eaffd700 1 -- 172.21.15.118:0/2919256061 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91f0003a60 con 0x7f91fc06eaa0 2023-07-13T14:22:12.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.263+0000 7f91eaffd700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f91dc06ad30 0x7f91dc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:12.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.263+0000 7f91f9d9b700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f91dc06ad30 0x7f91dc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:12.255 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.264+0000 7f91f9d9b700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f91dc06ad30 0x7f91dc06d1e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91fc071330 tx=0x7f91ec009210 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:12.259 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.267+0000 7f91eaffd700 1 -- 172.21.15.118:0/2919256061 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f91f005d380 con 0x7f91fc06eaa0 2023-07-13T14:22:12.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.277+0000 7f91eaffd700 1 -- 172.21.15.118:0/2919256061 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91f0055700 con 0x7f91fc06eaa0 2023-07-13T14:22:12.497 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.506+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f91fc0c6300 con 0x7f91fc06eaa0 2023-07-13T14:22:12.789 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.798+0000 7f91eaffd700 1 -- 172.21.15.118:0/2919256061 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f91f0020090 con 0x7f91fc06eaa0 2023-07-13T14:22:12.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f91dc06ad30 msgr2=0x7f91dc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:12.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f91dc06ad30 0x7f91dc06d1e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91fc071330 tx=0x7f91ec009210 comp rx=0 tx=0).stop 2023-07-13T14:22:12.792 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc06eaa0 msgr2=0x7f91fc1eec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:12.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc06eaa0 0x7f91fc1eec20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f91f0016000 tx=0x7f91f0004750 comp rx=0 tx=0).stop 2023-07-13T14:22:12.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 shutdown_connections 2023-07-13T14:22:12.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7f91dc06ad30 0x7f91dc06d1e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91fc152850 0x7f91fc0c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91fc06eaa0 0x7f91fc1eec20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 --2- 172.21.15.118:0/2919256061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91fc0c5d90 0x7f91fc159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.793 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 >> 172.21.15.118:0/2919256061 conn(0x7f91fc070d40 msgr2=0x7f91fc0ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:12.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 shutdown_connections 2023-07-13T14:22:12.794 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.800+0000 7f9200e69700 1 -- 172.21.15.118:0/2919256061 wait complete. 2023-07-13T14:22:12.794 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-13T14:22:12.806 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-13T14:22:12.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.940+0000 7efd7216c700 1 Processor -- start 2023-07-13T14:22:12.932 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.940+0000 7efd7216c700 1 -- start start 2023-07-13T14:22:12.933 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.941+0000 7efd7216c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd6c1507d0 0x7efd6c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:12.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.941+0000 7efd7216c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efd6c0c6fc0 0x7efd6c0c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:12.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.941+0000 7efd7216c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c0c7900 con 0x7efd6c1565e0 2023-07-13T14:22:12.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.941+0000 7efd7216c700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c0c1820 con 0x7efd6c0c6fc0 2023-07-13T14:22:12.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.941+0000 7efd7216c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c0c1b00 con 0x7efd6c1507d0 2023-07-13T14:22:12.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.941+0000 7efd6b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd6c1507d0 0x7efd6c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:12.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.942+0000 7efd6bfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efd6c0c6fc0 0x7efd6c0c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:12.934 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.942+0000 7efd6b7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd6c1507d0 0x7efd6c15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:35328/0 (socket says 172.21.15.118:35328) 2023-07-13T14:22:12.935 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.942+0000 7efd6b7fe700 1 -- 172.21.15.118:0/1900404243 learned_addr learned my addr 172.21.15.118:0/1900404243 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:12.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.945+0000 7efd6b7fe700 1 -- 172.21.15.118:0/1900404243 >> v2:172.21.15.118:3300/0 conn(0x7efd6c0c6fc0 msgr2=0x7efd6c0c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:12.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.945+0000 7efd6b7fe700 1 --2- 172.21.15.118:0/1900404243 >> v2:172.21.15.118:3300/0 conn(0x7efd6c0c6fc0 0x7efd6c0c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.937 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.945+0000 7efd6b7fe700 1 -- 172.21.15.118:0/1900404243 >> v1:172.21.15.123:6789/0 conn(0x7efd6c1565e0 legacy=0x7efd6c06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:12.938 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.946+0000 7efd6b7fe700 1 -- 172.21.15.118:0/1900404243 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0c1de0 con 0x7efd6c1507d0 2023-07-13T14:22:12.939 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.948+0000 7efd6b7fe700 1 --2- 172.21.15.118:0/1900404243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c15a500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd6c071cd0 tx=0x7efd5c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de7df20bc347902e server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:12.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.955+0000 7efd6a7fc700 1 -- 172.21.15.118:0/1900404243 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c011830 con 0x7efd6c1507d0 2023-07-13T14:22:12.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.955+0000 7efd6a7fc700 1 -- 172.21.15.118:0/1900404243 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efd5c011990 con 0x7efd6c1507d0 2023-07-13T14:22:12.947 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.955+0000 7efd6a7fc700 1 -- 172.21.15.118:0/1900404243 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c011d40 con 0x7efd6c1507d0 2023-07-13T14:22:12.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.956+0000 7efd7216c700 1 -- 172.21.15.118:0/1900404243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 msgr2=0x7efd6c15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:12.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.956+0000 7efd7216c700 1 --2- 172.21.15.118:0/1900404243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c15a500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd6c071cd0 tx=0x7efd5c009bd0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.956+0000 7efd7216c700 1 -- 172.21.15.118:0/1900404243 shutdown_connections 2023-07-13T14:22:12.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.956+0000 7efd7216c700 1 --2- 172.21.15.118:0/1900404243 >> v2:172.21.15.118:3300/0 conn(0x7efd6c0c6fc0 0x7efd6c0c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.948 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.956+0000 7efd7216c700 1 --2- 172.21.15.118:0/1900404243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c15a500 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.956+0000 7efd7216c700 1 -- 172.21.15.118:0/1900404243 >> 172.21.15.118:0/1900404243 conn(0x7efd6c06e060 msgr2=0x7efd6c06eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:12.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.956+0000 7efd7216c700 1 -- 172.21.15.118:0/1900404243 shutdown_connections 2023-07-13T14:22:12.949 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.956+0000 7efd7216c700 1 -- 172.21.15.118:0/1900404243 wait complete. 2023-07-13T14:22:12.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.957+0000 7efd7216c700 1 Processor -- start 2023-07-13T14:22:12.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.957+0000 7efd7216c700 1 -- start start 2023-07-13T14:22:12.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.958+0000 7efd7216c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd6c0c6fc0 0x7efd6c1483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:12.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.958+0000 7efd7216c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:12.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.958+0000 7efd7216c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd6c1565e0 0x7efd6c0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:12.950 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.958+0000 7efd7216c700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c5100 con 0x7efd6c0c6fc0 2023-07-13T14:22:12.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.958+0000 7efd7216c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1488e0 con 0x7efd6c1507d0 2023-07-13T14:22:12.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.958+0000 7efd7216c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c06c9c0 con 0x7efd6c1565e0 2023-07-13T14:22:12.951 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.959+0000 7efd6b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd6c0c6fc0 0x7efd6c1483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:12.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.959+0000 7efd6bfff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd6c1565e0 0x7efd6c0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:12.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.959+0000 7efd6affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:12.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.959+0000 7efd6affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c0c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:35344/0 (socket says 172.21.15.118:35344) 2023-07-13T14:22:12.952 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.959+0000 7efd6affd700 1 -- 172.21.15.118:0/1716250230 learned_addr learned my addr 172.21.15.118:0/1716250230 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.963+0000 7efd6affd700 1 -- 172.21.15.118:0/1716250230 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd6c1565e0 msgr2=0x7efd6c0c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.963+0000 7efd6affd700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd6c1565e0 0x7efd6c0c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.963+0000 7efd6affd700 1 -- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd6c0c6fc0 msgr2=0x7efd6c1483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.963+0000 7efd6affd700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd6c0c6fc0 0x7efd6c1483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:12.955 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.963+0000 7efd6affd700 1 -- 172.21.15.118:0/1716250230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c009550 con 0x7efd6c1507d0 2023-07-13T14:22:12.958 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.966+0000 7efd6affd700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c0c5520 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c430 tx=0x7efd6000c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:12.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.970+0000 7efd53fff700 1 -- 172.21.15.118:0/1716250230 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600050d0 con 0x7efd6c1507d0 2023-07-13T14:22:12.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.970+0000 7efd53fff700 1 -- 172.21.15.118:0/1716250230 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efd60005250 con 0x7efd6c1507d0 2023-07-13T14:22:12.962 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.970+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c06cca0 con 0x7efd6c1507d0 2023-07-13T14:22:12.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.970+0000 7efd53fff700 1 -- 172.21.15.118:0/1716250230 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60006860 con 0x7efd6c1507d0 2023-07-13T14:22:12.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.971+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c0700f0 con 0x7efd6c1507d0 2023-07-13T14:22:12.963 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:12.972+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c06cee0 con 0x7efd6c1507d0 2023-07-13T14:22:13.212 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:13.220+0000 7efd53fff700 1 -- 172.21.15.118:0/1716250230 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd60003680 con 0x7efd6c1507d0 2023-07-13T14:22:13.212 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:13.221+0000 7efd53fff700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efd5806ace0 0x7efd5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:13.213 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:13.221+0000 7efd6b7fe700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efd5806ace0 0x7efd5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:13.213 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:13.221+0000 7efd6b7fe700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efd5806ace0 0x7efd5806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009840 tx=0x7efd5c01d040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:13.218 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:13.227+0000 7efd53fff700 1 -- 172.21.15.118:0/1716250230 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7efd6005b670 con 0x7efd6c1507d0 2023-07-13T14:22:13.228 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:13.236+0000 7efd53fff700 1 -- 172.21.15.118:0/1716250230 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efd600539f0 con 0x7efd6c1507d0 2023-07-13T14:22:13.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:13.479+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efd6c0c7900 con 0x7efd6c1507d0 2023-07-13T14:22:13.726 INFO:tasks.ceph.mds.e.smithi118.stderr:==00:00:30:13.882 150840== 2023-07-13T14:22:13.727 INFO:tasks.ceph.mds.e.smithi118.stderr:==00:00:30:13.882 150840== Exit program on first error (--exit-on-first-error=yes) 2023-07-13T14:22:13.816 INFO:tasks.ceph.mds.e.smithi118.stderr:daemon-helper: command failed with exit status 42 2023-07-13T14:22:14.040 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.049+0000 7efd53fff700 1 -- 172.21.15.118:0/1716250230 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7efd6c0c7900 con 0x7efd6c1507d0 2023-07-13T14:22:14.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efd5806ace0 msgr2=0x7efd5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:14.043 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efd5806ace0 0x7efd5806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009840 tx=0x7efd5c01d040 comp rx=0 tx=0).stop 2023-07-13T14:22:14.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 msgr2=0x7efd6c0c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:14.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c0c5520 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c430 tx=0x7efd6000c740 comp rx=0 tx=0).stop 2023-07-13T14:22:14.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 shutdown_connections 2023-07-13T14:22:14.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7efd5806ace0 0x7efd5806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.044 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd6c1565e0 0x7efd6c0c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd6c0c6fc0 0x7efd6c1483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 --2- 172.21.15.118:0/1716250230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd6c1507d0 0x7efd6c0c5520 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 >> 172.21.15.118:0/1716250230 conn(0x7efd6c06e060 msgr2=0x7efd6c1551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:14.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.051+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 shutdown_connections 2023-07-13T14:22:14.045 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.052+0000 7efd7216c700 1 -- 172.21.15.118:0/1716250230 wait complete. 2023-07-13T14:22:14.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-13T14:22:14.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.190+0000 7fabef83d700 1 Processor -- start 2023-07-13T14:22:14.181 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.190+0000 7fabef83d700 1 -- start start 2023-07-13T14:22:14.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.191+0000 7fabef83d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fabe8070dd0 0x7fabe8069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:14.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.191+0000 7fabef83d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fabe8158640 0x7fabe806a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:14.182 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.191+0000 7fabef83d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe8158b80 con 0x7fabe8152970 2023-07-13T14:22:14.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.191+0000 7fabef83d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe8158e60 con 0x7fabe8158640 2023-07-13T14:22:14.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.191+0000 7fabef83d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe8159140 con 0x7fabe8070dd0 2023-07-13T14:22:14.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.191+0000 7fabecdd8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fabe8070dd0 0x7fabe8069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:14.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.191+0000 7fabeddda700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fabe8158640 0x7fabe806a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:14.183 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.192+0000 7fabecdd8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fabe8070dd0 0x7fabe8069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:35354/0 (socket says 172.21.15.118:35354) 2023-07-13T14:22:14.184 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.192+0000 7fabecdd8700 1 -- 172.21.15.118:0/415979847 learned_addr learned my addr 172.21.15.118:0/415979847 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:14.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.195+0000 7fabecdd8700 1 -- 172.21.15.118:0/415979847 >> v2:172.21.15.118:3300/0 conn(0x7fabe8158640 msgr2=0x7fabe806a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:14.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.195+0000 7fabecdd8700 1 --2- 172.21.15.118:0/415979847 >> v2:172.21.15.118:3300/0 conn(0x7fabe8158640 0x7fabe806a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.195+0000 7fabecdd8700 1 -- 172.21.15.118:0/415979847 >> v1:172.21.15.118:6789/0 conn(0x7fabe8152970 legacy=0x7fabe8071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:14.186 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.195+0000 7fabecdd8700 1 -- 172.21.15.118:0/415979847 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8159420 con 0x7fabe8070dd0 2023-07-13T14:22:14.188 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.197+0000 7fabecdd8700 1 --2- 172.21.15.118:0/415979847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 0x7fabe8069f30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fabe80cb3c0 tx=0x7fabe4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a40e06dc99a8cf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:14.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.200+0000 7fabdffff700 1 -- 172.21.15.118:0/415979847 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4004230 con 0x7fabe8070dd0 2023-07-13T14:22:14.192 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabdffff700 1 -- 172.21.15.118:0/415979847 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fabe4004390 con 0x7fabe8070dd0 2023-07-13T14:22:14.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabdffff700 1 -- 172.21.15.118:0/415979847 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe40036a0 con 0x7fabe8070dd0 2023-07-13T14:22:14.193 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabef83d700 1 -- 172.21.15.118:0/415979847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 msgr2=0x7fabe8069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabef83d700 1 --2- 172.21.15.118:0/415979847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 0x7fabe8069f30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fabe80cb3c0 tx=0x7fabe4009bd0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabef83d700 1 -- 172.21.15.118:0/415979847 shutdown_connections 2023-07-13T14:22:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabef83d700 1 --2- 172.21.15.118:0/415979847 >> v2:172.21.15.118:3300/0 conn(0x7fabe8158640 0x7fabe806a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabef83d700 1 --2- 172.21.15.118:0/415979847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 0x7fabe8069f30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabef83d700 1 -- 172.21.15.118:0/415979847 >> 172.21.15.118:0/415979847 conn(0x7fabe806cf60 msgr2=0x7fabe806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:14.194 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabef83d700 1 -- 172.21.15.118:0/415979847 shutdown_connections 2023-07-13T14:22:14.195 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.201+0000 7fabef83d700 1 -- 172.21.15.118:0/415979847 wait complete. 2023-07-13T14:22:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.203+0000 7fabef83d700 1 Processor -- start 2023-07-13T14:22:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.203+0000 7fabef83d700 1 -- start start 2023-07-13T14:22:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.203+0000 7fabef83d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 0x7fabe80ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.203+0000 7fabef83d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabe8152970 0x7fabe81492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.203+0000 7fabef83d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fabe8158640 0x7fabe81497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:14.196 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.203+0000 7fabef83d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814d540 con 0x7fabe8152970 2023-07-13T14:22:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.203+0000 7fabef83d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814a110 con 0x7fabe8070dd0 2023-07-13T14:22:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.203+0000 7fabef83d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe814b9d0 con 0x7fabe8158640 2023-07-13T14:22:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.204+0000 7fabecdd8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabe8152970 0x7fabe81492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.204+0000 7fabeddda700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fabe8158640 0x7fabe81497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.204+0000 7fabed5d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 0x7fabe80ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.204+0000 7fabecdd8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabe8152970 0x7fabe81492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50354/0 (socket says 172.21.15.118:50354) 2023-07-13T14:22:14.197 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.204+0000 7fabecdd8700 1 -- 172.21.15.118:0/1590428786 learned_addr learned my addr 172.21.15.118:0/1590428786 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:14.199 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.208+0000 7fabecdd8700 1 -- 172.21.15.118:0/1590428786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fabe8158640 msgr2=0x7fabe81497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.208+0000 7fabecdd8700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fabe8158640 0x7fabe81497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.208+0000 7fabecdd8700 1 -- 172.21.15.118:0/1590428786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 msgr2=0x7fabe80ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.208+0000 7fabecdd8700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 0x7fabe80ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:14.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.208+0000 7fabecdd8700 1 -- 172.21.15.118:0/1590428786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4009550 con 0x7fabe8152970 2023-07-13T14:22:14.202 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.211+0000 7fabecdd8700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabe8152970 0x7fabe81492b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009c10 tx=0x7fabe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:14.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.215+0000 7fabddffb700 1 -- 172.21.15.118:0/1590428786 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4003e60 con 0x7fabe8152970 2023-07-13T14:22:14.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.215+0000 7fabddffb700 1 -- 172.21.15.118:0/1590428786 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fabe4004560 con 0x7fabe8152970 2023-07-13T14:22:14.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.215+0000 7fabddffb700 1 -- 172.21.15.118:0/1590428786 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe4011890 con 0x7fabe8152970 2023-07-13T14:22:14.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.215+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe81eec20 con 0x7fabe8152970 2023-07-13T14:22:14.207 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.215+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe814a360 con 0x7fabe8152970 2023-07-13T14:22:14.208 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.216+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe804e280 con 0x7fabe8152970 2023-07-13T14:22:14.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.481+0000 7fabddffb700 1 -- 172.21.15.118:0/1590428786 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabe402f480 con 0x7fabe8152970 2023-07-13T14:22:14.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.481+0000 7fabddffb700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fabcc06ace0 0x7fabcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:14.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.481+0000 7fabddffb700 1 -- 172.21.15.118:0/1590428786 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fabe408abd0 con 0x7fabe8152970 2023-07-13T14:22:14.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.481+0000 7fabed5d9700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fabcc06ace0 0x7fabcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:14.474 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.481+0000 7fabddffb700 1 -- 172.21.15.118:0/1590428786 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fabe40b63b0 con 0x7fabe8152970 2023-07-13T14:22:14.474 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.482+0000 7fabed5d9700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fabcc06ace0 0x7fabcc06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabd8007fd0 tx=0x7fabd8009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:14.660 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:14.668+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fabe80cc050 con 0x7fabe8152970 2023-07-13T14:22:14.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-07-13T14:22:15.124 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.132+0000 7fabddffb700 1 -- 172.21.15.118:0/1590428786 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7fabe4059370 con 0x7fabe8152970 2023-07-13T14:22:15.126 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fabcc06ace0 msgr2=0x7fabcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:15.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fabcc06ace0 0x7fabcc06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabd8007fd0 tx=0x7fabd8009040 comp rx=0 tx=0).stop 2023-07-13T14:22:15.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabe8152970 msgr2=0x7fabe81492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:15.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabe8152970 0x7fabe81492b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009c10 tx=0x7fabe4004750 comp rx=0 tx=0).stop 2023-07-13T14:22:15.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 shutdown_connections 2023-07-13T14:22:15.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fabcc06ace0 0x7fabcc06d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fabe8070dd0 0x7fabe80ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.127 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fabe8158640 0x7fabe81497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 --2- 172.21.15.118:0/1590428786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fabe8152970 0x7fabe81492b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 >> 172.21.15.118:0/1590428786 conn(0x7fabe806cf60 msgr2=0x7fabe8157000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:15.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 shutdown_connections 2023-07-13T14:22:15.128 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.135+0000 7fabef83d700 1 -- 172.21.15.118:0/1590428786 wait complete. 2023-07-13T14:22:15.128 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2023-07-13T14:22:15.139 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-13T14:22:15.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.280+0000 7fefb9579700 1 Processor -- start 2023-07-13T14:22:15.272 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.280+0000 7fefb9579700 1 -- start start 2023-07-13T14:22:15.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.280+0000 7fefb9579700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fefb4070570 0x7fefb40710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:15.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.280+0000 7fefb9579700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefb414ecc0 0x7fefb4070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:15.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.281+0000 7fefb9579700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb40c7040 con 0x7fefb406abc0 2023-07-13T14:22:15.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.281+0000 7fefb9579700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb4070e80 con 0x7fefb4070570 2023-07-13T14:22:15.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.281+0000 7fefb9579700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40c7320 con 0x7fefb414ecc0 2023-07-13T14:22:15.273 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.281+0000 7fefb2ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fefb4070570 0x7fefb40710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:15.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.281+0000 7fefb27fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefb414ecc0 0x7fefb4070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:15.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.282+0000 7fefb27fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefb414ecc0 0x7fefb4070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:35368/0 (socket says 172.21.15.118:35368) 2023-07-13T14:22:15.274 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.282+0000 7fefb27fc700 1 -- 172.21.15.118:0/911136958 learned_addr learned my addr 172.21.15.118:0/911136958 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:15.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.285+0000 7fefb27fc700 1 -- 172.21.15.118:0/911136958 >> v2:172.21.15.118:3300/0 conn(0x7fefb4070570 msgr2=0x7fefb40710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:15.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.285+0000 7fefb27fc700 1 --2- 172.21.15.118:0/911136958 >> v2:172.21.15.118:3300/0 conn(0x7fefb4070570 0x7fefb40710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.276 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.285+0000 7fefb27fc700 1 -- 172.21.15.118:0/911136958 >> v1:172.21.15.123:6789/0 conn(0x7fefb406abc0 legacy=0x7fefb4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-13T14:22:15.277 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.285+0000 7fefb27fc700 1 -- 172.21.15.118:0/911136958 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40c7600 con 0x7fefb414ecc0 2023-07-13T14:22:15.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.287+0000 7fefb27fc700 1 --2- 172.21.15.118:0/911136958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb414ecc0 0x7fefb4070940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fefa40098f0 tx=0x7fefa4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49aff87a5907a0b server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:15.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.293+0000 7fefb1ffb700 1 -- 172.21.15.118:0/911136958 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4004230 con 0x7fefb414ecc0 2023-07-13T14:22:15.284 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.293+0000 7fefb1ffb700 1 -- 172.21.15.118:0/911136958 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fefa4004390 con 0x7fefb414ecc0 2023-07-13T14:22:15.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.293+0000 7fefb1ffb700 1 -- 172.21.15.118:0/911136958 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40036a0 con 0x7fefb414ecc0 2023-07-13T14:22:15.285 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.294+0000 7fefb9579700 1 -- 172.21.15.118:0/911136958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb414ecc0 msgr2=0x7fefb4070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.294+0000 7fefb9579700 1 --2- 172.21.15.118:0/911136958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb414ecc0 0x7fefb4070940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fefa40098f0 tx=0x7fefa4009c00 comp rx=0 tx=0).stop 2023-07-13T14:22:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.294+0000 7fefb9579700 1 -- 172.21.15.118:0/911136958 shutdown_connections 2023-07-13T14:22:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.294+0000 7fefb9579700 1 --2- 172.21.15.118:0/911136958 >> v2:172.21.15.118:3300/0 conn(0x7fefb4070570 0x7fefb40710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.294+0000 7fefb9579700 1 --2- 172.21.15.118:0/911136958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb414ecc0 0x7fefb4070940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.294+0000 7fefb9579700 1 -- 172.21.15.118:0/911136958 >> 172.21.15.118:0/911136958 conn(0x7fefb406bac0 msgr2=0x7fefb406bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.294+0000 7fefb9579700 1 -- 172.21.15.118:0/911136958 shutdown_connections 2023-07-13T14:22:15.286 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.294+0000 7fefb9579700 1 -- 172.21.15.118:0/911136958 wait complete. 2023-07-13T14:22:15.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.296+0000 7fefb9579700 1 Processor -- start 2023-07-13T14:22:15.287 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.296+0000 7fefb9579700 1 -- start start 2023-07-13T14:22:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.297+0000 7fefb9579700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb406abc0 0x7fefb41ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.297+0000 7fefb9579700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefb4070570 0x7fefb4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.297+0000 7fefb9579700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefb414ecc0 0x7fefb41570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.297+0000 7fefb9579700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4158e60 con 0x7fefb4070570 2023-07-13T14:22:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.297+0000 7fefb9579700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4151ce0 con 0x7fefb406abc0 2023-07-13T14:22:15.289 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.297+0000 7fefb9579700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb41566d0 con 0x7fefb414ecc0 2023-07-13T14:22:15.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.298+0000 7fefb2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb406abc0 0x7fefb41ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:15.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.298+0000 7fefb37fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefb414ecc0 0x7fefb41570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:15.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.298+0000 7fefb2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb406abc0 0x7fefb41ee4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.118:35382/0 (socket says 172.21.15.118:35382) 2023-07-13T14:22:15.290 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.298+0000 7fefb2ffd700 1 -- 172.21.15.118:0/4192431797 learned_addr learned my addr 172.21.15.118:0/4192431797 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:15.293 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.302+0000 7fefb2ffd700 1 -- 172.21.15.118:0/4192431797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefb414ecc0 msgr2=0x7fefb41570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:15.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.302+0000 7fefb2ffd700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefb414ecc0 0x7fefb41570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.302+0000 7fefb2ffd700 1 -- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefb4070570 msgr2=0x7fefb4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:15.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.302+0000 7fefb2ffd700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefb4070570 0x7fefb4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:15.294 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.302+0000 7fefb2ffd700 1 -- 172.21.15.118:0/4192431797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa4009550 con 0x7fefb406abc0 2023-07-13T14:22:15.296 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.305+0000 7fefb2ffd700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb406abc0 0x7fefb41ee4e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fefa800e9e0 tx=0x7fefa800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:15.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.309+0000 7fef9b7fe700 1 -- 172.21.15.118:0/4192431797 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8009710 con 0x7fefb406abc0 2023-07-13T14:22:15.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.309+0000 7fef9b7fe700 1 -- 172.21.15.118:0/4192431797 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fefa800c850 con 0x7fefb406abc0 2023-07-13T14:22:15.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.309+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb41eeda0 con 0x7fefb406abc0 2023-07-13T14:22:15.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.309+0000 7fef9b7fe700 1 -- 172.21.15.118:0/4192431797 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa800cbe0 con 0x7fefb406abc0 2023-07-13T14:22:15.301 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.309+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb4151fa0 con 0x7fefb406abc0 2023-07-13T14:22:15.302 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.310+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb404e280 con 0x7fefb406abc0 2023-07-13T14:22:15.322 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.331+0000 7fef9b7fe700 1 -- 172.21.15.118:0/4192431797 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fefa800cd40 con 0x7fefb406abc0 2023-07-13T14:22:15.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.331+0000 7fef9b7fe700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fefa006ad10 0x7fefa006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:15.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.331+0000 7fefb27fc700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fefa006ad10 0x7fefa006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:15.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.332+0000 7fefb27fc700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fefa006ad10 0x7fefa006d1c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fefb406f140 tx=0x7fefa4010000 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:15.326 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.335+0000 7fef9b7fe700 1 -- 172.21.15.118:0/4192431797 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fefa805e2d0 con 0x7fefb406abc0 2023-07-13T14:22:15.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.574+0000 7fef9b7fe700 1 -- 172.21.15.118:0/4192431797 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fefa8056700 con 0x7fefb406abc0 2023-07-13T14:22:15.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:15.762+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fefb4070350 con 0x7fefb406abc0 2023-07-13T14:22:16.324 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.333+0000 7fef9b7fe700 1 -- 172.21.15.118:0/4192431797 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7fefa801e0d0 con 0x7fefb406abc0 2023-07-13T14:22:16.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fefa006ad10 msgr2=0x7fefa006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:16.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fefa006ad10 0x7fefa006d1c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fefb406f140 tx=0x7fefa4010000 comp rx=0 tx=0).stop 2023-07-13T14:22:16.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb406abc0 msgr2=0x7fefb41ee4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:16.327 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb406abc0 0x7fefb41ee4e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fefa800e9e0 tx=0x7fefa800ecf0 comp rx=0 tx=0).stop 2023-07-13T14:22:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 shutdown_connections 2023-07-13T14:22:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7fefa006ad10 0x7fefa006d1c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefb406abc0 0x7fefb41ee4e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fefb414ecc0 0x7fefb41570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 --2- 172.21.15.118:0/4192431797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fefb4070570 0x7fefb4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 >> 172.21.15.118:0/4192431797 conn(0x7fefb406bac0 msgr2=0x7fefb4154c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:16.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 shutdown_connections 2023-07-13T14:22:16.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.335+0000 7fefb9579700 1 -- 172.21.15.118:0/4192431797 wait complete. 2023-07-13T14:22:16.329 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2023-07-13T14:22:16.339 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-13T14:22:16.465 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.474+0000 7faa9e2e5700 1 Processor -- start 2023-07-13T14:22:16.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.474+0000 7faa9e2e5700 1 -- start start 2023-07-13T14:22:16.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.475+0000 7faa9e2e5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98070dd0 0x7faa98069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:16.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.475+0000 7faa9e2e5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa98158b80 con 0x7faa98158640 2023-07-13T14:22:16.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.475+0000 7faa9e2e5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa98158e60 con 0x7faa98152970 2023-07-13T14:22:16.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.475+0000 7faa9e2e5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa98159140 con 0x7faa98070dd0 2023-07-13T14:22:16.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.475+0000 7faa977fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98070dd0 0x7faa98069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:16.467 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.475+0000 7faa9c882700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7faa98158640 0x7faa980c8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:50570/0 (socket says 172.21.15.118:50570) 2023-07-13T14:22:16.468 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.475+0000 7faa9c882700 1 -- 172.21.15.118:0/424907153 learned_addr learned my addr 172.21.15.118:0/424907153 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-07-13T14:22:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.478+0000 7faa96ffd700 1 -- 172.21.15.118:0/424907153 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059259842 0 0) 0x7faa98158b80 con 0x7faa98158640 2023-07-13T14:22:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.479+0000 7faa96ffd700 1 -- 172.21.15.118:0/424907153 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa800035b0 con 0x7faa98158640 2023-07-13T14:22:16.470 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.479+0000 7faa977fe700 1 -- 172.21.15.118:0/424907153 >> v1:172.21.15.123:6789/0 conn(0x7faa98152970 legacy=0x7faa98071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.479+0000 7faa977fe700 1 -- 172.21.15.118:0/424907153 >> v1:172.21.15.118:6789/0 conn(0x7faa98158640 legacy=0x7faa980c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:16.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.479+0000 7faa977fe700 1 -- 172.21.15.118:0/424907153 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98159420 con 0x7faa98070dd0 2023-07-13T14:22:16.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.480+0000 7faa977fe700 1 --2- 172.21.15.118:0/424907153 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98070dd0 0x7faa98069f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009870 tx=0x7faa8c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d7b325a5064309 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:16.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.484+0000 7faa96ffd700 1 -- 172.21.15.118:0/424907153 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c011830 con 0x7faa98070dd0 2023-07-13T14:22:16.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa96ffd700 1 -- 172.21.15.118:0/424907153 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faa8c011990 con 0x7faa98070dd0 2023-07-13T14:22:16.476 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa96ffd700 1 -- 172.21.15.118:0/424907153 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c011d40 con 0x7faa98070dd0 2023-07-13T14:22:16.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa9e2e5700 1 -- 172.21.15.118:0/424907153 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98070dd0 msgr2=0x7faa98069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:16.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa9e2e5700 1 --2- 172.21.15.118:0/424907153 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98070dd0 0x7faa98069f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009870 tx=0x7faa8c009b80 comp rx=0 tx=0).stop 2023-07-13T14:22:16.477 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa9e2e5700 1 -- 172.21.15.118:0/424907153 shutdown_connections 2023-07-13T14:22:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa9e2e5700 1 --2- 172.21.15.118:0/424907153 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98070dd0 0x7faa98069f30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa9e2e5700 1 -- 172.21.15.118:0/424907153 >> 172.21.15.118:0/424907153 conn(0x7faa9806cf60 msgr2=0x7faa9806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa9e2e5700 1 -- 172.21.15.118:0/424907153 shutdown_connections 2023-07-13T14:22:16.478 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.485+0000 7faa9e2e5700 1 -- 172.21.15.118:0/424907153 wait complete. 2023-07-13T14:22:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.486+0000 7faa9e2e5700 1 Processor -- start 2023-07-13T14:22:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.487+0000 7faa9e2e5700 1 -- start start 2023-07-13T14:22:16.479 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.487+0000 7faa9e2e5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa98070dd0 0x7faa981e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:16.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.487+0000 7faa9e2e5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98152970 0x7faa981540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:16.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.487+0000 7faa9e2e5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa98158640 0x7faa98155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:16.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.487+0000 7faa9e2e5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa98153cb0 con 0x7faa98070dd0 2023-07-13T14:22:16.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.487+0000 7faa9e2e5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa980c3fc0 con 0x7faa98158640 2023-07-13T14:22:16.480 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.487+0000 7faa9e2e5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa980c4260 con 0x7faa98152970 2023-07-13T14:22:16.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.489+0000 7faa9c882700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa98158640 0x7faa98155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:16.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.489+0000 7faa97fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa98070dd0 0x7faa981e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:16.481 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.489+0000 7faa97fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa98070dd0 0x7faa981e53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:50398/0 (socket says 172.21.15.118:50398) 2023-07-13T14:22:16.482 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.489+0000 7faa97fff700 1 -- 172.21.15.118:0/3199608815 learned_addr learned my addr 172.21.15.118:0/3199608815 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-07-13T14:22:16.482 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.490+0000 7faa977fe700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98152970 0x7faa981540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:16.485 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.494+0000 7faa977fe700 1 -- 172.21.15.118:0/3199608815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa98158640 msgr2=0x7faa98155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:16.485 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.494+0000 7faa977fe700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa98158640 0x7faa98155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:16.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.494+0000 7faa977fe700 1 -- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa98070dd0 msgr2=0x7faa981e53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:16.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.494+0000 7faa977fe700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa98070dd0 0x7faa981e53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:16.486 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.494+0000 7faa977fe700 1 -- 172.21.15.118:0/3199608815 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c0094a0 con 0x7faa98152970 2023-07-13T14:22:16.488 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.497+0000 7faa977fe700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98152970 0x7faa981540d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa98072590 tx=0x7faa8c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:16.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.500+0000 7faa94ff9700 1 -- 172.21.15.118:0/3199608815 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c004510 con 0x7faa98152970 2023-07-13T14:22:16.492 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.500+0000 7faa94ff9700 1 -- 172.21.15.118:0/3199608815 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faa8c01f070 con 0x7faa98152970 2023-07-13T14:22:16.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.501+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa98153030 con 0x7faa98152970 2023-07-13T14:22:16.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.501+0000 7faa94ff9700 1 -- 172.21.15.118:0/3199608815 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c003900 con 0x7faa98152970 2023-07-13T14:22:16.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.501+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa981535f0 con 0x7faa98152970 2023-07-13T14:22:16.493 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.501+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa98153df0 con 0x7faa98152970 2023-07-13T14:22:16.743 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.752+0000 7faa94ff9700 1 -- 172.21.15.118:0/3199608815 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 7) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa8c003a60 con 0x7faa98152970 2023-07-13T14:22:16.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.752+0000 7faa94ff9700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7faa8406ace0 0x7faa8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-13T14:22:16.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.752+0000 7faa97fff700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7faa8406ace0 0x7faa8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-13T14:22:16.744 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.753+0000 7faa97fff700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7faa8406ace0 0x7faa8406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa88001910 tx=0x7faa88009040 comp rx=0 tx=0).ready entity=mgr.4192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-13T14:22:16.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.757+0000 7faa94ff9700 1 -- 172.21.15.118:0/3199608815 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6047+0+0 (secure 0 0 0) 0x7faa8c021070 con 0x7faa98152970 2023-07-13T14:22:16.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.767+0000 7faa94ff9700 1 -- 172.21.15.118:0/3199608815 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faa8c055d50 con 0x7faa98152970 2023-07-13T14:22:16.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:16.953+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa98153df0 con 0x7faa98152970 2023-07-13T14:22:17.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.430+0000 7faa94ff9700 1 -- 172.21.15.118:0/3199608815 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7faa98153df0 con 0x7faa98152970 2023-07-13T14:22:17.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7faa8406ace0 msgr2=0x7faa8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:17.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7faa8406ace0 0x7faa8406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa88001910 tx=0x7faa88009040 comp rx=0 tx=0).stop 2023-07-13T14:22:17.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98152970 msgr2=0x7faa981540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-13T14:22:17.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98152970 0x7faa981540d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa98072590 tx=0x7faa8c004750 comp rx=0 tx=0).stop 2023-07-13T14:22:17.425 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 shutdown_connections 2023-07-13T14:22:17.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:6832/1448394653,v1:172.21.15.118:6833/1448394653] conn(0x7faa8406ace0 0x7faa8406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:17.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa98158640 0x7faa98155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:17.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa98070dd0 0x7faa981e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:17.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 --2- 172.21.15.118:0/3199608815 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faa98152970 0x7faa981540d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-13T14:22:17.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 >> 172.21.15.118:0/3199608815 conn(0x7faa9806cf60 msgr2=0x7faa98156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-13T14:22:17.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 shutdown_connections 2023-07-13T14:22:17.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-07-13T14:22:17.433+0000 7faa9e2e5700 1 -- 172.21.15.118:0/3199608815 wait complete. 2023-07-13T14:22:17.427 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data_ec' removed 2023-07-13T14:22:17.437 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-13T14:22:17.438 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-13T14:22:17.438 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:22:17.452 INFO:tasks.ceph.mds.a.smithi118.stderr:2023-07-13T14:22:17.451+0000 11d24700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 150817) UID: 0 2023-07-13T14:22:17.452 INFO:tasks.ceph.mds.a.smithi118.stderr:2023-07-13T14:22:17.452+0000 11d24700 -1 mds.a *** got signal Terminated *** 2023-07-13T14:22:21.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~7s 2023-07-13T14:22:23.540 INFO:tasks.ceph.mds.a:Stopped 2023-07-13T14:22:23.541 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-13T14:22:23.541 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:22:23.558 INFO:tasks.ceph.mds.c.smithi118.stderr:2023-07-13T14:22:23.554+0000 11d24700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 150823) UID: 0 2023-07-13T14:22:23.558 INFO:tasks.ceph.mds.c.smithi118.stderr:2023-07-13T14:22:23.556+0000 11d24700 -1 mds.c *** got signal Terminated *** 2023-07-13T14:22:28.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-07-13T14:22:28.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~14s 2023-07-13T14:22:28.513 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:22:28.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:22:29.642 INFO:tasks.ceph.mds.c:Stopped 2023-07-13T14:22:29.643 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-07-13T14:22:29.643 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:22:29.643 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-07-13T14:22:29.644 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi118 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2023-07-13T14:22:29.644 INFO:tasks.ceph.mds.e:Stopped 2023-07-13T14:22:29.644 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-13T14:22:29.645 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:22:29.662 INFO:tasks.ceph.mds.b.smithi123.stderr:2023-07-13T14:22:29.658+0000 11d24700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 150780) UID: 0 2023-07-13T14:22:29.663 INFO:tasks.ceph.mds.b.smithi123.stderr:2023-07-13T14:22:29.660+0000 11d24700 -1 mds.b *** got signal Terminated *** 2023-07-13T14:22:34.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-13T14:22:34.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-07-13T14:22:34.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-07-13T14:22:35.746 INFO:tasks.ceph.mds.b:Stopped 2023-07-13T14:22:35.747 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-13T14:22:35.747 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:22:35.764 INFO:tasks.ceph.mds.d.smithi123.stderr:2023-07-13T14:22:35.761+0000 11d24700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 150783) UID: 0 2023-07-13T14:22:35.765 INFO:tasks.ceph.mds.d.smithi123.stderr:2023-07-13T14:22:35.763+0000 11d24700 -1 mds.d *** got signal Terminated *** 2023-07-13T14:22:41.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-13T14:22:41.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-13T14:22:41.849 INFO:tasks.ceph.mds.d:Stopped 2023-07-13T14:22:41.849 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-07-13T14:22:41.850 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:22:41.866 INFO:tasks.ceph.mds.f.smithi123.stderr:2023-07-13T14:22:41.863+0000 11d24700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 150786) UID: 0 2023-07-13T14:22:41.867 INFO:tasks.ceph.mds.f.smithi123.stderr:2023-07-13T14:22:41.865+0000 11d24700 -1 mds.f *** got signal Terminated *** 2023-07-13T14:22:47.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-07-13T14:22:47.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-07-13T14:22:47.952 INFO:tasks.ceph.mds.f:Stopped 2023-07-13T14:22:47.952 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-13T14:22:47.953 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-13T14:22:47.953 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:22:47.954 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-07-13T14:22:47.962+0000 7fd988736700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 146457) UID: 0 2023-07-13T14:22:47.954 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-07-13T14:22:47.962+0000 7fd988736700 -1 osd.0 40 *** Got signal Terminated *** 2023-07-13T14:22:53.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-07-13T14:22:53.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-07-13T14:22:54.056 INFO:tasks.ceph.osd.0:Stopped 2023-07-13T14:22:54.056 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-13T14:22:54.057 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:22:54.057 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-07-13T14:22:54.066+0000 7fe24641b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 146458) UID: 0 2023-07-13T14:22:54.057 INFO:tasks.ceph.osd.1.smithi118.stderr:2023-07-13T14:22:54.066+0000 7fe24641b700 -1 osd.1 42 *** Got signal Terminated *** 2023-07-13T14:22:55.057 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:31:29.573 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:55.117 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:31:29.632 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:55.122 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:31:29.605 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:55.127 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:31:29.609 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:55.195 INFO:tasks.ceph.mon.a.smithi118.stderr:==00:00:31:29.711 146089== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:55.203 INFO:tasks.ceph.mon.b.smithi123.stderr:==00:00:31:29.685 145937== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:55.239 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:31:29.721 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:55.242 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:31:29.724 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:55.305 INFO:tasks.ceph.mon.c.smithi123.stderr:==00:00:31:29.787 145938== Warning: unimplemented fcntl command: 1036 2023-07-13T14:22:58.631 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:22:58.634 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:22:59.847 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-07-13T14:22:59.847 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-07-13T14:23:00.159 INFO:tasks.ceph.osd.1:Stopped 2023-07-13T14:23:00.160 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-13T14:23:00.160 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:00.160 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-07-13T14:23:00.169+0000 7f12a454d700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 146467) UID: 0 2023-07-13T14:23:00.161 INFO:tasks.ceph.osd.2.smithi118.stderr:2023-07-13T14:23:00.169+0000 7f12a454d700 -1 osd.2 44 *** Got signal Terminated *** 2023-07-13T14:23:05.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-07-13T14:23:05.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-07-13T14:23:06.262 INFO:tasks.ceph.osd.2:Stopped 2023-07-13T14:23:06.262 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-13T14:23:06.263 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:06.263 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-07-13T14:23:06.271+0000 7f2d53d08700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 146471) UID: 0 2023-07-13T14:23:06.263 INFO:tasks.ceph.osd.3.smithi118.stderr:2023-07-13T14:23:06.271+0000 7f2d53d08700 -1 osd.3 46 *** Got signal Terminated *** 2023-07-13T14:23:11.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-07-13T14:23:11.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-07-13T14:23:12.364 INFO:tasks.ceph.osd.3:Stopped 2023-07-13T14:23:12.365 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-13T14:23:12.365 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:12.366 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-07-13T14:23:12.374+0000 7f3521974700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 146649) UID: 0 2023-07-13T14:23:12.366 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-07-13T14:23:12.374+0000 7f3521974700 -1 osd.4 47 *** Got signal Terminated *** 2023-07-13T14:23:17.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-07-13T14:23:17.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-07-13T14:23:18.467 INFO:tasks.ceph.osd.4:Stopped 2023-07-13T14:23:18.467 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-13T14:23:18.468 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:18.468 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T14:23:18.477+0000 7fc4a16cd700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 146654) UID: 0 2023-07-13T14:23:18.469 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T14:23:18.477+0000 7fc4a16cd700 -1 osd.5 48 *** Got signal Terminated *** 2023-07-13T14:23:19.655 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T14:23:19.664+0000 7fc4a16cd700 -1 osd.5 49 pgid 2.2 has ref count of 2 2023-07-13T14:23:20.372 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T14:23:20.379+0000 7fc4ac32a640 -1 leaked refs: 2023-07-13T14:23:20.372 INFO:tasks.ceph.osd.5.smithi123.stderr:dump_weak_refs 0x5620fa0ce348 weak_refs: 49 = 0x5620fb751000 with 1 refs 2023-07-13T14:23:20.372 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.373 INFO:tasks.ceph.osd.5.smithi123.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4842-gf0b380e6/rpm/el8/BUILD/ceph-18.0.0-4842-gf0b380e6/src/common/shared_cache.hpp: In function 'SharedLRU::~SharedLRU() [with K = unsigned int; V = const OSDMap]' thread 7fc4ac32a640 time 2023-07-13T14:23:20.380574+0000 2023-07-13T14:23:20.373 INFO:tasks.ceph.osd.5.smithi123.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4842-gf0b380e6/rpm/el8/BUILD/ceph-18.0.0-4842-gf0b380e6/src/common/shared_cache.hpp: 119: FAILED ceph_assert(weak_refs.empty()) 2023-07-13T14:23:20.373 INFO:tasks.ceph.osd.5.smithi123.stderr: ceph version 18.0.0-4842-gf0b380e6 (f0b380e693e28c35a89e7c2062b0976b7def7973) reef (dev) 2023-07-13T14:23:20.373 INFO:tasks.ceph.osd.5.smithi123.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x5620f6e348db] 2023-07-13T14:23:20.374 INFO:tasks.ceph.osd.5.smithi123.stderr: 2: ceph-osd(+0x634aa1) [0x5620f6e34aa1] 2023-07-13T14:23:20.374 INFO:tasks.ceph.osd.5.smithi123.stderr: 3: (SharedLRU::~SharedLRU()+0x3f1) [0x5620f6fe19f1] 2023-07-13T14:23:20.374 INFO:tasks.ceph.osd.5.smithi123.stderr: 4: (OSDService::~OSDService()+0x39a) [0x5620f6fe829a] 2023-07-13T14:23:20.374 INFO:tasks.ceph.osd.5.smithi123.stderr: 5: (OSD::~OSD()+0x27a) [0x5620f6f8869a] 2023-07-13T14:23:20.374 INFO:tasks.ceph.osd.5.smithi123.stderr: 6: (OSD::~OSD()+0xd) [0x5620f6f88bed] 2023-07-13T14:23:20.374 INFO:tasks.ceph.osd.5.smithi123.stderr: 7: main() 2023-07-13T14:23:20.374 INFO:tasks.ceph.osd.5.smithi123.stderr: 8: __libc_start_main() 2023-07-13T14:23:20.375 INFO:tasks.ceph.osd.5.smithi123.stderr: 9: _start() 2023-07-13T14:23:20.375 INFO:tasks.ceph.osd.5.smithi123.stderr:*** Caught signal (Aborted) ** 2023-07-13T14:23:20.375 INFO:tasks.ceph.osd.5.smithi123.stderr: in thread 7fc4ac32a640 thread_name:ceph-osd 2023-07-13T14:23:20.375 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T14:23:20.382+0000 7fc4ac32a640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4842-gf0b380e6/rpm/el8/BUILD/ceph-18.0.0-4842-gf0b380e6/src/common/shared_cache.hpp: In function 'SharedLRU::~SharedLRU() [with K = unsigned int; V = const OSDMap]' thread 7fc4ac32a640 time 2023-07-13T14:23:20.380574+0000 2023-07-13T14:23:20.375 INFO:tasks.ceph.osd.5.smithi123.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4842-gf0b380e6/rpm/el8/BUILD/ceph-18.0.0-4842-gf0b380e6/src/common/shared_cache.hpp: 119: FAILED ceph_assert(weak_refs.empty()) 2023-07-13T14:23:20.375 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.375 INFO:tasks.ceph.osd.5.smithi123.stderr: ceph version 18.0.0-4842-gf0b380e6 (f0b380e693e28c35a89e7c2062b0976b7def7973) reef (dev) 2023-07-13T14:23:20.375 INFO:tasks.ceph.osd.5.smithi123.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x5620f6e348db] 2023-07-13T14:23:20.376 INFO:tasks.ceph.osd.5.smithi123.stderr: 2: ceph-osd(+0x634aa1) [0x5620f6e34aa1] 2023-07-13T14:23:20.376 INFO:tasks.ceph.osd.5.smithi123.stderr: 3: (SharedLRU::~SharedLRU()+0x3f1) [0x5620f6fe19f1] 2023-07-13T14:23:20.376 INFO:tasks.ceph.osd.5.smithi123.stderr: 4: (OSDService::~OSDService()+0x39a) [0x5620f6fe829a] 2023-07-13T14:23:20.376 INFO:tasks.ceph.osd.5.smithi123.stderr: 5: (OSD::~OSD()+0x27a) [0x5620f6f8869a] 2023-07-13T14:23:20.376 INFO:tasks.ceph.osd.5.smithi123.stderr: 6: (OSD::~OSD()+0xd) [0x5620f6f88bed] 2023-07-13T14:23:20.376 INFO:tasks.ceph.osd.5.smithi123.stderr: 7: main() 2023-07-13T14:23:20.376 INFO:tasks.ceph.osd.5.smithi123.stderr: 8: __libc_start_main() 2023-07-13T14:23:20.377 INFO:tasks.ceph.osd.5.smithi123.stderr: 9: _start() 2023-07-13T14:23:20.377 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.377 INFO:tasks.ceph.osd.5.smithi123.stderr: ceph version 18.0.0-4842-gf0b380e6 (f0b380e693e28c35a89e7c2062b0976b7def7973) reef (dev) 2023-07-13T14:23:20.377 INFO:tasks.ceph.osd.5.smithi123.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc4a9de6cf0] 2023-07-13T14:23:20.377 INFO:tasks.ceph.osd.5.smithi123.stderr: 2: gsignal() 2023-07-13T14:23:20.378 INFO:tasks.ceph.osd.5.smithi123.stderr: 3: abort() 2023-07-13T14:23:20.378 INFO:tasks.ceph.osd.5.smithi123.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x5620f6e34935] 2023-07-13T14:23:20.378 INFO:tasks.ceph.osd.5.smithi123.stderr: 5: ceph-osd(+0x634aa1) [0x5620f6e34aa1] 2023-07-13T14:23:20.378 INFO:tasks.ceph.osd.5.smithi123.stderr: 6: (SharedLRU::~SharedLRU()+0x3f1) [0x5620f6fe19f1] 2023-07-13T14:23:20.378 INFO:tasks.ceph.osd.5.smithi123.stderr: 7: (OSDService::~OSDService()+0x39a) [0x5620f6fe829a] 2023-07-13T14:23:20.378 INFO:tasks.ceph.osd.5.smithi123.stderr: 8: (OSD::~OSD()+0x27a) [0x5620f6f8869a] 2023-07-13T14:23:20.378 INFO:tasks.ceph.osd.5.smithi123.stderr: 9: (OSD::~OSD()+0xd) [0x5620f6f88bed] 2023-07-13T14:23:20.379 INFO:tasks.ceph.osd.5.smithi123.stderr: 10: main() 2023-07-13T14:23:20.379 INFO:tasks.ceph.osd.5.smithi123.stderr: 11: __libc_start_main() 2023-07-13T14:23:20.379 INFO:tasks.ceph.osd.5.smithi123.stderr: 12: _start() 2023-07-13T14:23:20.379 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-07-13T14:23:20.385+0000 7fc4ac32a640 -1 *** Caught signal (Aborted) ** 2023-07-13T14:23:20.379 INFO:tasks.ceph.osd.5.smithi123.stderr: in thread 7fc4ac32a640 thread_name:ceph-osd 2023-07-13T14:23:20.379 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.379 INFO:tasks.ceph.osd.5.smithi123.stderr: ceph version 18.0.0-4842-gf0b380e6 (f0b380e693e28c35a89e7c2062b0976b7def7973) reef (dev) 2023-07-13T14:23:20.379 INFO:tasks.ceph.osd.5.smithi123.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc4a9de6cf0] 2023-07-13T14:23:20.380 INFO:tasks.ceph.osd.5.smithi123.stderr: 2: gsignal() 2023-07-13T14:23:20.380 INFO:tasks.ceph.osd.5.smithi123.stderr: 3: abort() 2023-07-13T14:23:20.380 INFO:tasks.ceph.osd.5.smithi123.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x5620f6e34935] 2023-07-13T14:23:20.380 INFO:tasks.ceph.osd.5.smithi123.stderr: 5: ceph-osd(+0x634aa1) [0x5620f6e34aa1] 2023-07-13T14:23:20.380 INFO:tasks.ceph.osd.5.smithi123.stderr: 6: (SharedLRU::~SharedLRU()+0x3f1) [0x5620f6fe19f1] 2023-07-13T14:23:20.380 INFO:tasks.ceph.osd.5.smithi123.stderr: 7: (OSDService::~OSDService()+0x39a) [0x5620f6fe829a] 2023-07-13T14:23:20.380 INFO:tasks.ceph.osd.5.smithi123.stderr: 8: (OSD::~OSD()+0x27a) [0x5620f6f8869a] 2023-07-13T14:23:20.380 INFO:tasks.ceph.osd.5.smithi123.stderr: 9: (OSD::~OSD()+0xd) [0x5620f6f88bed] 2023-07-13T14:23:20.381 INFO:tasks.ceph.osd.5.smithi123.stderr: 10: main() 2023-07-13T14:23:20.381 INFO:tasks.ceph.osd.5.smithi123.stderr: 11: __libc_start_main() 2023-07-13T14:23:20.381 INFO:tasks.ceph.osd.5.smithi123.stderr: 12: _start() 2023-07-13T14:23:20.381 INFO:tasks.ceph.osd.5.smithi123.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-13T14:23:20.381 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.388 INFO:tasks.ceph.osd.5.smithi123.stderr: -2052> 2023-07-13T14:23:18.477+0000 7fc4a16cd700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 146654) UID: 0 2023-07-13T14:23:20.388 INFO:tasks.ceph.osd.5.smithi123.stderr: -2051> 2023-07-13T14:23:18.477+0000 7fc4a16cd700 -1 osd.5 48 *** Got signal Terminated *** 2023-07-13T14:23:20.389 INFO:tasks.ceph.osd.5.smithi123.stderr: -1132> 2023-07-13T14:23:19.664+0000 7fc4a16cd700 -1 osd.5 49 pgid 2.2 has ref count of 2 2023-07-13T14:23:20.390 INFO:tasks.ceph.osd.5.smithi123.stderr: -2> 2023-07-13T14:23:20.379+0000 7fc4ac32a640 -1 leaked refs: 2023-07-13T14:23:20.390 INFO:tasks.ceph.osd.5.smithi123.stderr:dump_weak_refs 0x5620fa0ce348 weak_refs: 49 = 0x5620fb751000 with 1 refs 2023-07-13T14:23:20.390 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.391 INFO:tasks.ceph.osd.5.smithi123.stderr: -1> 2023-07-13T14:23:20.382+0000 7fc4ac32a640 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4842-gf0b380e6/rpm/el8/BUILD/ceph-18.0.0-4842-gf0b380e6/src/common/shared_cache.hpp: In function 'SharedLRU::~SharedLRU() [with K = unsigned int; V = const OSDMap]' thread 7fc4ac32a640 time 2023-07-13T14:23:20.380574+0000 2023-07-13T14:23:20.391 INFO:tasks.ceph.osd.5.smithi123.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4842-gf0b380e6/rpm/el8/BUILD/ceph-18.0.0-4842-gf0b380e6/src/common/shared_cache.hpp: 119: FAILED ceph_assert(weak_refs.empty()) 2023-07-13T14:23:20.391 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.391 INFO:tasks.ceph.osd.5.smithi123.stderr: ceph version 18.0.0-4842-gf0b380e6 (f0b380e693e28c35a89e7c2062b0976b7def7973) reef (dev) 2023-07-13T14:23:20.391 INFO:tasks.ceph.osd.5.smithi123.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x5620f6e348db] 2023-07-13T14:23:20.391 INFO:tasks.ceph.osd.5.smithi123.stderr: 2: ceph-osd(+0x634aa1) [0x5620f6e34aa1] 2023-07-13T14:23:20.391 INFO:tasks.ceph.osd.5.smithi123.stderr: 3: (SharedLRU::~SharedLRU()+0x3f1) [0x5620f6fe19f1] 2023-07-13T14:23:20.391 INFO:tasks.ceph.osd.5.smithi123.stderr: 4: (OSDService::~OSDService()+0x39a) [0x5620f6fe829a] 2023-07-13T14:23:20.392 INFO:tasks.ceph.osd.5.smithi123.stderr: 5: (OSD::~OSD()+0x27a) [0x5620f6f8869a] 2023-07-13T14:23:20.392 INFO:tasks.ceph.osd.5.smithi123.stderr: 6: (OSD::~OSD()+0xd) [0x5620f6f88bed] 2023-07-13T14:23:20.392 INFO:tasks.ceph.osd.5.smithi123.stderr: 7: main() 2023-07-13T14:23:20.392 INFO:tasks.ceph.osd.5.smithi123.stderr: 8: __libc_start_main() 2023-07-13T14:23:20.392 INFO:tasks.ceph.osd.5.smithi123.stderr: 9: _start() 2023-07-13T14:23:20.392 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.392 INFO:tasks.ceph.osd.5.smithi123.stderr: 0> 2023-07-13T14:23:20.385+0000 7fc4ac32a640 -1 *** Caught signal (Aborted) ** 2023-07-13T14:23:20.393 INFO:tasks.ceph.osd.5.smithi123.stderr: in thread 7fc4ac32a640 thread_name:ceph-osd 2023-07-13T14:23:20.393 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:20.393 INFO:tasks.ceph.osd.5.smithi123.stderr: ceph version 18.0.0-4842-gf0b380e6 (f0b380e693e28c35a89e7c2062b0976b7def7973) reef (dev) 2023-07-13T14:23:20.393 INFO:tasks.ceph.osd.5.smithi123.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc4a9de6cf0] 2023-07-13T14:23:20.393 INFO:tasks.ceph.osd.5.smithi123.stderr: 2: gsignal() 2023-07-13T14:23:20.393 INFO:tasks.ceph.osd.5.smithi123.stderr: 3: abort() 2023-07-13T14:23:20.393 INFO:tasks.ceph.osd.5.smithi123.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x5620f6e34935] 2023-07-13T14:23:20.393 INFO:tasks.ceph.osd.5.smithi123.stderr: 5: ceph-osd(+0x634aa1) [0x5620f6e34aa1] 2023-07-13T14:23:20.394 INFO:tasks.ceph.osd.5.smithi123.stderr: 6: (SharedLRU::~SharedLRU()+0x3f1) [0x5620f6fe19f1] 2023-07-13T14:23:20.394 INFO:tasks.ceph.osd.5.smithi123.stderr: 7: (OSDService::~OSDService()+0x39a) [0x5620f6fe829a] 2023-07-13T14:23:20.394 INFO:tasks.ceph.osd.5.smithi123.stderr: 8: (OSD::~OSD()+0x27a) [0x5620f6f8869a] 2023-07-13T14:23:20.394 INFO:tasks.ceph.osd.5.smithi123.stderr: 9: (OSD::~OSD()+0xd) [0x5620f6f88bed] 2023-07-13T14:23:20.394 INFO:tasks.ceph.osd.5.smithi123.stderr: 10: main() 2023-07-13T14:23:20.394 INFO:tasks.ceph.osd.5.smithi123.stderr: 11: __libc_start_main() 2023-07-13T14:23:20.394 INFO:tasks.ceph.osd.5.smithi123.stderr: 12: _start() 2023-07-13T14:23:20.394 INFO:tasks.ceph.osd.5.smithi123.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-13T14:23:20.395 INFO:tasks.ceph.osd.5.smithi123.stderr: 2023-07-13T14:23:21.126 INFO:tasks.ceph.osd.5.smithi123.stderr:daemon-helper: command crashed with signal 11 2023-07-13T14:23:23.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-07-13T14:23:23.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-07-13T14:23:24.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T14:23:24.570 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5' 2023-07-13T14:23:24.571 INFO:tasks.ceph.osd.5:Stopped 2023-07-13T14:23:24.571 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-13T14:23:24.571 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:24.572 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-07-13T14:23:24.581+0000 7f46aa342700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 146655) UID: 0 2023-07-13T14:23:24.572 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-07-13T14:23:24.581+0000 7f46aa342700 -1 osd.6 49 *** Got signal Terminated *** 2023-07-13T14:23:28.754 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:23:28.758 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:23:28.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-07-13T14:23:28.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-07-13T14:23:30.673 INFO:tasks.ceph.osd.6:Stopped 2023-07-13T14:23:30.673 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-13T14:23:30.674 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:30.674 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-07-13T14:23:30.683+0000 7f6a50661700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 146658) UID: 0 2023-07-13T14:23:30.674 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-07-13T14:23:30.683+0000 7f6a50661700 -1 osd.7 49 *** Got signal Terminated *** 2023-07-13T14:23:34.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-13T14:23:34.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-07-13T14:23:36.776 INFO:tasks.ceph.osd.7:Stopped 2023-07-13T14:23:36.776 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-13T14:23:36.777 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-13T14:23:36.777 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:36.778 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T14:23:36.786+0000 7feadfed1700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 146116) UID: 0 2023-07-13T14:23:36.778 INFO:tasks.ceph.mgr.y.smithi118.stderr:2023-07-13T14:23:36.786+0000 7feadfed1700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-13T14:23:36.806 INFO:tasks.ceph.mgr.y:Stopped 2023-07-13T14:23:36.807 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-13T14:23:36.807 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:36.832 INFO:tasks.ceph.mgr.x:Stopped 2023-07-13T14:23:36.832 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-13T14:23:36.832 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-13T14:23:36.833 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:36.866 INFO:tasks.ceph.mon.a.smithi118.stderr:2023-07-13T14:23:36.860+0000 10d53700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 146068) UID: 0 2023-07-13T14:23:36.867 INFO:tasks.ceph.mon.a.smithi118.stderr:2023-07-13T14:23:36.862+0000 10d53700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-13T14:23:39.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-07-13T14:23:39.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-13T14:23:42.934 INFO:tasks.ceph.mon.a:Stopped 2023-07-13T14:23:42.935 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-13T14:23:42.935 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:42.958 INFO:tasks.ceph.mon.b.smithi123.stderr:2023-07-13T14:23:42.950+0000 10d53700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 145925) UID: 0 2023-07-13T14:23:42.960 INFO:tasks.ceph.mon.b.smithi123.stderr:2023-07-13T14:23:42.952+0000 10d53700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-13T14:23:44.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-07-13T14:23:44.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-07-13T14:23:49.037 INFO:tasks.ceph.mon.b:Stopped 2023-07-13T14:23:49.037 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-13T14:23:49.038 INFO:teuthology.orchestra.run:waiting for 300 2023-07-13T14:23:49.060 INFO:tasks.ceph.mon.c.smithi123.stderr:2023-07-13T14:23:49.051+0000 10d53700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 145932) UID: 0 2023-07-13T14:23:49.061 INFO:tasks.ceph.mon.c.smithi123.stderr:2023-07-13T14:23:49.053+0000 10d53700 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-07-13T14:23:49.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-07-13T14:23:54.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-07-13T14:23:55.139 INFO:tasks.ceph.mon.c:Stopped 2023-07-13T14:23:55.140 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-13T14:23:55.140 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-07-13T14:23:55.180 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T14:23:55.180 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-13T14:23:55.320 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T14:23:55.320 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-13T14:23:55.381 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T14:23:55.381 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-13T14:23:55.439 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T14:23:55.439 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-13T14:23:55.534 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T14:23:55.534 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-13T14:23:55.731 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T14:23:55.731 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-13T14:23:55.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T14:23:55.825 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-13T14:23:55.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T14:23:55.907 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-13T14:23:56.002 INFO:tasks.ceph:Archiving mon data... 2023-07-13T14:23:56.003 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/data/mon.a.tgz 2023-07-13T14:23:56.004 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-07-13T14:23:56.022 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.WTe8bX4Qjf 2023-07-13T14:23:56.023 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WTe8bX4Qjf 2023-07-13T14:23:56.158 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.WTe8bX4Qjf 2023-07-13T14:23:56.244 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.WTe8bX4Qjf is 348KB 2023-07-13T14:23:56.337 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.WTe8bX4Qjf 2023-07-13T14:23:56.354 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/data/mon.b.tgz 2023-07-13T14:23:56.355 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-07-13T14:23:56.377 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.llyggD9sDQ 2023-07-13T14:23:56.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.llyggD9sDQ 2023-07-13T14:23:56.533 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.llyggD9sDQ 2023-07-13T14:23:56.624 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.llyggD9sDQ is 352KB 2023-07-13T14:23:56.716 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.llyggD9sDQ 2023-07-13T14:23:56.734 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/data/mon.c.tgz 2023-07-13T14:23:56.734 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-07-13T14:23:56.792 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.TQj5089k6p 2023-07-13T14:23:56.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TQj5089k6p 2023-07-13T14:23:56.922 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.TQj5089k6p 2023-07-13T14:23:57.008 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.TQj5089k6p is 352KB 2023-07-13T14:23:57.075 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.TQj5089k6p 2023-07-13T14:23:57.092 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-13T14:23:57.093 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-13T14:23:57.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-13T14:23:57.159 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-13T14:23:57.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-13T14:23:57.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-13T14:23:57.208 INFO:teuthology.orchestra.run.smithi118.stdout:/var/log/ceph/valgrind/mds.e.log: Leak_PossiblyLost 2023-07-13T14:23:57.209 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mds.e.log kind Leak_PossiblyLost 2023-07-13T14:23:57.243 INFO:tasks.ceph:Archiving crash dumps... 2023-07-13T14:23:57.245 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/remote/smithi118/crash 2023-07-13T14:23:57.246 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-13T14:23:57.273 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/remote/smithi123/crash 2023-07-13T14:23:57.274 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-13T14:23:57.312 INFO:tasks.ceph:Shutting down logrotate 2023-07-13T14:23:57.312 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:23:57.317 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-13T14:23:57.548 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-13T14:23:57.576 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-13T14:23:57.603 INFO:tasks.ceph:Compressing logs... 2023-07-13T14:23:57.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T14:23:57.619 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T14:23:59.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-07-13T14:24:41.313 INFO:tasks.ceph:Archiving logs... 2023-07-13T14:24:41.314 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/remote/smithi118/log 2023-07-13T14:24:41.315 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-13T14:24:45.967 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/remote/smithi123/log 2023-07-13T14:24:45.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-13T14:24:47.514 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-13T14:24:47.523 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-13T14:24:47.524 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-13T14:24:47.526 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-13T14:24:47.621 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-13T14:24:47.630 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-13T14:24:47.630 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T14:24:47.633 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T14:24:47.652 INFO:teuthology.orchestra.run.smithi118.stderr:bash: ntpq: command not found 2023-07-13T14:24:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2023-07-13T14:24:47.657 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-13T14:24:47.657 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2023-07-13T14:24:47.658 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 -224us[ -224us] +/- 96ms 2023-07-13T14:24:47.658 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 +2142us[+2142us] +/- 69ms 2023-07-13T14:24:47.658 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv03.front.sepia.ceph.com 3 7 377 99 -2498us[-2589us] +/- 95ms 2023-07-13T14:24:47.658 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T14:24:47.658 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-13T14:24:47.658 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2023-07-13T14:24:47.658 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 -205us[ -175us] +/- 96ms 2023-07-13T14:24:47.659 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 +2167us[+2197us] +/- 69ms 2023-07-13T14:24:47.659 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -2657us[-1193us] +/- 96ms 2023-07-13T14:24:47.659 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-13T14:24:47.660 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-13T14:24:47.669 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-13T14:24:47.669 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-13T14:24:47.678 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-13T14:24:47.804 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-13T14:24:47.899 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-13T14:24:47.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T14:24:47.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-13T14:24:47.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T14:24:47.973 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-13T14:24:47.983 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-13T14:24:47.993 INFO:teuthology.task.internal:Duration was 6282.913960 seconds 2023-07-13T14:24:47.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-13T14:24:48.002 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-13T14:24:48.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-13T14:24:48.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-13T14:24:48.060 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-13T14:24:48.060 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-13T14:24:48.213 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-13T14:24:48.214 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-07-13T14:24:48.214 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-13T14:24:48.239 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2023-07-13T14:24:48.240 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-13T14:24:48.262 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-13T14:24:48.262 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T14:24:48.282 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T14:24:48.340 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-13T14:24:48.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T14:24:48.365 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T14:24:48.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-13T14:24:48.457 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-13T14:24:48.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-13T14:24:48.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-13T14:24:48.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-13T14:24:48.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-13T14:24:48.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-13T14:24:48.553 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-07-13T14:24:48.580 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2023-07-13T14:24:48.623 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-13T14:24:48.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T14:24:48.641 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-13T14:24:48.680 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi123.front.sepia.ceph.com, flagging run as failed 2023-07-13T14:24:48.680 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-13T14:24:48.690 INFO:teuthology.task.internal:Transferring archived files... 2023-07-13T14:24:48.691 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/remote/smithi118 2023-07-13T14:24:48.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-13T14:24:48.726 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/remote/smithi123 2023-07-13T14:24:48.727 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-13T14:25:09.159 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-07-13T14:25:09.210 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090/remote/smithi123/coredump/1689258200.146679.core.gz: gzip compressed data, was "1689258200.146679.core", last modified: Thu Jul 13 14:24:48 2023, max compression 2023-07-13T14:25:09.211 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-07-13T14:25:10.540 INFO:teuthology.task.internal: core looks like: /tmp/tmpxt5g8qjy: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'ceph-osd -f --cluster ceph -i 5', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-osd', platform: 'x86_64' 2023-07-13T14:25:10.582 INFO:teuthology.task.internal: dump_program: ceph-osd -f --cluster ceph -i 5 2023-07-13T14:25:10.583 DEBUG:teuthology.orchestra.run.smithi123:> which 'ceph-osd -f --cluster ceph -i 5' 2023-07-13T14:25:10.607 INFO:teuthology.orchestra.run.smithi123.stderr:/usr/bin/which: invalid option -- 'f' 2023-07-13T14:25:10.607 INFO:teuthology.orchestra.run.smithi123.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-07-13T14:25:10.607 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-osd 2023-07-13T14:25:10.607 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph 2023-07-13T14:25:10.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T14:25:10.608 INFO:teuthology.orchestra.run.smithi123.stderr:/usr/bin/which: no 5 in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-07-13T14:25:10.609 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: "which 'ceph-osd -f --cluster ceph -i 5'" 2023-07-13T14:25:10.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-13T14:25:10.622 INFO:teuthology.task.internal:Not uploading archives. 2023-07-13T14:25:10.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-13T14:25:10.636 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-13T14:25:10.636 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-13T14:25:10.639 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-13T14:25:10.659 INFO:teuthology.orchestra.run.smithi118.stdout: 525350 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 13 14:24 /home/ubuntu/cephtest 2023-07-13T14:25:10.660 INFO:teuthology.orchestra.run.smithi118.stdout: 525352 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Jul 13 14:24 /home/ubuntu/cephtest/archive 2023-07-13T14:25:10.660 INFO:teuthology.orchestra.run.smithi118.stdout: 1573196 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jul 13 14:24 /home/ubuntu/cephtest/archive/audit 2023-07-13T14:25:10.660 INFO:teuthology.orchestra.run.smithi118.stdout: 1573198 248 -rw------- 1 ubuntu ubuntu 253797 Jul 13 14:24 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-07-13T14:25:10.660 INFO:teuthology.orchestra.run.smithi118.stdout: 525358 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 13 14:24 /home/ubuntu/cephtest/archive/syslog 2023-07-13T14:25:10.660 INFO:teuthology.orchestra.run.smithi118.stdout: 525618 4 -rw-rw-rw- 1 ubuntu ubuntu 1139 Jul 13 14:23 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-07-13T14:25:10.660 INFO:teuthology.orchestra.run.smithi118.stdout: 525360 100 -rw-rw-r-- 1 ubuntu ubuntu 102036 Jul 13 14:24 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T14:25:10.660 INFO:teuthology.orchestra.run.smithi118.stdout: 525359 100 -rw-rw-rw- 1 ubuntu ubuntu 102278 Jul 13 14:24 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-07-13T14:25:10.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T14:25:10.662 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-13T14:25:10.662 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: "which 'ceph-osd -f --cluster ceph -i 5'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi118 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-07-13T14:25:10.663 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-13T14:25:10.673 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-13T14:25:10.683 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi123 with status 1: "which 'ceph-osd -f --cluster ceph -i 5'" 2023-07-13T14:25:10.683 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T14:25:10.687 INFO:teuthology.orchestra.run.smithi123.stdout: 525362 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jul 13 14:24 /home/ubuntu/cephtest 2023-07-13T14:25:10.687 INFO:teuthology.orchestra.run.smithi123.stdout: 525363 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Jul 13 14:24 /home/ubuntu/cephtest/archive 2023-07-13T14:25:10.688 INFO:teuthology.orchestra.run.smithi123.stdout: 525364 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 13 14:23 /home/ubuntu/cephtest/archive/coredump 2023-07-13T14:25:10.688 INFO:teuthology.orchestra.run.smithi123.stdout: 525642 108456 -rw------- 1 root root 311693312 Jul 13 14:23 /home/ubuntu/cephtest/archive/coredump/1689258200.146679.core 2023-07-13T14:25:10.688 INFO:teuthology.orchestra.run.smithi123.stdout: 1572913 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jul 13 14:24 /home/ubuntu/cephtest/archive/audit 2023-07-13T14:25:10.688 INFO:teuthology.orchestra.run.smithi123.stdout: 1573195 228 -rw------- 1 ubuntu ubuntu 231154 Jul 13 14:24 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-07-13T14:25:10.688 INFO:teuthology.orchestra.run.smithi123.stdout: 525366 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 13 14:24 /home/ubuntu/cephtest/archive/syslog 2023-07-13T14:25:10.688 INFO:teuthology.orchestra.run.smithi123.stdout: 525618 4 -rw-rw-rw- 1 ubuntu ubuntu 918 Jul 13 14:23 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-07-13T14:25:10.689 INFO:teuthology.orchestra.run.smithi123.stdout: 525534 92 -rw-rw-r-- 1 ubuntu ubuntu 94024 Jul 13 14:24 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T14:25:10.689 INFO:teuthology.orchestra.run.smithi123.stdout: 525437 92 -rw-rw-rw- 1 ubuntu ubuntu 91805 Jul 13 14:24 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-07-13T14:25:10.689 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-07-13T14:25:10.717 DEBUG:teuthology.nuke:shortname: smithi118 2023-07-13T14:25:10.718 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T14:25:10.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 12:13:41.529694', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3Mna00yLVPHncl6oc7Y9Amf4aFlw2hLXHndF4YDriNgrX6lPR/c8ETczOKv7PcBKwOFgfZT123gd9GT2XHLJI5nFNMrPu6dkn+bvH2wz62D5SfL9yNu8hgDqjCAl7N5+TXa7uWUIi2WPq8wk27GQlqdg+I3vRlbvDTsThblukUualPREj0j/vXnBZ4YxDF8kS+R9o5mFwKWGrmOmupZf24YNGuKJ1L3L4d+WsDXnHGzyuR7twuD9o4AWQrSbhsfKNEk+gBCEda6gGMg6RHUrYCtKa8mHjK3VjS1p0rgnUJtnMoH2bjVb5QAiVIgayDMk9siq+CBcsctLnBEgxlC1JE5/BFNoln5MEsboigc5eSreCL8RfcnqvDWpes6OK2btpt7NN58Qtc9GICw1l1ZqpnjRHxGCoOrtieN8IyNUUA6QY5q/sQ2lnWaktE9rofCLkJ+5HlRnwuX9/+7/v+X5/idkDUi8bwj0JSU5kiHZ1nSFQprPI4YDNZOYmQRCcehs='} 2023-07-13T14:25:10.746 DEBUG:teuthology.nuke:shortname: smithi123 2023-07-13T14:25:10.747 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T14:25:10.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-13_12:11:45-fs:verify-main-distro-default-smithi/7336090', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 12:13:41.527387', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHchmyXf71FoMjzc4gel+uknrOySkqwMGM2j7V6w3y5U1XIXal9UUqr+ZvMNTemEG+60j7l3jBN1EfuGxTjiNZA='} 2023-07-13T14:25:10.801 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-13T14:25:10.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T14:25:10.818 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-13T14:25:10.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T14:25:10.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T14:25:10.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T14:25:14.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T14:25:14.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T14:25:18.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T14:25:18.977 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T14:25:19.180 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-13T14:25:23.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T14:25:23.303 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-13T14:25:23.408 INFO:teuthology.run:Summary data: description: fs:verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 6282.91396021843 failure_reason: Found coredumps on ubuntu@smithi123.front.sepia.ceph.com flavor: default owner: scheduled_matan@teuthology status: fail success: false 2023-07-13T14:25:23.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T14:25:23.497 INFO:teuthology.run:FAIL